Prepare

So i think i must be missing something or maybe even forgetten.My dataflow: I have a Data source connection (dsc) ingesting csv-files from a S3 bucket with an aggregation pattern since the files have the date in the filename to make sure we dont overwrite any files. Each row in each file has a column with the date. So all rows in the file has the same date. The ingestion has a data type override to override all columns to nvarchar(max) since we cant trust the data source. The data is then transfered to a to a table in a data area as is.  Next step is with a view for validation and a simple table insert move data to a table with data types we want to work with.This last table is a History table. Not that we use any scd we simply want to update the data and use the scd-columns to be able to know first seen/last seen stuff. Problem/question:Since this last table is a history table, its vital that rows are inserted in the correct order (date order i wrote about in step 1) to not update row

In my TX Connection, i have created a Data Cource. Under that i have an Endpoint. Initially i have called it CASES. I have used it for a few days and now i have changed it to SEN_CASES.However in BU, it still appears as CASES.I have a cuple of senarios like that where i need to change the name. In CData it was easy, yoiu change the name of the RSD-file and the endpoint name chages, but how do i do it here. I dont want to delete the 20 or so endpoints and create then again.

When adding a conditional lookup in table A from table B an index is created in table B.This is expected behaviour when the Index generation setting is set to “Automatic”.However, if the lookup operator is set to “None”, no index is created in table B, eventhough index generation is set to automatic.Additionally, if a lookup is at first created with operator “Max” (or any other) an index is created, but if the operator is later changed to “None” the index is automatically removed. This seems like a bug. Is anyone else able to replicate this?I have tested this on version 7026.1

Hi all,I'm currently rebuilding an existing TimeXtender solution in another system and need to rebuild a large number of ETL pipelines.I'm wondering if there's an easy way to export the complete SQL logic for a single table, including things like:Joins Custom fields / calculated fields Transformation logic Lookup logic Any generated SQL behind the tableMy goal isn't to migrate the project itself, but rather to use the generated SQL as a reference.Is there a built-in way to export or generate the full SQL for an individual table, or is there another recommended approach for this type of migration?Have tried looking at the documentation export-option but I don’t think thats what Im looking for.Thanks!

I have read through the guide(s) and posts, but still not able to solve the issue.The pagination info is on the top of the API response I am on page 2, reteriving only 1 record. I can reterieve max 100.This the API endpoint i am using: /api/result?pageNumber=2&pageSize=1{ "pagination": { "total": 29486, "pages": 14743, "page": 2, "pagesize": 1 }, "data": { "cases": [ { "index": 1, "id": 1, "subject": "Hidden", "description": "Hidden", "plaintext": "Hidden", "solution": "Hidden", "status": "Hidden", "priority": null, "impact": "Hidden"} ], "total": 1 }}I have overridden pagination - because not all endpoints are paginated.I dont want to reterieve all pages (which are 30 if i reterieve 1000 records per pageSize) before i know i can reterieve first 5This setting should be 500 recor

Hello,Couldn’t quickly find a similar thread so I would like to ask it here.What is the best way to transfer selected objects between environments, TEST→ PROD or is it still all or nothing? We’ve integrated a new ERP system and I only want to migrate tables from this new source to PROD, not all the other changes I’ve been working on.Would be great to just select which objects I want to push to the next envrionment.

Hi,In one of my CData connections i have a RSD file for an endpoint with the follwing code for startPeriod and endPeriod <api:set attr="out.TodayDate" value="[dummy | CURRENT_DATE()]"/><api:set attr="out.StartPeriodYear" value="[out.TodayDate | year()]"/><api:set attr="out.StartPeriod" value="[out.StartPeriodYear | insert(4,01)]"/><api:set attr="out.EndPeriod" value="[out.StartPeriodYear | insert(4,12)]"/> This i refer to in POST statement in { "fromValue": "{startPeriod}", "restrictionType": ">=", "columnName": "period", "relDateCrit": "" }, { "fromValue": "{endPeriod}", "restrictionType": "<=", "columnName": "period", "relDateCrit": "" }Is this the correct way - instead of hard coding?  Name Value todayDate CURRENT_DATE() startPeriodYear year(todayDate) startPeriod insert(startPeriodYear, 4, '01') endPeriod insert(startPeriodYear, 4, '12')  And then, in the

Hi, TimeXtender Data Integration 7303.1I got this error when opening instance An error occurred while fetching data from the database.Failed to enable constraints. One or more rows contain values violating non-null, unique, or foreign-key constraints.Location: Table: TableInsertSelectionRuleFieldsForeignKeyConstraint TableInsertSelectionRules_TableInsertSelectionRuleFields requires the child key values (881d81f2-2ee7-4716-8eb8-d9da2332b33d) to exist in the parent table..  How to solve this? best regards,Bjørn A.

Incremental Load Strategy for Data Warehouse Layer (Prepare Views → DW Hi everyone,We’re working on a project for a TPA that provides property and casualty services to smaller P&C companies. The architecture connects to multiple disparate sources that ultimately feed into a standardized data warehouse.Here’s our current setup:Architecture:We’re creating a raw schema in Prepare for each data source, then using views to abstract the transformation logic. The DW maps from those views. So the flow is: Source → Ingest → Prepare (raw) → Prepare (views) → DW.What’s working:Incremental loads are running well from Source to Ingest and from Ingest to Prepare raw — no issues there.The challenge:The DW layer currently runs as a full load every time. We’re moving roughly 200M rows per company. Load times are about 1:45 hours, which is manageable, but we’d like to bring that down with incremental loads. It would also reduce the vCore demand — we’re currently on 8 vCores Premium Series with memor

Hi All, Hopefully you can help me with this one. We have a source table from our POS systems containing sales transactions. There are a few value columns we transfer that are stored as a money data type and we see some weird things happening with the values of the columns. Differences of 0.01 up to 0.0001 are appearing from nowhere in the transfer from ODX to DWH and i don't know how this i happening.The columns that have money data type are called ‘Bedrag', ’Korting’ and ‘NettoBedrag’ Take transaction 52. In the source the values are like this: After transfer with ODX, i looked in the parquet file using ParquetViewer and that looks like this: Still the same, nothing wrong here.I imported the table without any modifications in TimeXtender and it looks like this: After a transfer the data looks like this: If you look closely we lost 0.0001 on the first record ‘NettoBedrag’. Also wel lost 0.0001 on the Bedrag of the second record.I've tried a few things to mitigate this. Different numeri

Hi team, I need to audit how many rows were moved by batch on the prepare table. Is there in TX how to audit it?ThanksCarlos

I have 3 big fact tables in the source which i load incrementally. Primary keys are CompanyID and EntryNo (applicable for each table separately, incrementing), the records in these fact tables are never deleted.I need to merge these tables to a single table in DSA layer also incrementally. I think of following setup:Make the DSA table also incremental, check “Don’t handle deletes” (as the records are never deleted in source) Include both CompanyID and EntryNo as primary keys in the table; Incremental Selection Rule → EntryNo > (Last max value); Map all tables from source in this single DSA table The result which i expect is every time DSA table is executed - it incrementally loads data from 3 related fact tables - based on EntryNo for each separate CompanyID (one CompanyID per one source table). This way i have one huge table containing all the records for all 3 “Companies”. Am i correct to assume this is the setup i need? Are there any risks with possibly missing or overwriting the

Hi teamI have created this Schedule Groups,  The ingestion process packages are working fine, but the prepared packages are not working. the message log is:Logfile output: 5:01:53 AM UTC now: 2/20/2026 5:01:53 AM5:01:53 AM TimeXtender Version 25.2.0.57 built 11/10/2025 2:15:00 PM. Running on vm-orc-prod-0075:01:56 AM PID: 42376  - Started with arguments: --startschedulegroup 9 --execute_uat PROD --schedule_group 9 --customerkey uim --use-saas-queue true --token ece94e91-e0af-4588-9844-80e5e7f952cd --is-saas-local true 5:01:56 AM Connected at 2/20/2026 5:01:56 AM5:01:56 AM 5:01:56 AM *** Executing schedule group 165:01:56 AM Running schedule group CortexPolicy on PROD with 4 tasks.5:01:57 AM 2/20/2026 5:01:57 AM Starting: GWPCProd Load Data (Incremental Load) (CortexIngestServiceDLSProd) - (28) Extra Param: 5:01:57 AM (28) Command : epcmd --uat PROD --startpkg 28 --parentexecid 31 --use-saas-queue true --execute_uat PROD --token ece94e91-e0af-4588-9844-80e5e7f952cd --is-saas-local true

Hi, I am adding a mapping set (4 tables) to my table and then I get the “Source Table” column. After a deploy and execute the column “Source Table” have only a single dot in the column. I am expecting a table name from the mapping set as before... Whats wrong? Any suggestion? regards,Bjørn A.

I have been trying to sort out something out,My JSON looks like this:addendumGroupName occurs multiple times. Here, its 4 times but in other cases it occurs between 1 to 50.columns can be one or multiple I am trying to list all addendumGroupName and all columns under each addendumGroupName without doing this:json/addendumValues/addendumGroups[2]/addendumGroupName[0]json/addendumValues/addendumGroups[2]/rows[0]/columns/fremdrift_group[0] json/addendumValues/addendumGroups[2]/rows[1]/columns/fremdrift_group[0]json/addendumValues/addendumGroups[2]/rows[2]/columns/fremdrift_group[0]  So i tried this (with an without [*] at the end of column name): <attr name="addendumGroupName" xs:type="string" readonly="false" other:xPath="/json/addendumValues/addendumGroups[*]/addendumGroupName[*]" /> <attr name="fremdrift_group" xs:type="string" readonly="false" other:xPath="/json/addendumValues/addendumGroups[*]/rows[*]/columns/fremdrift_group[*]and for JSONpath:<api:set attr="detai

We are loading data from a SQL Server (onprem) to a Datalake (ingest instance). Data is stored as parquet, but TX is creating a huge parquet file for each table.  We are using ADF to ingest the data into the ingest instance.  Is there a way to load the data in such a way that when it gets into the Datalake the parquet can be divided in parts?  table_xxx_0001.parquet, table_xxx_0002.parquet, etc. (I know this is not the parquet format it is just an example).  Is this possible? We are having performance issues reading from parquet to AZURE SQL DB prepare instance.  We are using ADO.NET from ingest to prepare.

Hi team I was recently working on a table where I added a hash field and configured it for incremental loading. However, the initial deployment failed because the table was missing the required column for the incremental process. When I attempted to redeploy to fix it, I hit a roadblock: a duplicate key error in dbo.DataFields with the value (ea41fe97-e408-4504-9164-239dfcdee390, 148, 99999999).  

Hi team, I am encountering a timeout issue when moving large tables. The problem seems to be originating from the cleanup stored procedure (clean sp), as smaller tables are processed without incident. Could you please look into this issue?  

I’m migrating a large SQL Dedicated Pool data warehouse to Fabric Lakehouse.I’ve run into Fabric’s workspace limit of a thousand items.What’s the best-practices workaround?

Hi all,I'm working in TimeXtender (TDI) and ran into something I can't quite figure out. When I create a new schema in my Prepare instance, I want to assign it to a table that already exists in that same instance. The schema does appear as an option when I try to link it to the table. However, it gives an error upon deployment (of that table), at least until after I deploy the instance. Is this expected behavior?Or am I perhaps creating them in the wrong order or place? 

Hi community,I created a role in the MDW and added Grant permission on one specific database schema. This schema contains some tables and some Stored Procedures. This role need to be able to select data in the tables and execute the stored procedures. I created my Object Security Setup using these settings:  When I login using SSMS (using the user in the role), I see the correct tables and I'm able to select data in the tables. But I'm not able to see the stored procedures. When I check the permissions on the ‘ExcelAddin’ database schema. Only the ‘select’ permission in granted. Is it possible to grant permission for ‘execute’ as well? Using TimeXtender?

Hi,I have a client that uses TDI 7026.1 and i need to install it on another computer, but on the web I can only find 7050.1. Any possibility to find the earlier version somewhere?/Leo

I’m getting a Lakehouse notebook execution timeout in v7142.1 after exactly 10 minutes.My connection and command timeouts in the TX portal are 1200 and 7200 seconds, respectively, for both Ingest and Prepare so that’s not the setting I need to change … and the workspace’s Spark timeout setting is 20 minutes so that’s also not the one.I’ve copied the relevant part of the error message below.Does anyone know how and where to increase the notebook timeout setting?(the Microsoft links aren’t that useful from a TDI perspective, I think) Start Time : 10/15/2025 2:23:08 PM End Time : 10/15/2025 2:37:01 PM on server: V171D008S -Execute Execution Package Default 'Failed'      An error occurred while calling o5570.throwExceptionIfHave.: com.microsoft.spark.notebook.msutils.NotebookExecutionException: Timeout when exe cell - 15 in notebook TimeXtender_PrepareKOMBI_TABLE_dsa_INVENTTRANS, code length = 39808 and it costs 600.001s. You can set timeout parameter to mitigate the issue. Please check th

Hello,Is it possible to Extract data from an existing Lakehouse into a Prepare instance without needing to move it into the TimeXtender Ingest instance? The use case is to avoid replicating the data again, if the customer has already ingested data into a data lake or Lakehouse.Thanks in advanceTim