Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications
Recently active
Hello. This document has the ports which need to be opened. Configure your Firewall | Community It doesn't reference Fabric Lakehouse.. are you able to advise what we need to open for the ingest service to communicate to Fabric Lakehouse?Thanks Tim
So i think i must be missing something or maybe even forgetten.My dataflow: I have a Data source connection (dsc) ingesting csv-files from a S3 bucket with an aggregation pattern since the files have the date in the filename to make sure we dont overwrite any files. Each row in each file has a column with the date. So all rows in the file has the same date. The ingestion has a data type override to override all columns to nvarchar(max) since we cant trust the data source. The data is then transfered to a to a table in a data area as is. Next step is with a view for validation and a simple table insert move data to a table with data types we want to work with.This last table is a History table. Not that we use any scd we simply want to update the data and use the scd-columns to be able to know first seen/last seen stuff. Problem/question:Since this last table is a history table, its vital that rows are inserted in the correct order (date order i wrote about in step 1) to not update row
I believe I have read the documentation, in case I missed something. My bad. Im trying to load csv files from the root of a S3 bucket. The 'test connection’ in the portal turns green but when trying to synchronize in timextender it tells me I have to enter a value for ‘path’.I have tried these so far: /.mybucketname/inbound/s3://mybucketname/inbound/But timextender keeps throwing errors saying the directory does not exist. I can succesfully connect to it and download the csv's via Python so Im quite sure the setup is correct. Does anyone know what to fill in for ‘path’?
A JSON response looks like this [{"ref": 123456,"dim_1": "A","dim_2": "B","peroid": 202601},{"ref": 5E+20242959,"dim_1": "A","dim_2": "B","period": 202602}]The second ref (5E+20242959) is a problem - its neither STRING nor an INT.Ref is defined as NVARCHAR in BU, but as you can see the value is not between “”.I have tried the following approaches under, still i get the same errorInput string '5E+20242959' is not a valid number. Path '[56935]['ref.53e92a42-b13c-4062-87b4-6bd5a89547b1.1992753']', line 1, position 36741783.How do i solve this?Here are the approaches i have tried:Omitting Ref in Table FlattningIn table flattning, i have left it out. I have the other three values, but still landing returns an error:Defining the value as NULL in table flattningField transformationCondition on column ref in BUI have defined the following condition on the column, still i get the same errorCASE WHEN [ref] LIKE '5E+%' THEN NULL ELSE [ref]ENDScript ActionsI have created a script th
I run into this error while loadning csv-files from our s3 bucket.The issue is that the number of fields differs from time to time. We would like to ignore that and read these fields if they exists and otherwise not.Is there a way to do this or is this just an exception in CsvHelper-lib that isnt accessible for me to configure? The error:Executing table [csv].[VOF_UTF_Planeradebesok__aggregated]:failed with error:CsvHelper.MissingFieldException: Field with name 'Planerat besök - konfidentiellt' does not exist. You can ignore missing fields by setting MissingFieldFound to null.IReader state: ColumnCount: 21 CurrentIndex: -1 HeaderRecord:["Användare - ID2","Användare - personnummer","Användare - profession","Avbruten/inställd","Brukare - ID2","Brukare - personnummer","Planerad resurs - namn","Planerat besök - dubbelbemanning","Planerat besök - ej utfört (anledning)","Planerat besök - sluttid","Planerat besök - starttid","Planerat besök - typ av brukare","Planerat besök - utfört","P
I have a large table with about 50 columns. There is column called projectNumber. This column, i am unable to override.This column is varchar. However in TX with Enhanced Drivers it shows Int32.I have overridden it to Text It even says so in Data type overrides on the DataSource I have even tried adding and removing it in Table builder
We have a client with a Rest Datasource that does not use URL parameters. Instead they use the post body to pass a series of filters and conditions.We are using this post body to implement Incremental loading from the datasource. It seems to be working correctly in so far as the rest source is definitely loading incrementally.However the Ingest instance does not seem to recognize the tables in the Gen 2 Storage as incremental.We have defined the incremental several times, deleted the entire folder in the Azure Gen2 storage. Still the same result.if we drag the table over to a data area the source in the Ingest instance is not flagged with an “i” indicating that it is incremental.Is this because we are passing the incremental variable through the post body and not as a query parameter?if this is the case is there a work around?The issue we are facing is that we cannot do any downstream incremental loads as TX complains that the source table in the ingets instance is not incremental. Not
Hi,We are consolidating our ingestion setup from one ingest instance per environment to a single shared ingest instance for both DEV and PRD environments.Current situation:ODX DEV → DSA_DEV → SSL_DEVODX PRD → DSA_PRD → SSL_PRDTarget situation: ↗ DSA_DEV → SSL_DEVODX PRD ↘ DSA_PRD → SSL_PRDThe DEV VM is able to communicate with the PRD VM, where the shared ODX instance is hosted.Could you please advise on the next steps required to implement this change?
Hi,i have a gen2 storage account with a blob container with multiple parquet files. when i do a sync with odx it’s succesfull, the transfer gives me for 4 files the message “ is used by another table”. all other files in the same map go ok. have tried to recreate the blob container, and recreate the parquet files again, same results.Exact message:The table folder 'parquet_taak_status' is used by another table with the id 9a510177-a130-4bcc-aaaa-5abefd42c1b9 how to solve / find the other table that is referenced to? thanks!
In my TX Connection, i have created a Data Cource. Under that i have an Endpoint. Initially i have called it CASES. I have used it for a few days and now i have changed it to SEN_CASES.However in BU, it still appears as CASES.I have a cuple of senarios like that where i need to change the name. In CData it was easy, yoiu change the name of the RSD-file and the endpoint name chages, but how do i do it here. I dont want to delete the 20 or so endpoints and create then again.
When adding a conditional lookup in table A from table B an index is created in table B.This is expected behaviour when the Index generation setting is set to “Automatic”.However, if the lookup operator is set to “None”, no index is created in table B, eventhough index generation is set to automatic.Additionally, if a lookup is at first created with operator “Max” (or any other) an index is created, but if the operator is later changed to “None” the index is automatically removed. This seems like a bug. Is anyone else able to replicate this?I have tested this on version 7026.1
Hello,I have created a .csv endpoint based on a view in my MDW. I’m able to successfully execute the endpoint manually or through the execution package, where the .csv gets created as expected.However, I can’t seem to add the package to a job, and can’t get it to work through Exmon/Orchestration.In Exmon, my StocklistCSV package can be found. However, when I run it in Exmon, it doesn’t do anything and doesn’t show in the execution log. If I add the package in a process, it won’t run and time-out after 10 minutes.Do you have any idea how I can schedule to execution of the CSV endpoint so it creates the file based on a schedule?
Hi all,I'm currently rebuilding an existing TimeXtender solution in another system and need to rebuild a large number of ETL pipelines.I'm wondering if there's an easy way to export the complete SQL logic for a single table, including things like:Joins Custom fields / calculated fields Transformation logic Lookup logic Any generated SQL behind the tableMy goal isn't to migrate the project itself, but rather to use the generated SQL as a reference.Is there a built-in way to export or generate the full SQL for an individual table, or is there another recommended approach for this type of migration?Have tried looking at the documentation export-option but I don’t think thats what Im looking for.Thanks!
Hi all,Our TimeXtender is currently growing and growing, which is a good thing. However, I’m experiencing performance issues during TimeXtender execution and would appreciate guidance on both technical optimization and cost-efficient scaling.As my execution packages become unpredictable regarding execution times, i’m running into issues with PowerBI starting it’s refresh without TX being finished.TimeXtender Version: 7158.1 TX O&DQ Version: 26.1.0.23 ODX: Azure Data Lake Gen2 Execution VM: OS: Windows Server 2022 Datacenter Azure Edition Size: Standard D8s v5 (8 vCPUs, 32 GB RAM) Production Instance: SQL Server Storage Azure SQL Database: Tier: General Purpose (Provisioned) Compute: 2 vCores Storage: 65 GB I’m currently integrating data from about 15 sources, distributed across 5 ERP systems.I played around with execution package threads some time ago and i’m using 12 parallel threads for a while now. This package as a total task count of 540. During execution (mainly data load
I have read through the guide(s) and posts, but still not able to solve the issue.The pagination info is on the top of the API response I am on page 2, reteriving only 1 record. I can reterieve max 100.This the API endpoint i am using: /api/result?pageNumber=2&pageSize=1{ "pagination": { "total": 29486, "pages": 14743, "page": 2, "pagesize": 1 }, "data": { "cases": [ { "index": 1, "id": 1, "subject": "Hidden", "description": "Hidden", "plaintext": "Hidden", "solution": "Hidden", "status": "Hidden", "priority": null, "impact": "Hidden"} ], "total": 1 }}I have overridden pagination - because not all endpoints are paginated.I dont want to reterieve all pages (which are 30 if i reterieve 1000 records per pageSize) before i know i can reterieve first 5This setting should be 500 recor
As you can see in this screenshot I’ve a custom field, defined several months ago, that uses fields from two tables: The model works perfectly, but in the current version I cannot edit and more CRITICAL for me, I cannot create a similar new one.I don’t know when this problem appears, but I’ve detect it today.What’s happen?
I have followed this guide to set-up an Incremental load on a table in BU:Incremental Loading in a Business Unit (BU) in TimeXtender Classic | CommunityHowever, during the deploy i get an error:Data source Incr LoadsValidation status: ValidMessage: OKStaging Database ODXValidation status: ValidMessage: OKTable: Incr_LoadValidation status: ValidMessage: OKIncremental LoadValidation status: ErrorMessage: Incremental load is not supported on this table.Details:Data source Incr Loads ...TimeXtender.DataManager.UserErrorExceptionIt says in the guide that: When the option is enabled and the table is deployed, TimeXtender performs the following:Initial Full Load: The system fully loads the table. Setting content of the _I Table: This table records the largest incremental field value from the given load I am attachig a video of where i get an error.What am i doing wrong?
Can I preserve my source field names when synchronizeing my fields?I dont want spaces and periods replaces by an underscore, my current workaround is to edit the fields manually when I use the tables in my prepare instance.
Version: TX 7158.1Hello,I’m currently running into an incremental loading issue where the source system automatically generates invoices in batches. This inserts new rows/Primary keys in the invoice table. It could be that certain invoices are scheduled for a batch. Let’s say from 24-07-2026 scheduled for 29-07-2026.If that’s the case, the new row will get inserted on 29-07-2026 with a datelastmodified of 24-07-2026. Any changes to that document will trigger the datelastmodified correctly, only this process gives this issue. In that case, my incremental loading will completely miss these new document / primary keys (currently -1 day offset).Is there a way to always add new primary keys but only do the updates based on the datelastmodified timestamp?
Hello,Couldn’t quickly find a similar thread so I would like to ask it here.What is the best way to transfer selected objects between environments, TEST→ PROD or is it still all or nothing? We’ve integrated a new ERP system and I only want to migrate tables from this new source to PROD, not all the other changes I’ve been working on.Would be great to just select which objects I want to push to the next envrionment.
In TX Enhanced Connector, how do one handle fields in JSON response that has the same name?In the screen-grab below, the fields in marked in red comes multiple times but the values are different.In TX Enhanced Connector, the field always grabs the value of the first occurance of the field i have marked in red.Is there a way to grab the desired value by doing somethng like this:/json/addendumValues/addendumGroups/rows[0]/json/addendumValues/addendumGroups/rows[1]/json/addendumValues/addendumGroups/rows[2]/json/addendumValues/addendumGroups/rows[3] If not, is there a way to grab everything in blue and show in one column?I can then creat a view in BU and grab each saperately The screen grabs are broek here: Understanding and using script parameters in TimeXtender Classic | Community, so i can not fuly understand the documentation
Hi,In one of my CData connections i have a RSD file for an endpoint with the follwing code for startPeriod and endPeriod <api:set attr="out.TodayDate" value="[dummy | CURRENT_DATE()]"/><api:set attr="out.StartPeriodYear" value="[out.TodayDate | year()]"/><api:set attr="out.StartPeriod" value="[out.StartPeriodYear | insert(4,01)]"/><api:set attr="out.EndPeriod" value="[out.StartPeriodYear | insert(4,12)]"/> This i refer to in POST statement in { "fromValue": "{startPeriod}", "restrictionType": ">=", "columnName": "period", "relDateCrit": "" }, { "fromValue": "{endPeriod}", "restrictionType": "<=", "columnName": "period", "relDateCrit": "" }Is this the correct way - instead of hard coding? Name Value todayDate CURRENT_DATE() startPeriodYear year(todayDate) startPeriod insert(startPeriodYear, 4, '01') endPeriod insert(startPeriodYear, 4, '12') And then, in the
Hello,After Snowflake enabled behavior change bundle 2026_04 on our production account, our execution packages began failing. TimeXtender generates the "SCD Surrogate Hash Key" column as a virtual (computed) column with a NOT NULL constraint.As of bundle 2026_04, Snowflake rejects NOT NULL/CHECK constraints on virtual columns at DDL time, so the CREATE TABLE statement for the TX-generated temporary staging table now fails. The same project ran fine until the bundle was enabled, and runs fine again after we temporarily disabled the bundle.The failures occur only on tables that have History (SCD) settings enabled. Tables without history are unaffected, which is consistent with the surrogate hash key being generated specifically for the history/SCD code path.Environment- TimeXtender Data Integration, product/portal version: 7158.1- Data storage: SnowflakeError messageJavaScript execution error: Uncaught Execution of multiple statements failed on statement "CREATE TABLE ...#<temp>...
I have en endpint with multiple parameters:CaseHandling/External/Cases/GetCases?exportFields=CaseID&exportFields=Closed&exportFields=Position&exportFields=ProjectLevel&exportFields=Anonymous&Key is always exportFields Values are differentIn CData i have no issues getting values in the columns.In TX Enhanced Connection, when i define multiple parametes with key-anme exportFields and different value, only the last is shown: This is how i have defined in TX Endpoint I have tried the whole endoint in Path, which gived empty table
Installed data integration and ingest services 7361.1 I cannot start the Timextender execution services also not after I download the config file and replaced it
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.