Ingest

Hi Everyone, In the Ingest instance activity log I see a lot of messages. It happens when populating a table in the DSA (execute). We are using Datalake as storage and TDI version 7158.1Execution takes a loooooong time also. What goes wrong here???  

Hello,I use TimeXtender CSV Data Source (version 23.18.5.0). I'm trying to read about 15 csv's from an sftp server, but since january 15th 2026 we get an error. This server is hosted by an external supplier which has it's settings limited to max 1 session (no concurrent sessions).In TDI I've configured the max concurrent threads on 1, so max 1 thread at a time. My transfer still crashes because I use too many threads.I tried to put max concurrent threads on 0. This resulted in a never ending transfer task. Didn't work.After this the supplier increased it's max threads temporarily for testing purposes. I configured the connector on 1 thread again. If I look in the log, I can see that the first 2 tables start on the same timestamp. This occurs a couple of times more. Is the connector using 2 threads now?Is this advanced max thread setting working correctly for the TX csv connector? Supplier claims we're not using 1 thread. I'm not sure how I can check and prove this. Do you have any advi

Hello,Since the TimeXtender Classic (V25) was announced to be released by the end of Q2 2025, i would like to ask if there is a clarified date when the release is planned. To my knowledge it has not been released as of yet? Also the more important question to me is the upgrade process. Currently we are using TimeXtender classic together with ODX server and we have couple of questions:Will there be a detailed guide released on upgrading older TimeXtender platforms (20.10.52 in our case) to Classic V25? What will happen with all the data sources in our ODX instance? Since we are using quite some CDATA providers - does it mean we will have to manually recreate the data sources? Or ODX will be deprecated and we need to move to using BusinessUnits? Thanks for the information

I have a source table in ODX. The source only keeps record for the last 3 months. UUID ColumnA ColumnB ColumnC Date 1234 Xiaomi Mobile phone 125 GB 01.01.2025 5678 Apple iPad 1 TB 01.02.2025 9101 Samsung Mobile phone 256 GB 01.03.2025  When i am in month 4, the forst row is unavailable in the sourceUUID ColumnA ColumnB ColumnC Date 5678 Apple iPad 1 TB 01.02.2025 9101 Samsung Mobile phone 256 GB 01.03.2025 11121 Google Pixel Mobile phone 256 GB 01.04.2025  I want to keep the history in DSA forever.I know that if i create a history table and use UUID as unique key, i will be able to keep the history.The question is: what if i accedently execute the table on 01.04.2025! Will i lose everything before 01.02.2025? Or will executing the table keep the history intact !What if there are changes in the source and there is either a new column or the column name changes? I need to then deply the table. Will that keep th

Hello, we have upgraded to 20.10.74 TimeXtender with 20.10.73 ODX server from older version. Since ODX server is getting removed in the future and CData connectors have their distribution stopped, i am looking to migrate the existing connectors to future supported ones and  switching from using ODX server to using Business Unit. Could you advice me which connectors i should start using instead of the following ones?:CData ADO.NET Provider for Microsoft Excel Online 2024; CData ADO.NET Provider for Databricks 2024; CData ADO.NET Provider for SAP HANA 2023; CData ADO.NET Provider for REST 2023I does not look that there are direct alternatives to these, at least in current TX version. Are there also any guides of migrating these specific ones to new alternatives? Thank you

Hi, I am trying to conect to an endpoint using a dynamic query parameter from a simple SQL query: SELECT       [CODE_ID] as codeId  FROM [dsa].[Products]I use {codeId} as value in the query parameter. When deploying, I get the following error: Format of the initialization string does not conform to specification starting at index 0.  When I hard-code the codeId, it works. Using this query does not work. There are around 600 codeId's in the query. Even when i limit it to 2 id's, it gives me the same error. My API documentation does not mention anything about extra parameters. Also, the logs do not give me much more information, other than the error I mentioned. Anyone has experience with this error and has a possible solution? Kind regards,René 

Hi All,My current employer uses a DWH with a lot of views (with unions and so on), which leads to slow execution packages. I would like to enhance the performance (rebuilding the views is one thing). But i woud also like to enhance the performance with indexing. So i have setup up one of our Dimension tables as seen below:Is our SupernaturalKey (SNK) Are our PK'sWhat would you guys recommend? Which type of indexing for SNK (nonclustered, unique index, Columnstore Index, Clusttered ColumnStore Index)?Which type of index do you recommend for PK's (nonclustered, unique index, Columnstore Index, Clusttered ColumnStore Index) ? Which type of indexing SNK and PK in fact tables?  

Hello, Three of my collegueas where developing in our dev enviroment. And when trying to save the project, we got the error:An error occurred while saving the project to the database.An item with the same key has already been added.Detailed error:An error occurred while saving the project to the database.Er is al een item met dezelfde sleutel toegevoegd.Details:Er is al een item met dezelfde sleutel toegevoegd.Module: mscorlibSystem.ArgumentExceptionbij System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)bij System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)bij TimeXtender.DataManager.ProjectPerspective.AddProjectPerspectiveItem(ProjectPerspectiveItemsRow itemRow)bij TimeXtender.DataManager.Project.InitProject(Int32 version, DsProject loadDsProject, DataSet adaptersDataSet, ProjectsRow projectRow)bij TimeXtender.DataManager.Project.LoadProject(DsProject _dsProject)bij TimeXtender.DataManager.Project.<>c__DisplayClass136_0.<Load

Hi All,In TX 20.10.45.64 we would like to work with Work Items to prefent Project Locks. There is no option to Release the work item and make it green. I already tried:Deploy Execut Save and Reload the projectWe only have the option to update, edit or delete the workitem.  How do we release these items and make them green? 

Hi,I have a customer working with TimeXtender 7150.1 connected to Snowflake.I have a .csv data-source connected through the Ingest. The ingest settings have a number of header rows removed. But in the data received, I have Totaal-rows that I want to skip or filter out.The option to “filter rows” by right-clicking the data-source in the Ingest area is not available for this source: My next option would be to add a data selection rule to the table connected to the ingestion. But that has no effect: my result table has two rows (one from each .csv source) with Totaal.The above data selection rule seems not to be used. The only thing I can do to get it working, as far as I am aware, is to manually add a line of code, using the “Custom Code” option:But I was told / had learned that using the data selection rule, would automatically change the transformation script.I am not a fan of this solution, as it is not immediately clear to a new user (or to me in a year time) that I have changed the

Hello,I have a question about the RAW tables in TimeXtender. I noticed that the data types of the fields in the RAW table change when I modify them in the tool. I was under the impression that RAW tables should keep the original data types from the source, since this would be “RAW”.I ran into trouble when loading transferring from the ODX. I changed the datatype of a field and even added a transformation that resulted in a CAST in the transformation view. However, I got an error message saying: The given value of type String from the data source cannot be converted to type float of the specified target column.This should not be, because the source contains only data that is/should be convertible to a float. The Raw table has no data, which I find strange. Changing the fields data type to float has also changed the datatype of the Raw table. I would expect the Raw table to always have the same datatype as the source and that the changing of datatypes is handled in the transformation vie

I have an issue, and i have not been able to identify if this is a TX issue or a DWH issue.This is how TX is set up:I have a MS PowerApp that writes to the APP database.I can see that the records are in the DWH, like in the table below.  I have confirmed that the entetried are in APP-stack.At 07:30 in the morning, execution package runs, then this happens:Meaning, the DW_ID that were previously Bob’s and Marlen’s are now overwritten by Kim and Tom.There are no traced of DW_ID 101 and 103 being registrered by Bob and Marlen either in ODX or in DSA.I dont know if it happens before the execution job runs, during or after. I have been scratching my head for the past couple of weeks.

In my TimeXtender Data Integration (Ingest) instance, data sources seem to be listed alphabetically. I’d like to set a custom order instead. I tried drag-and-drop, but it didn’t work, and I don’t see any option in the portal to reorder them.Is there a way to change the display order (e.g. sort settings, or another workaround)?If this isn’t supported, a confirmation would also be helpful. Thanks! 😊 

Need help with TimeXtender data transformation issue. We're pulling sales data from SQL Server but getting errors during the transform step. The source has decimal values but TimeXtender seems to be reading them as text.Also need to set up a simple incremental load based on ModifiedDate field. Should be 2-3 hours remote work to fix the data types and configure the incremental logic.Need working by Tuesday for our weekly data refresh.Please Contact Me Asap.

Hi, When trying to replicate the use of “Importing OpenAPI” from this TimeXtender Tuesdays video i get bellow Time Out error:  I am wondering if i am doing something wrong, or one could replicate this issue aswell.Regards,Devin

Hi,TDI ver 7026.1TimeXtender Ingest Service Configuration 7017.1 We are using Azure Datalake Gen2 Storage Container as our Ingest instance. I have set a load job (incr_load) from a sql server database to the ingest instance.This works fine during the day. When get into the next day the same job does a full load on my tables in the database. Why is this happening?  I really need to solve this asap :-) regards,Bjørn A. 

We are using the provider Azure Data Factory - SQL Server for a lof connections where the instances for these connections contains almost the same data but each time another customer. What we have noticed when the incremental load is setup to look at a datetime field called DW_MODIFIED_date. it will never load that 1 record which is in the table. When I exclude that table from the incremental load then I have 1 record loaded.When I include the table again in the incremental load it is removing the first folder from the previous load and don’t write a new file because it was not updated.When I remove the folder from the container and I incremental load that client table again I get no record at al while it should be the first load. Even if the incremental load is on and there is no file  then I expect to have in the initial load the data.

We are unable to open our instance as we are prompted with the following error message: TX Version 7047.1 

Hi there! We have had a small problem recently whereas Table A is on the staging/DSA layer and contains the following columns: Column 1 (PK)Column 2 (PK)Column 3Column 4 … etcNow this table has three sources - three Business Central instances. In two of the sources the original order of columns is Column 1, Column 2 but in the third source the order is Column 2, Column 1.We get the following error when incremental load is enabled:  "TIMEXTENDER COPY DATA LOOP", "Failure happened on 'Sink' side, Column 2 contains an invalid value. We have been able to manage this error previously by ordering the columns in the same way as in the source.However, now the sources have different orders of the columns and therefore not possible to use that way to get around this. Any ideas or suggestions? 

Hello, TimeXtender 20.10.67 with ODX. We have a source (azure datalake) that will geta json file dumped with the following format table.name/”date-when-file-dumped”. The files will be15million + rows and dumped atleast once a week.What I want to achieve is for the connector to only extract the latest file and have it dynamically change. I can’t figure out a way to effectively do this in the connector, as the uri connection string wants to point to a specific filename or take everything in a concat.I can’t figure out a way to change the URI dynamically and the only option I can think of in theory is concatenating all the json in the connector, including resourcecolumns and doing a custom query table on the connector with a DSR rule based on the MAX filedate.However, in a year or two when there will be 50+ files (750 million rows in theory with concat), I am not sure how the performance or scalability of that solution will be. Anyone have done something similar or have a better idea how

Hi all,Since about a week ago, we’re seeing random but frequent (almost daily) failures in ODX extract tasks from two sources: TimeXtender SQL Data Source (version 22.0.2.1) (SQL database) – runs from 05:00 to ~05:45 (45 min) UTC. Error: Cannot access a closed Stream (HttpRequestException). TimeXtender SQL Data Source (version 22.0.2.1) (Synapse Severless SQL pool)  – runs from 05:00 to ~05:00:30 (30 sec) UTC. Error: System.TimeoutException: The operation has timed out. Manual retries later in the morning succeed without issue.The Synapse serverless SQL pool is pre-triggered ~15 minutes in advance to avoid cold start, and both the ODX environment and the data sources have generous timeout settings.We use Azure Data Lake Gen2 storage as our ODX storage.Any idea what might be causing these recent failures?Thanks,sva

Hi,I need to add authorization basic auth (username, password) to every endpoint in my rest api(Tripletex).I have added dynamic values from the endpoint “TokenSessionCreate Create” creating a session token.This token is my password and using a fixed username to every endpoint.In my endpoint “LedgerPosting” am using the section “Override Headers” to add the token to the “Authorization” and the value equal “Basic user:pwd”. Well, I cant get this to work.I proberly nedd to convert usr:pwd to base64 encoding….Does anyone have any suggestion?best regards,Bjørn A.    

Hi,i have a gen2 storage account with a blob container with multiple parquet files. when i do a sync with odx it’s succesfull, the transfer gives me for 4 files the message “ is used by another table”. all other files in the same map go ok. have tried to recreate the blob container, and recreate the parquet files again, same results.Exact message:The table folder 'parquet_taak_status' is used by another table with the id 9a510177-a130-4bcc-aaaa-5abefd42c1b9 how to solve / find the other table that is referenced to? thanks!  

I recently updated the connection provider version on Hubspot, also for ODX/TX, and I have a problem getting the custom objects in. I checked, they still exist, postman can access them without issues, but I get errors when trying to get them to TimeXtender.  Error messages as below:   

Hello,We are looking to implement incremental data fetching from REST API endpoints, specifically by dynamically filtering with an updatedAt parameter. The goal is to use the maximum updatedAt value previously fetched from each API call, which is stored in our ODX tables.While I'm aware of the capability to use dynamic parameters based on endpoints and queries within TimeXtender, I'm struggling to find a method to reference the maximum updatedAt value already loaded in the ODX tables for this purpose.Has anyone implemented a similar dynamic data fetching mechanism in TimeXtender? If so, could you share how you managed to reference data from the ODX tables to set the parameters for the next API call?Thanks!