Skip to main content
To homepage To homepage

TimeXtender Desktop Q&A

Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications

741 Topics
B
Contributor
bjornContributor
asked in Ingest
Add Authorization to my endpoints

Hi,I need to add authorization basic auth (username, password) to every endpoint in my rest api(Tripletex).I have added dynamic values from the endpoint “TokenSessionCreate Create” creating a session token.This token is my password and using a fixed username to every endpoint.In my endpoint “LedgerPosting” am using the section “Override Headers” to add the token to the “Authorization” and the value equal “Basic user:pwd”. Well, I cant get this to work.I proberly nedd to convert usr:pwd to base64 encoding….Does anyone have any suggestion?best regards,Bjørn A.    

282
Christian Hauggaard
Community Manager
P
Explorer
Pieter-JanExplorer
asked in Ingest
the table folder is used by another table

Hi,i have a gen2 storage account with a blob container with multiple parquet files. when i do a sync with odx it’s succesfull, the transfer gives me for 4 files the message “ is used by another table”. all other files in the same map go ok. have tried to recreate the blob container, and recreate the parquet files again, same results.Exact message:The table folder 'parquet_taak_status' is used by another table with the id 9a510177-a130-4bcc-aaaa-5abefd42c1b9 how to solve / find the other table that is referenced to? thanks!  

1657
R
Problem Solver
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Prepare
SCD Surrogate Hash Key is non-deterministic.

Hi,I obtain a deployment error when I try to make my table historic. Computed column 'SCD Surrogate Hash Key' in table ' <mytable>' cannot be persisted because the column is non-deterministic. I think this has to do with the excessive amount of columns in the table: 695 columns, all varchar(2000). What confuses me is that when I set the hashing algorithms to debug, I still get the same error  I don't have any transformations on this table, its a straight copy from to ODX.  Is there a limit on the amount of fields a History table can have? 

1686
M
Contributor
A
Problem Solver
aftabpProblem Solver
asked in Jobs & Executions
Unable to identify the circular reference

I am struggling with Circular References.Finished executing project 'Discovery_Hub' Execution Package 'Report Booking' Execution failed Start Time : 8/21/2025 11:52:42 AM End Time : 8/21/2025 11:52:42 AM on server: TX-SERVER-DEV -Execute Execution Package Report Booking 'Failed' 'Execute DSA DSA_F.Management Data Cleansing Rules' has a circular relation with the following steps: 'Execute DSA DSA_TX.sub_agrDIM_RentContract Data Cleansing Rules' 'Fill Aggregate Table DSA_TX.sub_agrDIM_RentContract' 'Execute DSA DSA_F.RentContract Data Cleansing Rules'The execution job Report Booking uses DSA_F.Management, but not DSA_TX.sub_agrDim_RentContracts.I have also tried excluding DSA_TX.sub_agrDim_RentContracts from the execution job, but it still fails. What i find strange is that when i run the following tables individually, i do not get any errors:DSA_F.Management  DSA_TX.sub_agrDIM_RentContract Also, DSA_TX.sub_agrDIM_RentContract  is not the part of Report Booking prespective Only when i ru

372
A
Problem Solver
B
Participant
Boglarka BaranyParticipant
asked in Ingest
Hubspot Custom Objects 400 error after updating provider version to 10.2.0.0

I recently updated the connection provider version on Hubspot, also for ODX/TX, and I have a problem getting the custom objects in. I checked, they still exist, postman can access them without issues, but I get errors when trying to get them to TimeXtender.  Error messages as below:   

366
Christian Hauggaard
Community Manager
S
Explorer
svaExplorer
asked in Ingest
ODX Extract Failures – Azure Data Lake Gen2 storage

Hi all,Since about a week ago, we’re seeing random but frequent (almost daily) failures in ODX extract tasks from two sources: TimeXtender SQL Data Source (version 22.0.2.1) (SQL database) – runs from 05:00 to ~05:45 (45 min) UTC. Error: Cannot access a closed Stream (HttpRequestException). TimeXtender SQL Data Source (version 22.0.2.1) (Synapse Severless SQL pool)  – runs from 05:00 to ~05:00:30 (30 sec) UTC. Error: System.TimeoutException: The operation has timed out. Manual retries later in the morning succeed without issue.The Synapse serverless SQL pool is pre-triggered ~15 minutes in advance to avoid cold start, and both the ODX environment and the data sources have generous timeout settings.We use Azure Data Lake Gen2 storage as our ODX storage.Any idea what might be causing these recent failures?Thanks,sva

344
Christian Hauggaard
Community Manager
S
Contributor
sigsolContributor
asked in Ingest
Incremental load in TimeXtender REST API 6.1

Hello,We are looking to implement incremental data fetching from REST API endpoints, specifically by dynamically filtering with an updatedAt parameter. The goal is to use the maximum updatedAt value previously fetched from each API call, which is stored in our ODX tables.While I'm aware of the capability to use dynamic parameters based on endpoints and queries within TimeXtender, I'm struggling to find a method to reference the maximum updatedAt value already loaded in the ODX tables for this purpose.Has anyone implemented a similar dynamic data fetching mechanism in TimeXtender? If so, could you share how you managed to reference data from the ODX tables to set the parameters for the next API call?Thanks!

1865
Thomas Lind
Community Manager
P
Contributor
Paul BridgeContributor
asked in Ingest
Question About ODX Data Connections - Concurrent Execution Threads

HiIn an effort to resolve intermittent ODX errors whilst retrieving data back from Oracle JDE tables I am trying to understand whether reducing the ‘concurrent execution threads’ setting in the Oracle data source connections could be a potential solution.I have multiple Oracle connections set up in TX, with each connection pulling a subset of tables (e.g. all the JDE master file tables in one connection, all the transaction-related GL tables in another etc). All these connection transfer tasks are then wrapped up in a TX job scheduled to run each evening.The ‘concurrent execution threads’ default value across all the Oracle data connections I had set up for this was ‘8’.My thinking was that if TimeXtender is running multiple data pulls simultaneously then this could be causing resource contention issues on the source Oracle server, and thereby intermittently triggering data pull failures with generic error messages that don’t precisely indicate root cause.I have since changed the ‘conc

497
Christian Hauggaard
Community Manager
Paul McLeod Bespoke Analytics
TimeXtender Xpert
Paul McLeod Bespoke AnalyticsTimeXtender Xpert
asked in Ingest
Rest Datasource Upgrade issue!

I just upgraded TimeXtender to the latest versions for a client. (7017 and 7047).In doing so most of the datasource stopped working unless I upgraded the datasources to the latest versions. I decided that I should just do them all to be consistent. This has broken my CData Rest sources because the new drivers are not installed! This is a massive issue, and i was not warned in any significant way about this particular issue in the upgrade.I need to get the new CData drivers, I am not in a position where I can transition multiple CData Rest sources as part of an upgrade! This is a production issue and I need to resolve it ASAP!

161
Christian Hauggaard
Community Manager
G
Contributor
gediminas.juskenasContributor
asked in Ingest
TimeXtender classic (v25) release date and platform upgrade

Hello,Since the TimeXtender Classic (V25) was announced to be released by the end of Q2 2025, i would like to ask if there is a clarified date when the release is planned. To my knowledge it has not been released as of yet? Also the more important question to me is the upgrade process. Currently we are using TimeXtender classic together with ODX server and we have couple of questions:Will there be a detailed guide released on upgrading older TimeXtender platforms (20.10.52 in our case) to Classic V25? What will happen with all the data sources in our ODX instance? Since we are using quite some CDATA providers - does it mean we will have to manually recreate the data sources? Or ODX will be deprecated and we need to move to using BusinessUnits? Thanks for the information

291
Christian Hauggaard
Community Manager
M
TimeXtender Xpert
MuddiTimeXtender Xpert
asked in Prepare
Classic and statistics

Hello Timextender and communityI’m looking to understand how Timextender Classic deals with collumn statistics that aren’t tied to indexes. Our project is built on Azure SQL DB.Obviously TimeXtender automatically rebuilds indexes as part of its data cleansing procedures. However, rebuilding indexes only updates statistics on the indexed columns—not on the rest. Performance  relies heavily on accurate statistics for query optimization (especially when MAXDOP isn’t explicitly set), this leaves me wondering: Does TimeXtender have any built-in process or configuration to update statistics on non-indexed columns? If not, are there recommended best practices for managing these statistics in a TX solution—either as part of the deployment or as a post-process step? After dealing with a sudden drop in performance, we’ve observed performance improvements after manually updating statistics in the entire project. This takes 16 hours though, so I’d like to ensure we’re not missing any built-in ca

191
rory.smith
TimeXtender Xpert
P
Contributor
Paul BridgeContributor
asked in Ingest
How to Set Network Connection Timeout Value for ADO.NET Oracle Data Connection

HiOver the weekend one on our ODX jobs failed with the following error; Executing table [PRODDTA].[F0101]:failed with error:Oracle.ManagedDataAccess.Client.OracleException (0x80004005): ORA-50000: Connection request timed out   at OracleInternal.ConnectionPool.PoolManager`3.Get(ConnectionString csWithDiffOrNewPassw, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch, Boolean bAsync)   at OracleInternal.ConnectionPool.OraclePoolManager.Get(ConnectionString csWithNewPassw, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch, Boolean bAsync)   at OracleInternal.ConnectionPool.OracleConnectionDispenser`3.Get(ConnectionString cs, PM conPM, ConnectionString pmCS, OracleOpaqueString securedPassw, OracleOpaqueString securedProxyPassw, OracleConnection connRefForCriteria, Boolean bAsync)   at Oracle.ManagedDataAccess.Client.OracleConnectionInternal.OpenInternal(Boolean bAsync)   at Oracl

364
Thomas Lind
Community Manager
kerry_bespoke
Contributor
kerry_bespokeContributor
asked in Ingest
Sensitive Data Security within TX

Good Day,We have a client that is on V20 that would like to incorporate some Sensitive Data within their TX environment that some of the TX Developers should not have access to. As far as I am aware, if you have access to the TX Repository then the developers can open all projects.How would I handle the solution of the Sensitive Data in TX?Kerry

262
kerry_bespoke
Contributor
Søren Sørensen
Contributor
Søren SørensenContributor
asked in Prepare
Max value of multiple columns in Lakehouse

I’m looking for a TimeXtender Fabric Lakehouse (pyspark.sql) expert 😀I’ve got a SQL transformation that selects the maximum value of 10 columns:(select max(val) from (values ([Column_1]), ([Column_2]), ..., ([Column_10])) as [Values](val))How do I achieve this in a Prepare Lakehouse custom transformation?I could build the mother/father of all massive case statements, but I’d prefer something simpler and more elegant … if possible!?

311
rory.smith
TimeXtender Xpert
Paul McLeod Bespoke Analytics
TimeXtender Xpert
Paul McLeod Bespoke AnalyticsTimeXtender Xpert
asked in Prepare
Create Sandbox Ingest in V21

I have a client that wants to explore a significant rework of their Prepare instance. They want to duplicate their existing Prepare instance in Dev to create a sandbox instance. Is there a recommended approach to achieve this? They are using version 6898.1

282
rory.smith
TimeXtender Xpert
Søren Sørensen
Contributor
Søren SørensenContributor
asked in Ingest
Tuning ingestion into Fabric Lakehouse

Does anyone know exactly what happens when we ingest data from e.g. a SQL Server into Fabric Lakehouse? It seems concurrency impacts performance (more can be less) but there might also be Fabric assets in play that could act like bottlenecks, and which requires “capacity” management.Any best recommendations/practices in this space?

211
rory.smith
TimeXtender Xpert
S
Explorer
svaExplorer
asked in Ingest
Optimizing data selection in prepare instance when loading incremental Parquet files

I am loading a table incrementally into my ODX storage in an Azure Data Lake, where new Parquet files are added daily. This approach is because the source only holds data every two weeks, and I want to maintain a log in the ODX. The Parquet storage is very compact.However, for downstream analysis, I only need to retrieve data from the last 1 to 2 days into my prepare instance. I am using a data selection rule on the mapping, and I have also tried applying it directly on the table. Both approaches take a very long time to complete (+1 hour), whereas running the same query on the source SQL database filtering for 2 days of data completes in about 10 seconds.I suspect that the prepare instance is scanning through all the Parquet files, including older days, causing the slow performance.My question:Is there a way to configure the TX prepare instance to only process the most recent X Parquet files (e.g., the last 2 days) instead of scanning all files? This would significantly improve the se

602
Christian Hauggaard
Community Manager
Søren Sørensen
Contributor
Søren SørensenContributor
asked in Ingest
Ingest Lakehouse - Handling invalid characters

Version 7026.1 - Ingest into LakehouseI’ve got a SQL data source where some column names contain spaces. This causes the TX SQL connector (23.0.3.0) to throw the following error when I try to ingest data into a Lakehouse:Executing table dbo_tx_profitcentreinfo:failed with error:Found invalid character(s) among ' ,;{}()\n\t=' in the column names of your schema. Please enable Column Mapping on your Delta table with mapping mode 'name'.You can use one of the following commands.If your table is already on the required protocol version:ALTER TABLE table_name SET TBLPROPERTIES ('delta.columnMapping.mode' = 'name')If your table is not on the required protocol version and requires a protocol upgrade:ALTER TABLE table_name SET TBLPROPERTIES (   'delta.columnMapping.mode' = 'name',   'delta.minReaderVersion' = '2',   'delta.minWriterVersion' = '5')I can read what it says 😀 but I thought I’d ask the Community for advice. Has anyone encountered and resolved this issue? If so, what do you recommen

402
Søren Sørensen
Contributor
B
Contributor
bjornContributor
asked in Ingest
REST Error: Cannot send a content-body with this verb-type.

Hi,TX ver: latest I am getting an error when import metadata or doing table flattening. This worked fine earlier, before 3 june. Works fine using Postman. Any suggestion what I am missing? “One or more errors occurred.Failed to execute request for endpoint 'Get Charge Points'.One or more errors occurred.Cannot send a content-body with this verb-type.System.AggregateException: One or more errors occurred. ---> System.Net.ProtocolViolationException: Cannot send a content-body with this verb-type.   at System.Net.HttpWebRequest.CheckProtocol(Boolean onRequestStream)   at System.Net.HttpWebRequest.BeginGetRequestStream(AsyncCallback callback, Object state)” /Bjørn A.

8710
B
Contributor
P
Contributor
pontus.berglundContributor
asked in Ingest
Is it possible to include the endpoint path as a column with TimeXtender REST connector?

I am fetching refresh logs from power bi using the following endpoint: https://api.powerbi.com/v1.0/myorg/groups/{groupid}/datasets/{id}/refreshes(https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/get-refresh-history-in-group#refresh)In my use case, the groupid is hard coded and I iterate over the datasetid {id} using dynamic values FromEndpointTable.The setup for this is the same as in this guide: My problem is that the dataset id is not included in the payload for the refresh log endpoint, so I have no way of knowing which power bi dataset has been refreshed.Could I somehow include the dynamic endpoint as a field in the result set? Or is there any other way to solve this?Best regards,Pontus B

361
Thomas Lind
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Custom Editor

Somebody can explain how to use the custom editor feature?Is it possible to use SSMS to edit the t-sql scripts?How must be setup it? 

764
rvgfox
Problem Solver
devin.tiemens
TimeXtender Xpert
devin.tiemensTimeXtender Xpert
asked in Ingest
Time Out error: Importing OpenAPI from CheckWX Aviation Weather API

Hi, When trying to replicate the use of “Importing OpenAPI” from this TimeXtender Tuesdays video i get bellow Time Out error:  I am wondering if i am doing something wrong, or one could replicate this issue aswell.Regards,Devin

425
devin.tiemens
TimeXtender Xpert
P
Contributor
Paul BridgeContributor
asked in Prepare
How to Clone a Table From One Prepare Instance Into Another

HiLooking to quickly replicate an existing data pipeline in a new prepare instance. Is it possible to clone a table in one prepare instance into another, or somehow export a table from one prepare instance and import into another?I cannot see any option, so my guess is no, but just thought I’d ask.RegardsPaul

579
rory.smith
TimeXtender Xpert
A
Explorer
AmrExplorer
asked in Ingest
Invalid column count Excel sheet on storage account

Suddenly all the excel sheets are not loading anymore however some of them no one touched 6 months ago.the error is:Executing table excel_sheet:failed with error:Exception Type: System.ExceptionMessage: Invalid column count             Stack Trace: at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.<>c__DisplayClass41_5.<UploadData>b__14(DataTable dataTable, Partition partition)                          at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.UploadData(ADLSGen2APIManager api, DataSourceModel dataSourceModel, DataLakeGen2ExecutionMethod executionMethod, Action`2 writeExecutionLog)                          at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.<>c__DisplayClass35_2.<TransferDataAsync>b__7(DataLakeGen2ExecutionMethod executionMethod)                          at DataSourceEngine.Custom.CustomSourceEngine.InvokeDataSourceExecution(Action`1 action)                          at DataSourceEngine.Custom.CustomSourceEngine.RunExecu

9710
A
Explorer
avanrijn
Contributor
avanrijnContributor
asked in Ingest
ODX TimeXtender Parquet Data Source connector (23.1.1.0 64bit)

Dear Sir,Our client is running TimeXtender 6963.1.So want a rowcount, count(*) on our tables loaded in de ODX.Our ODX is configured with ADSL (Azure Datalake Gen2 Storage).So we want to use the ODX TimeXtender Parquet Data Source connector (23.1.1.0 64bit).Is it possible to run a count(*) query to our tables when we setup this connection to our ADSL?We need to know how many records are loaded in all of our tables.We have a lot of incremental tables, so we worry of all the increment files in the lake. Do we need to configure some sort of a aggregation ?Is there documentation available how to configure this ? The connector has a lot of options, we don’t know all the details.Hope somebody has some experience with this Parquet connector.Thank you in advance for looking into this.Regards,Arthur

571
Christian Hauggaard
Community Manager

Badge winners

Show all badges
Terms and ConditionsCookie settings