Skip to main content
To homepage To homepage

TimeXtender Desktop Q&A

Ask questions and find answers about the TimeXtender Desktop Application

664 Topics
bas.hopstaken
TimeXtender Xpert
bas.hopstakenTimeXtender Xpert
posted in Prepare
Batch cleansing option - best practices, tips and tricks

Hi all,I'd like to start a discussion about the batch cleansing option. You can find this option in: Table Settings → Performance → Enable batch data cleansing. This option is disabled by default. I'm looking for best practices when you should use it and how to determine the best batch cleansing size.I normally enable it on big tables (5.000.000 + rows), this reduces the disk space used for logging. But in some cases it also improves performance. It can result in faster loading of a table. However, I'm always struggling determining the correct batch size. I know the answer will be ‘it depends’. But I'm trying to find some best practices for this option.For now I start at 250.000 rows for batch cleansing and increase with 250.000 rows. I write down the timings and pick the best setting. This setting depends on the number of rows and number of transformations in the table. I'm curious if there are any practices or tips and tricks for this?

5673
rory.smith
TimeXtender Xpert
25 days ago
M
Starter
mvansprundelStarter
asked in Deliver
Error deploying tabular endpoint - "A device attached to the system is not functioning"

During deployment of a tabular endpoint in 20.10.44.64 the error listed below occurs. The same error appears for multiple people in my organization, also in TimeXtender 6346.1The error only occurs when deploying, not when executing. In SQL Server Management Studio (Analysis Server), the executed tables do occur, but remain empty. Naturally, connecting to the endpoint in Power BI is not possible. Error:Failed to save modifications to the server. Error returned: 'The following system error occurred:  A device attached to the system is not functioning. The following system error occurred:  A device attached to the system is not functioning. The following system error occurred:  A device attached to the system is not functioning. The following system error occurred:  A device attached to the system is not functioning. The following system error occurred:  A device attached to the system is not functioning. The following system error occurred:  A device attached to the system is not functio

32010
L
Starter
26 days ago
p.ruijter
Contributor
p.ruijterContributor
asked in Jobs & Executions
Execution packages starts later than scheduled

All Execution packages with a schedule do not start at the time given. It starts always seconds to minutes later than the schedule indicates. Why doesn't it start according to the schedule?It happens with almost all packages. It also varies by package. The same package can start seconds later or 2 minutes later. For example: in the screenshots you can see that the package always starts later than 05:00 as scheduled. 

13619
Christian Hauggaard
Community Manager
29 days ago
B
Contributor
BennyContributor
asked in Ingest
Incremental load rules in Ingest Instance incorrectly set/displayed in UI

Hello,Sometimes a picture says is all, but to be complete:I set my incremental load rule on my datasource to mach any field containing ‘UPMJ’ (INT) with updates and deletes and most importantly: set the “substract from value”-value to 2. Looking at the picture above this is either not set correctly or not displayed correctly. 

333
Christian Hauggaard
Community Manager
29 days ago
avanrijn
Contributor
avanrijnContributor
asked in Ingest
Microsoft Excel Online

Dear Sir,We connect to our Excel files through a Sharepoint site with some Document Libraries. Works fine, but the performance is bad 😑 -5 minutes wait to Select Tables -5 minutes wait to execute Synchronize 5 minutes wait for execute Full Load Is there a way to squeeze some performance out of this ? Thanks in advance for looking into this performance issue. Regards,Arthur 

6810
Christian Hauggaard
Community Manager
1 month ago
B
Starter
bjornStarter
asked in Prepare
Updated TX 6814.1 with strange behavior for incr tables in prepare (desktop)

Hi,I updated our TX version to the newest 6814.1 I have added many tables in TimeXtender Ingest Server with incremental load. Why do I have to change all incr. tables in "desktop app" to explicit incremental load, can't you use “Automatic” anymore? Error msg: when executing with automatic on a table with incr setup from the datasource I get this type of error “Invalid object name 'shema.table_I'.” Something I haven't done right... regards,Bjørn A.

826
devin.tiemens
TimeXtender Xpert
1 month ago
avanrijn
Contributor
avanrijnContributor
asked in Ingest
Connecting to PostgreSQL database with ODBC

Dear Sir,I want to connect to a PostgreSQL database via ODBC.So I found these posts how to fix this. But I am using TX version 6766.1.Can someone please point me the way how to fix this with the latest and the greatest version of TimeXtender.See Word document in the attachment with my setup.https://legacysupport.timextender.com/hc/en-us/articles/4410466782621-Create-a-ODBC-data-source-in-a-ODX-or-with-a-Any-Source-ADO-Net-provider-in-a-Business-UnitThanxs in advance.Regards,Arthur

212
avanrijn
Contributor
1 month ago
Roy V
Problem Solver
Roy VProblem Solver
asked in Prepare
Object reference not set to an instance of an object.

I am deploying a project to Snowflake.On a table I get the following error:Object reference not set to an instance of an object.As read in another ticket I did a ‘Save and reload' but unfortunately that did not solve the issue.It;s on deploying the data cleansing script however it does not show me the script in the deployment log, I only see the error message. Is there an easy  way i can see what lookup column is causing the issue ? 

12711
Roy V
Problem Solver
1 month ago
avanrijn
Contributor
avanrijnContributor
asked in Ingest
Load semicolon csv file

I am trying to load a semicolon csv file with ODX (version 6766.1)The output is just 1 column.What box do I have to tick in the app portal to seperate the collumns on ; (semicolon) ?Regards,Arthur

302
Thomas Lind
Community Manager
1 month ago
RobvdBrink
Starter
RobvdBrinkStarter
asked in Ingest
Ingesting JSON files from nested date and hour subfolders

Hi all,I am currently working with a client who is using TimeXtender version 6766.1 in an Azure environment. We are trying to ingest data from a source that generates JSON files stored in a hierarchical folder structure organized by date and hour. The folder structure is as follows:subject/version/date=YYYY-MM-DD/hr=HH/*.jsonExample Path: dev/Call/1.2/date=2024-10-30/hr=14/*.jsonWithin each hr=HH (hour) folder, there may be one or more JSON files. Similarly, each date=YYYY-MM-DD (date) folder may contain multiple hour subfolders, though it's rare for all 24 hour subfolders to be present.I have successfully configured the data source connector in TimeXtender to read all JSON files from a specific hour folder, as shown in the example above. However, our goal is to configure TimeXtender to ingest all JSON files across all date and hour subfolders under the main path:dev/Call/1.2/ When I attempt to use wildcards to achieve this—such as:dev/Call/1.2/*/*/*.json I encounter an error stating:E

652
Thomas Lind
Community Manager
1 month ago
S
Contributor
sigsolContributor
asked in Ingest
JSON with an empty property name in TimeXtender REST API 6.1

Hello,I am encountering a challenge with the REST connector when it deals with JSON data that includes empty property names. This issue arises specifically during the conversion of JSON to XML.The REST connector fails when trying to convert JSON data that contains properties with empty names. Here is the error message I receive:Failed to execute endpoint 'authenticate':XmlNodeConverter cannot convert JSON with an empty property name to XML. Path 'TX_Autogenerated_Element.menu.categories.', line 1, position 94530. This error stops the ingestion process because XML does not support tags with empty names, which are present in the JSON structure. This is the problematic part of the JSON structure:{    "categories": {        "": {            "collapsed": false,            "description": "<No Category>",            "id": ""        },        "BUD": {            "collapsed": false,            "description": "Budget",            "id": "BUD"        }        // Additional categories    }} I

17610
S
Contributor
1 month ago
P
Contributor
Paul BridgeContributor
asked in Ingest
Overnight Jobs Not Run - Failing ODX Service

HiWe experienced for the second time a failure with our overnight TX jobs not running (first time was on 16 Sep) and on investigation we were not able to open up the ODX in TimeXtender (same issue as already logged here https://support.timextender.com/ingest-89/tx-freezes-when-opening-the-odx-2248)Could not manually stop and restart the  [TimeXtender_Ingest_Service_6744.1] service, so had to manually kill the task from the CMD and rerun the [TimeXtender Ingest Service Configuration 6744.1] tool.In the other post the conclusion seemed to be that this issue had now been resolved, but for us the issue has now occurred twice in the last 6 or so weeks.Is this still a known issue?TimeXtender Ingest 6744.1TimeXtender Data Integration 6745.1

441
Christian Hauggaard
Community Manager
1 month ago
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Deliver
Using API REST Endpoint to integrate with external DB

I would like to test this new functionality.I’ve read: https://support.timextender.com/deliver-109/rest-api-endpoint-1808?tid=1808&fid=109But I can't understand how to send the tables from the SSL instance to the target DB using this technique. Can you explain me with a clearer example? 

476
anders.e.jonsson
Contributor
1 month ago
M
Starter
MaarsenStarter
asked in Ingest
GA4 -- Multiple Properties

Hi, I'm currenty developing the GA4 connector in TimeXtender. With some other tips and tricks of other posts it was quite simple to create the connection. At this moment I have 7 different properties from where all data should be loaded. I've read multiple posts but haven't found a solution to extract data dynamically over a list of properties.  Current setup:CData Connector -- Google Analytics In this connector I can filter on property ID. TimeXtender -- v6xxxx + ODX Creating managed Queries to filter the relevant data from [GlobalAccessObject]. But haven't found a property id in this list.  I think that currently the only option is to create for each property one connection. Or has someone found another solution?

494
andrew.gebhard
TimeXtender Xpert
1 month ago
M
Visitor
MarcoVisitor
asked in Ingest
Ingest Data from Infor Data Fabric

Hi, we are in a project to update our on premise ERP system Infor to the current version Infor LN CE which is running on the cloud. Since we cannot access the database then directly we are currently checking how to ingest the data to TimeXtender in future. There is a tool within the ERP suite to provide the data to "Infor Data Fabric" which is an Amazon S3 data lake where the ERP data is stored in JSON files. This data fabric provides a SQL Endpoint to query the data. So similar architecture as in MS fabric with lakehouses. The data can be queried in two ways:- JDBC: using a JDBC driver with API Gateway authentification, see    Link- API: handle API request in a certain order to start a query job, aks its status and get the results, see link:        https://www.youtube.com/watch?v=m4d0awIQ6AgFor TimeXtender, which would be the way to prefer? I could not find the possibility to add a JDBC datasource with API authentification and I am wondering if TimeXtender can handle the process order

532
Thomas Lind
Community Manager
1 month ago
P
Explorer
Pieter-JanExplorer
asked in Ingest
the table folder is used by another table

Hi,i have a gen2 storage account with a blob container with multiple parquet files. when i do a sync with odx it’s succesfull, the transfer gives me for 4 files the message “ is used by another table”. all other files in the same map go ok. have tried to recreate the blob container, and recreate the parquet files again, same results.Exact message:The table folder 'parquet_taak_status' is used by another table with the id 9a510177-a130-4bcc-aaaa-5abefd42c1b9 how to solve / find the other table that is referenced to? thanks!  

1034
rory.smith
TimeXtender Xpert
1 month ago
S
Explorer
svaExplorer
asked in Ingest
Issues Retrieving datetimeoffset Columns with ODBC in TimeXtender

Hello everyone,I'm facing an issue with TimeXtender when trying to retrieve tables containing datetimeoffset columns through the Generic ODBC Data Source connector. The datetimeoffset columns aren’t coming through, and in the ODBC settings, the option to override datetime types is greyed out, which I thought might solve the issue.Has anyone encountered this or found a workaround to retrieve datetimeoffset data through ODBC in TimeXtender?Thanks in advance!

293
rory.smith
TimeXtender Xpert
1 month ago
T
Participant
thzmanParticipant
asked in Prepare
Object reference not set to an instance of an object.

Hi!Getting this error when I try to open the Dev instance. Test and Prod is OK.I could open an earlier version of the project but after I made some changes and tried to save and deploy, I first got a warning that said that this was not the latest version. When I chose to save anyway, I got the same error. Is there some way to “force save” to make this earlier version the latest one and get rid of the error?

471
Thomas Lind
Community Manager
1 month ago
D
Contributor
dsvartzmanContributor
asked in Prepare
Multiple ODX for different enviroments

Hi,I was wondering  if it's possible to use multiple ODX instances for different enviroments (DEV/ACC/PRD).I know that at 20.10 you could only use a single ODX as after multiple enviroment transfer all mapping to ODX would be lost when using multiple ODX instances Is this still the case? Is this issue solved in next-gen?  

8515
D
Contributor
1 month ago
S
Explorer
svaExplorer
asked in Ingest
Issue with Retrieving a Column with the Same Name as a SQL Function

Hi everyone,I'm facing an issue where one of the columns in my destination table has the same name as a SQL function, and because of this, I'm unable to retrieve it in a normal way. To work around this problem, I wanted to use the Query Table Tool to retrieve the column in a parameterized way.However, for this specific data source (which is a Generic ODBC Data Source), the Query Table Tool option is greyed out. I've noticed that the Query Table Tool is available for other data source types.Has anyone encountered this issue before?Thanks in advance!

606
S
Explorer
1 month ago
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Deliver
What security options are supported for Deliver REST endpoints

Hi,which kinds of security are available for REST Endpoints and how should they be implemented? Can you directly use row-level security in the Deliver instance? 

301
Christian Hauggaard
Community Manager
1 month ago
D
Contributor
dennishanssenContributor
asked in Ingest
Error when filtering columns BC Online

Using the TimeXtender Dynamics 365 Business Central - Online connector, I'm having trouble filtering columns in the ODX. With all columns selected everything is fine, but once I make a selection in columns I get the error below when running the Transfer Task. Any ideas on why this is happening and how to fix it? (TX Version 6XXX) Executing table customer:failed with error:Exception Type: System.InvalidOperationExceptionMessage: Sequence contains no matching element             Stack Trace: at System.Linq.Enumerable.First[TSource](IEnumerable`1 source, Func`2 predicate)                          at TimeXtender.ODX.Account.BC365CustomDataSource.ExecutionHelper.GetIncrementalLoadPartitionSetups(AccountBC365CustomDataSource accountBC365CustomDataSource, TableModel tableModel)                          at TimeXtender.ODX.Account.BC365CustomDataSource.AccountBC365CustomDataSource.GetIncrementalLoadSetups(TableModel tableModel)                          at DataSourceEngine.Custom.CustomSourceEng

447
D
Contributor
1 month ago
H
Starter
hans.westerhofStarter
asked in Jobs & Executions
TimeXtender API not showing all errors

Hi all,I have a customer that has to deal with an unreliable source system. During transfering specific query tables, it sometimes fails. As there is no retry option on this level, at least we can do right now is to inform the customer that things went wrong.  Unfortunately the TimeXtender API does not tell us there is anything wrong with this run. The “State” is 2, and all the child “JobExecutionLogs” child entries below the job itself all have the “Severity” value of 0. Does someone recognize this situation? Anything we can do differently to inform the customer?

895
Christian Hauggaard
Community Manager
2 months ago
avanrijn
Contributor
avanrijnContributor
asked in Ingest
Cdata Sharepoint connection Data Model feature

Dear Sir,I am connecting through Cdata to Sharepoint Online.I have hierarchies in my Sharepoint data, I can see them when I connect with PowerBI to my Sharepoint site. Can I use the Data Model feature ‘Flatten Documents’ like you can with JSon connectivity ?It looks like CData for Sharepoint Online doesn't have this capability. Can I somehow bring these ‘hidden fields’ into my TimeXtender  project ?In the attachment (Knipsel.PNG) you can see the hierarchical option in PowerBI with PowerQuery. I miss these fields when I connect with TX Cdata to the same Sharepoint site.Hope you can shine a light on this.Thank you in advance for looking into this case. Regards,Arthur 

212
avanrijn
Contributor
2 months ago
Pontus Olausson
Participant
Pontus OlaussonParticipant
asked in Ingest
Error 'Buffer cannot be null' in ODBC Connection

 Hi,I’m am trying to create a ODBC data source connection in the TimeXtender ODX portal.I have created a ODBC data source on the server on which TimeXtender is run, see picture below. This data source seems to work fine, I am able to test the connection with success and I am able to connect to the database and query the data through PSQL control center on the server.ODBC Data Source on TimeXtender VM In the TimeXtender portal, my configuration is as follows:TimeXtender portal configurationWhen trying to test the connection, I get the error “Buffer cannot be null. Parameter name: buffer”.I have tried adding buffer as an additional property without success.I am unable to find documentation or guidance on how to solve this issue. Since I am able to connect to the database and query the data through PSQL control center on the server on which TimeXtender is run, the ODBC data source on the server seems to be working correctly. It is only through the TimeXtender portal I am unable to use the

8210
Pontus Olausson
Participant
2 months ago

Badge winners

  • Certified Solutions Architect
    Dikshahas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    brett.taylorhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    RobvdBrinkhas earned the badge Certified Solutions Architect
  • Ingest Expert
    aftabphas earned the badge Ingest Expert
  • Certified Solutions Architect
    Leo Rogemanhas earned the badge Certified Solutions Architect
Show all badges
Terms and ConditionsCookie settings