Ingest

Hi, I have a unity catalog in azure databricks where I want to connect to from Timextender (20.10.44), I installed the Cdata connector for Databricks (2024) and am able to connect via test connection (succesfully connected) but when i try to save TX has issues with the length of the (Protocol ?) version which is empty but also using 1 till 8 which are available in the drop down list all result in the same errorWhat do I need to do in order to get his working? Kind regards,  

Hi I want to download the latest version of TDI and Ingest Service which is 6823.1. But when I use the link to download, it still gives 6822.1. Can you please share the link for the same to download.Also can someone share the link to download 6766.1 with Ingest Services.

Hi,We are trying to connect to several CSV files stored in a local folder. While we can successfully synchronize the data source and perform a full load in the ODX, we encounter an error when attempting to add the table to our data area (DSA).The issue lies in the path to the Parquet file stored in Azure. The correct path should be:CSV_DNB/csv_*/DATA_2024_11_28__11_09_50_2219585/DATA/DATA_0000.parquet However, the path Timextender is looking for is:CSV_DNB/csv_^*/DATA_2024_11_28__11_09_50_2219585/DATA/DATA_0000.parquet It seems that Timextender is misinterpreting the automatically generated name and adds a ^ character.I also attempted to use a specific file aggregation pattern, such as;H100.*.csv(all files in folder have the prefix H100 followed by a random number). However, I encountered the same error. Is there a way to specify the name of the table generated in the ODX? It seems like the “File aggregation pattern” is the issue. Do you have any idea how to fix this?  -Execute Executi

Hi,we have an Afas datasource via provider cddata rest 2023. The Afas getconnector has been updated with new columns. When i run the sync task for this Afas datasource i expect timex to detect the new columns but this is not the case. What do i need to do to let timex see this new columns? thank u in advance,Bob

Hi,we have created a new datasource for Azure Active Directory(Entra ID) via “cdata ado.netprovider for azure active directory 2022”de sync task runs ok but the transfer task keeps giving a completed with error signal. I have discussed this error with a consultant and a system/ authorization specialist but we cannot get it right. The error we are getting is(first part of the error): Executing table azuread_users:failed with error:System.Data.CData.AzureAD.AzureADException (0x80004005): [500] Could not execute the specified command: [Authentication_RequestFromUnsupportedUserRole] User is not in the allowed roles.  ---> cjo220x.BG: [Authentication_RequestFromUnsupportedUserRole] User is not in the allowed roles.  ---> cjo220x.Qt: [Authentication_RequestFromUnsupportedUserRole] User is not in the allowed roles.please advise us how to handle this. thank you in advance,Bob van Ierssel

We are experiencing a small issue with one of the connectors while using managed queries. When I use the query tool, we are utilizing the SQL endpoint from a Fabric Lakehouse to retrieve the data into the ODX. When I query the DBO table, I receive 12 records. For example, when running this query:SELECT [SinkCreatedOn],       [SinkModifiedOn],       [omoperatingunitnumber],       [modifieddatetime],       [modifiedby],       [createddatetime],       [createdby],       [dataareaid],       [recid],       [tableid],       [createdon],       [modifiedon],       [IsDelete]  FROM dbo.[omoperatingunit] I also get 12 records. However, when we transfer this managed query, we only receive 11 records. This issue has occurred with multiple tables. We are not applying any filters to this dataset.Do you have any idea why this might be happening? Manually excluding or including all the columns is not manageable on the scale we are working with, so we rely on writing managed queries.

I believe I followed the instructions I found here: But for some reason it wont work on my end, or maybe i’m doing something wrong? I’m using TX version 6745.1 which is one of the latest. I have set the column that gives me the error to convert to text.After that I double checked to see if TX would indeed override the datatype and turn it into text. I synchonize again and try to transfer. But for some reason it keeps throwing me the error:Message: Error obtaining value '25-mei-1991' for column 'Geboorte Datum'. Failed to convert  to datatype: 'datetime'. The original datatype of the column is: 'datetime'.Am I missing how this is supposed to work, or am I doing something wrong?

Hello,Sometimes a picture says is all, but to be complete:I set my incremental load rule on my datasource to mach any field containing ‘UPMJ’ (INT) with updates and deletes and most importantly: set the “substract from value”-value to 2. Looking at the picture above this is either not set correctly or not displayed correctly. 

Dear Sir,We connect to our Excel files through a Sharepoint site with some Document Libraries. Works fine, but the performance is bad 😑 -5 minutes wait to Select Tables -5 minutes wait to execute Synchronize 5 minutes wait for execute Full Load Is there a way to squeeze some performance out of this ? Thanks in advance for looking into this performance issue. Regards,Arthur 

Dear Sir,I want to connect to a PostgreSQL database via ODBC.So I found these posts how to fix this. But I am using TX version 6766.1.Can someone please point me the way how to fix this with the latest and the greatest version of TimeXtender.See Word document in the attachment with my setup.https://legacysupport.timextender.com/hc/en-us/articles/4410466782621-Create-a-ODBC-data-source-in-a-ODX-or-with-a-Any-Source-ADO-Net-provider-in-a-Business-UnitThanxs in advance.Regards,Arthur

I am trying to load a semicolon csv file with ODX (version 6766.1)The output is just 1 column.What box do I have to tick in the app portal to seperate the collumns on ; (semicolon) ?Regards,Arthur

Hi all,I am currently working with a client who is using TimeXtender version 6766.1 in an Azure environment. We are trying to ingest data from a source that generates JSON files stored in a hierarchical folder structure organized by date and hour. The folder structure is as follows:subject/version/date=YYYY-MM-DD/hr=HH/*.jsonExample Path: dev/Call/1.2/date=2024-10-30/hr=14/*.jsonWithin each hr=HH (hour) folder, there may be one or more JSON files. Similarly, each date=YYYY-MM-DD (date) folder may contain multiple hour subfolders, though it's rare for all 24 hour subfolders to be present.I have successfully configured the data source connector in TimeXtender to read all JSON files from a specific hour folder, as shown in the example above. However, our goal is to configure TimeXtender to ingest all JSON files across all date and hour subfolders under the main path:dev/Call/1.2/ When I attempt to use wildcards to achieve this—such as:dev/Call/1.2/*/*/*.json I encounter an error stating:E

Hello,I am encountering a challenge with the REST connector when it deals with JSON data that includes empty property names. This issue arises specifically during the conversion of JSON to XML.The REST connector fails when trying to convert JSON data that contains properties with empty names. Here is the error message I receive:Failed to execute endpoint 'authenticate':XmlNodeConverter cannot convert JSON with an empty property name to XML. Path 'TX_Autogenerated_Element.menu.categories.', line 1, position 94530. This error stops the ingestion process because XML does not support tags with empty names, which are present in the JSON structure. This is the problematic part of the JSON structure:{    "categories": {        "": {            "collapsed": false,            "description": "<No Category>",            "id": ""        },        "BUD": {            "collapsed": false,            "description": "Budget",            "id": "BUD"        }        // Additional categories    }} I

HiWe experienced for the second time a failure with our overnight TX jobs not running (first time was on 16 Sep) and on investigation we were not able to open up the ODX in TimeXtender (same issue as already logged here https://support.timextender.com/ingest-89/tx-freezes-when-opening-the-odx-2248)Could not manually stop and restart the  [TimeXtender_Ingest_Service_6744.1] service, so had to manually kill the task from the CMD and rerun the [TimeXtender Ingest Service Configuration 6744.1] tool.In the other post the conclusion seemed to be that this issue had now been resolved, but for us the issue has now occurred twice in the last 6 or so weeks.Is this still a known issue?TimeXtender Ingest 6744.1TimeXtender Data Integration 6745.1

Hi, I'm currenty developing the GA4 connector in TimeXtender. With some other tips and tricks of other posts it was quite simple to create the connection. At this moment I have 7 different properties from where all data should be loaded. I've read multiple posts but haven't found a solution to extract data dynamically over a list of properties.  Current setup:CData Connector -- Google Analytics In this connector I can filter on property ID. TimeXtender -- v6xxxx + ODX Creating managed Queries to filter the relevant data from [GlobalAccessObject]. But haven't found a property id in this list.  I think that currently the only option is to create for each property one connection. Or has someone found another solution?

Hi, we are in a project to update our on premise ERP system Infor to the current version Infor LN CE which is running on the cloud. Since we cannot access the database then directly we are currently checking how to ingest the data to TimeXtender in future. There is a tool within the ERP suite to provide the data to "Infor Data Fabric" which is an Amazon S3 data lake where the ERP data is stored in JSON files. This data fabric provides a SQL Endpoint to query the data. So similar architecture as in MS fabric with lakehouses. The data can be queried in two ways:- JDBC: using a JDBC driver with API Gateway authentification, see    Link- API: handle API request in a certain order to start a query job, aks its status and get the results, see link:        https://www.youtube.com/watch?v=m4d0awIQ6AgFor TimeXtender, which would be the way to prefer? I could not find the possibility to add a JDBC datasource with API authentification and I am wondering if TimeXtender can handle the process order

Hello everyone,I'm facing an issue with TimeXtender when trying to retrieve tables containing datetimeoffset columns through the Generic ODBC Data Source connector. The datetimeoffset columns aren’t coming through, and in the ODBC settings, the option to override datetime types is greyed out, which I thought might solve the issue.Has anyone encountered this or found a workaround to retrieve datetimeoffset data through ODBC in TimeXtender?Thanks in advance!

Hi everyone,I'm facing an issue where one of the columns in my destination table has the same name as a SQL function, and because of this, I'm unable to retrieve it in a normal way. To work around this problem, I wanted to use the Query Table Tool to retrieve the column in a parameterized way.However, for this specific data source (which is a Generic ODBC Data Source), the Query Table Tool option is greyed out. I've noticed that the Query Table Tool is available for other data source types.Has anyone encountered this issue before?Thanks in advance!

Using the TimeXtender Dynamics 365 Business Central - Online connector, I'm having trouble filtering columns in the ODX. With all columns selected everything is fine, but once I make a selection in columns I get the error below when running the Transfer Task. Any ideas on why this is happening and how to fix it? (TX Version 6XXX) Executing table customer:failed with error:Exception Type: System.InvalidOperationExceptionMessage: Sequence contains no matching element             Stack Trace: at System.Linq.Enumerable.First[TSource](IEnumerable`1 source, Func`2 predicate)                          at TimeXtender.ODX.Account.BC365CustomDataSource.ExecutionHelper.GetIncrementalLoadPartitionSetups(AccountBC365CustomDataSource accountBC365CustomDataSource, TableModel tableModel)                          at TimeXtender.ODX.Account.BC365CustomDataSource.AccountBC365CustomDataSource.GetIncrementalLoadSetups(TableModel tableModel)                          at DataSourceEngine.Custom.CustomSourceEng

Dear Sir,I am connecting through Cdata to Sharepoint Online.I have hierarchies in my Sharepoint data, I can see them when I connect with PowerBI to my Sharepoint site. Can I use the Data Model feature ‘Flatten Documents’ like you can with JSon connectivity ?It looks like CData for Sharepoint Online doesn't have this capability. Can I somehow bring these ‘hidden fields’ into my TimeXtender  project ?In the attachment (Knipsel.PNG) you can see the hierarchical option in PowerBI with PowerQuery. I miss these fields when I connect with TX Cdata to the same Sharepoint site.Hope you can shine a light on this.Thank you in advance for looking into this case. Regards,Arthur 

 Hi,I’m am trying to create a ODBC data source connection in the TimeXtender ODX portal.I have created a ODBC data source on the server on which TimeXtender is run, see picture below. This data source seems to work fine, I am able to test the connection with success and I am able to connect to the database and query the data through PSQL control center on the server.ODBC Data Source on TimeXtender VM In the TimeXtender portal, my configuration is as follows:TimeXtender portal configurationWhen trying to test the connection, I get the error “Buffer cannot be null. Parameter name: buffer”.I have tried adding buffer as an additional property without success.I am unable to find documentation or guidance on how to solve this issue. Since I am able to connect to the database and query the data through PSQL control center on the server on which TimeXtender is run, the ODBC data source on the server seems to be working correctly. It is only through the TimeXtender portal I am unable to use the

Hello Community!When running a rollup task, the resulting rollup file ends up in a separate folder inside the same full load folder: After the rollup, new incremental files continue to appear in the DATA folder and the old incremental files are still there. What have we achieved by doing the rollup? Is the new rollup file being used at all? How can we delete the old incremental files given that the delete Storage Management task only removes entire full load folders and we don’t perform full loads?Currently I don’t understand how we can clean up the many incremental files, both for load performance and storage management.Please note: We cannot rely on doing regular full loads because of the size of the tables.Thanks!TX version: 6745.1Connector: TimeXtender SQL Data Source 21.0.2.1We are using Azure Data Lake and ADF.

I’m trying to connect to Business Central Online using the Time Xtender connector. I’m using a service principal which has an app registration in Azure and I’ve run through all the steps in the BC/TX tutorial.I’m getting the following error message when I try to add the data source. Any ideas what might happen Service request failed: Sequence contains no matching element (System.InvalidOperationException)Details:Service request failed: Sequence contains no matching element (System.InvalidOperationException)Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException   at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, Func`3 func)   at TimeXtender.DataManager.AddODXDataSourceWizard_SelectConnectionStep.<>c__DisplayClass11_0.<Validate>b__0()   at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy)Service request failed: Sequence contains no matching element (System.InvalidOperationException)Modul

Hi support,Following this ticket I will make one myself to keep things clear. We have set up a Business Central 365 connection, both via OAuth2.0 as service to service authentication. We have succesfully tested the connection with both authentication options. However, when we want to read objects, we receive the error “Invalid response from Business Central retrieving table Field for company”. Full log is added to this ticket as an attachment. We have walked through all steps from the prerequisites guide. Hence, we have a succesful connection. From the other ticket I understand that there are more versions of the Jet Analytics for Business Central extension. It has to be the newest one and I have to keep on trying. In the Extension Marketplace we only find two versions of the Jet Analytics for Business Central extension. The first from Jet Global Data Technologies is not available anymore and they point to the second; the one from insightsoftware. This is the one we have installed; ver

Hi!I’m doing some tests and trying to set up som e form of incremental load with this connector to an API endpoint. It works fine with the two static parameters but as soon as I add the parameter for lastSynchronizedRowVersion with its dynamic value I get an error with I run the Synchronize job.Is there something obvious that I have missed here?I tried to follow the article Connect to Fixer IO with the TimeXtender REST data source | CommunitySetup for the endpoint: Error message: