- - Knowledge base overview
Product Updates
Training
Portal
For Partners
TimeXtender Classic

Home
Community overview
TimeXtender Desktop Q&A
Ingest

Ingest

Ask questions about Ingest Instances in TimeXtender Data Integration

225 Topics
1,223 Replies

When you subscribe we will email you when there is a new topic in this category

225 Topics

Recently active

Most replies Most views Newest first

avanrijnContributor

asked in Ingest

Cdata Sharepoint connection Data Model feature

Dear Sir,I am connecting through Cdata to Sharepoint Online.I have hierarchies in my Sharepoint data, I can see them when I connect with PowerBI to my Sharepoint site. Can I use the Data Model feature ‘Flatten Documents’ like you can with JSon connectivity ?It looks like CData for Sharepoint Online doesn't have this capability. Can I somehow bring these ‘hidden fields’ into my TimeXtender project ?In the attachment (Knipsel.PNG) you can see the hierarchical option in PowerBI with PowerQuery. I miss these fields when I connect with TX Cdata to the same Sharepoint site.Hope you can shine a light on this.Thank you in advance for looking into this case. Regards,Arthur

2 hours ago

BernarddbTimeXtender Xpert

asked in Ingest

Different output query tool vs transfer in the odx TX SQL connector (Classic)

We are experiencing a small issue with one of the connectors while using managed queries. When I use the query tool, we are utilizing the SQL endpoint from a Fabric Lakehouse to retrieve the data into the ODX. When I query the DBO table, I receive 12 records. For example, when running this query:SELECT [SinkCreatedOn], [SinkModifiedOn], [omoperatingunitnumber], [modifieddatetime], [modifiedby], [createddatetime], [createdby], [dataareaid], [recid], [tableid], [createdon], [modifiedon], [IsDelete] FROM dbo.[omoperatingunit] I also get 12 records. However, when we transfer this managed query, we only receive 11 records. This issue has occurred with multiple tables. We are not applying any filters to this dataset.Do you have any idea why this might be happening? Manually excluding or including all the columns is not manageable on the scale we are working with, so we rely on writing managed queries.

6 hours ago

Pontus OlaussonParticipant

asked in Ingest

Error 'Buffer cannot be null' in ODBC Connection

Hi,I’m am trying to create a ODBC data source connection in the TimeXtender ODX portal.I have created a ODBC data source on the server on which TimeXtender is run, see picture below. This data source seems to work fine, I am able to test the connection with success and I am able to connect to the database and query the data through PSQL control center on the server.ODBC Data Source on TimeXtender VM In the TimeXtender portal, my configuration is as follows:TimeXtender portal configurationWhen trying to test the connection, I get the error “Buffer cannot be null. Parameter name: buffer”.I have tried adding buffer as an additional property without success.I am unable to find documentation or guidance on how to solve this issue. Since I am able to connect to the database and query the data through PSQL control center on the server on which TimeXtender is run, the ODBC data source on the server seems to be working correctly. It is only through the TimeXtender portal I am unable to use the

6 hours ago

sigsolContributor

asked in Ingest

How to use Rolllup task

Hello Community!When running a rollup task, the resulting rollup file ends up in a separate folder inside the same full load folder: After the rollup, new incremental files continue to appear in the DATA folder and the old incremental files are still there. What have we achieved by doing the rollup? Is the new rollup file being used at all? How can we delete the old incremental files given that the delete Storage Management task only removes entire full load folders and we don’t perform full loads?Currently I don’t understand how we can clean up the many incremental files, both for load performance and storage management.Please note: We cannot rely on doing regular full loads because of the size of the tables.Thanks!TX version: 6745.1Connector: TimeXtender SQL Data Source 21.0.2.1We are using Azure Data Lake and ADF.

1 day ago

JorisKammaExplorer

asked in Ingest

Business Central Online Connection Error

I’m trying to connect to Business Central Online using the Time Xtender connector. I’m using a service principal which has an app registration in Azure and I’ve run through all the steps in the BC/TX tutorial.I’m getting the following error message when I try to add the data source. Any ideas what might happen Service request failed: Sequence contains no matching element (System.InvalidOperationException)Details:Service request failed: Sequence contains no matching element (System.InvalidOperationException)Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, Func`3 func) at TimeXtender.DataManager.AddODXDataSourceWizard_SelectConnectionStep.<>c__DisplayClass11_0.<Validate>b__0() at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy)Service request failed: Sequence contains no matching element (System.InvalidOperationException)Modul

1 day ago

Remy Kamphuis | VictaParticipant

asked in Ingest

Error BC365 connection after testing connection

Hi support,Following this ticket I will make one myself to keep things clear. We have set up a Business Central 365 connection, both via OAuth2.0 as service to service authentication. We have succesfully tested the connection with both authentication options. However, when we want to read objects, we receive the error “Invalid response from Business Central retrieving table Field for company”. Full log is added to this ticket as an attachment. We have walked through all steps from the prerequisites guide. Hence, we have a succesful connection. From the other ticket I understand that there are more versions of the Jet Analytics for Business Central extension. It has to be the newest one and I have to keep on trying. In the Extension Marketplace we only find two versions of the Jet Analytics for Business Central extension. The first from Jet Global Data Technologies is not available anymore and they point to the second; the one from insightsoftware. This is the one we have installed; ver

5 days ago

thzmanExplorer

asked in Ingest

TimeXtender REST dynamic values - error on Sync

Hi!I’m doing some tests and trying to set up som e form of incremental load with this connector to an API endpoint. It works fine with the two static parameters but as soon as I add the parameter for lastSynchronizedRowVersion with its dynamic value I get an error with I run the Synchronize job.Is there something obvious that I have missed here?I tried to follow the article Connect to Fixer IO with the TimeXtender REST data source | CommunitySetup for the endpoint: Error message:

6 days ago

HansZZVStarter

asked in Ingest

Error when opening project on TX version 20.10.51.64

6 days ago

thzmanExplorer

asked in Ingest

TimeXtender REST data source doesn't update endpoint names

Hi!I have set up a REST connection in my Ingest instance to an API with multiple endpoints. The first time I misspelled two of the endpoint names, which I later changed. Then I noticed that the “old” names are still active in the ODX and does not get updated despite multiple refreshes (see attached screenshot). We have already done some work on some of the endpoints so I’m a bit reluctant to delete the whole connection and set it up again just to get these names updated. Is there some other way to fix this?

7 days ago

BennyContributor

asked in Ingest

Failed to read metadata from XmlDocument for endpoint X with transformation 'T' Input string was not in a correct format.

The sync of my ODX datasource returns the following error. The datasource is a REST API endpoint of the form URL/{foreign_ID}, where foreign_id is a dynamic value that comes from a different endpoint within the same data source. The option "Perform exhaustive meta data scan” is enabled. The error returned is this:Failed to read metadata from XmlDocument for endpoint X with transformation 'T'Input string was not in a correct format.There is no further information. The sync does work when I replace foreign_ID by a fixed value. The endpoint contains a field that has a lot of values that look like integers, but some values contain letters. Since the above error message is the most verbose info I’ve got, I assumed that's probably the cause. However this conflicts with my understanding of what an “exhaustive meta data scan” should do. Any help is appreciated.

8 days ago

danielTimeXtender Xpert

asked in Ingest

Connecting to Azure Active Directory (AAD)

Dear Community,I’m having some issues with connecting to the Azure Active Directory. We want to use this data for RLS and feed this from the DWH.I’ve set up the Active Directory Connector and put in credentials: After a minute or so I get an timeout. If I leave out the OAuth stuff I get an not authorized. What do I need to set up here to get the data from the AAD? Thanks!

15 days ago

danielTimeXtender Xpert

asked in Ingest

JSON connector only get 1st JSON file from Blob

Dear Comunity,I’ve got a blob folder which contains 10 JSON files. I’ve set everything up but it only gets 1 file (the first) from the blob. Also only 1 RSD files get created. Is there something in the connector that needs to change in order for the connector to get more then 1 file? Thanks in advance

15 days ago

Paul BridgeContributor

asked in Ingest

Jobs Not Running On Schedule

HiI have recently noticed a problem where some of my scheduled jobs do not run at their scheduled times. When digging about I noticed in the event viewer the following;Running the [TimeXtender Execution Server Configuration 6698.1] tool to unlink and relink the instances has not resolved the issue.Running the jobs manually work fine.Please advise on next steps

20 days ago

HansZZVStarter

asked in Ingest

Filter rows in ODX on multiple substrings

Hi I am trying to find a way to filter rows in ODX on multiple 'like’ expressions.Below the SQL statement i use in SQL Server Manager that i would like to implement;SELECT [autoid], [values]FROM TableAWHERE [autoid] > 61103544AND ([values] like '<N V="D%' or [values] like '<N V="VAS%')How can we achieve this in ODX so I can limit the amount of records retrieved from the source.Thanks in AdvanceHans

22 days ago

Roy VContributor

asked in Ingest

Error when processing data from odx to snowflake

Good afternoonWe are working on the migration to fully deploy to Snowflake. We created a sas token as described in the instruction (https://support.timextender.com/configure-resources-126/use-snowflake-data-warehouse-storage-727) and added the token in the ODX settings in the portal. However when we deploy and execute to Snowflake the deployment goes fine but when executing we get the following error:Failure using stage area. Cause: [This request is not authorized to perform this operation. (Status Code: 403; Error Code: AuthorizationFailure)]In Snowflake the user has enough priviliges but it is when running the stage that want to read from the data lake storage that this error occures.The storage account has enabled that you can read from it with keys so that should not be the issue.Any ideas on why Snowflake can not access the data lake?

22 days ago

Pieter-JanExplorer

asked in Ingest

loading odx project information hangs

Hi, if i start timextender the first thing doen is “loading odx project information” this hangs. my version is 20.10.46.64 already restarted whole server , didn’t make any difference

29 days ago

oscarcleveContributor

asked in Ingest

Error synchronizing TimeXtender Dynamics 365 Business Central - Online data source

I get the following error message when synchronizing a TimeXtender Dynamics 365 Business Central - Online data source: “System.AggregateException: Ett eller flera fel har uppstått. ---> System.ApplicationException: Invalid response from Business Central retrieving table Field for company “ Authorize OAuth as well as Test Connection is successful in TimeXtender desktop. It seems like the Tenant and the Environment parameters are correct as connection fails when I alter these parameters. I am able to authorize and connect regardless what I input in the fields in the Account section. I use the Service to Service authentication with Client ID and Client Secret from the Azure app registration. I use TimeXtender v. 6718.1 and ODX Service v. 6718.1. Any suggestions on what to try next?

1 month ago

woutersmikeExplorer

asked in Ingest

Data movement ODX -> DSA with mapping set

HiIt looks impossible to add a new field from the ODX onto the DSA, once you have added fields before. I’m not able to drag a new field (one of the grayed out fields) onto the table. Only solution seems to drop the existing mapping set and restart. Am I missing something? Situation as is:We are using TX-version is V21 Different agencies, all using the same ERP. Have created different ODX-sources for each agency. Created a mapping set to import data from ODX to DSA. Mapping set is a handy feature. Instead of dragging each data source individually, you can create a mapping set that will pull in all the tables with the same name and structure Problem seems to be that when you have created the mapping set, that you can’t change/add something afterwards. This can’t be the case I assume.In the example I have added 14 fields before. I now want to add (1) more but the application won’t let me drop it on the table (or mapping set). Thanks for your thoughts/solutions

1 month ago

lindaj.bekkerVisitor

asked in Ingest

Exception from HRESULT: 0xC020801C

Error creating DTS package Exception from HRESULT: 0xC020801C I can't deploy the data and can't syncronize the datasource. I am getting this error. Exception from HRESULT: 0xC020801C Please help

1 month ago

aftabpContributor

asked in Ingest

Notification on critical errors

I have together with a solutions- and security architect used your guide to try setting up notifications but we keep on getting an error when i hit the button Test NotificationThis is the guide we have usedSet up Notifications on Critical Errors from the ODX Instance | Community (timextender.com)The part below also in place according to this guideNotifications on Critical Errors – TimeXtender SupportIs there someting missing?

1 month ago

christian.koekenContributor

asked in Ingest

Incremental loading with APIs

Dear Support,My customer is using AFAS. From this tool they load data into TimeXtender with an API.They have a wish to load the data from AFAS incrementally in the ODX.Is it possible to load incrementally from an API to the ODX server and what are your suggestions to start with? Best regards,Christian Koeken

1 month ago

aftabpContributor

asked in Ingest

Data capture with multiple API-endpoints

Hi,Has anyone worked with API from Energinet?I need some help extracing data from Energinet. Energinet delivers data with multiple endpoints. It starts with https://www.energinet.net/api/unit which gives me this [ { "unit_id": "1234ABCDfolder", "name": "My Company", "links": { "info": { "verb": "GET", "href": "/api/unitinfo/1234ABCDfolder" }, "drilldown": { "verb": "GET", "href": "/api/unit/1234ABCDfolder" } }, "datasources": [] }]Now, i have to drill down to get some info: https://www.energinet.net/api/unit/1234ACDfolder[ { "unit_id": 1Afolder", "name": "Company1", "links": { "info": { "verb": "GET", "href": "/api/unitinfo/1Afolder" }, "drilldown": { "verb": "GET", "href": "/api/unit/1Afolder" } }, "dat

1 month ago

BennyContributor

asked in Ingest

Why do datatypes in the Raw table change with the Valid?

Hello,I have a question about the RAW tables in TimeXtender. I noticed that the data types of the fields in the RAW table change when I modify them in the tool. I was under the impression that RAW tables should keep the original data types from the source, since this would be “RAW”.I ran into trouble when loading transferring from the ODX. I changed the datatype of a field and even added a transformation that resulted in a CAST in the transformation view. However, I got an error message saying: The given value of type String from the data source cannot be converted to type float of the specified target column.This should not be, because the source contains only data that is/should be convertible to a float. The Raw table has no data, which I find strange. Changing the fields data type to float has also changed the datatype of the Raw table. I would expect the Raw table to always have the same datatype as the source and that the changing of datatypes is handled in the transformation vie

1 month ago

truttafiskerExplorer

asked in Ingest

Importing new data .. what to do ?

hi thereI need a little advise form you guys .. In the near future I need a new datasource but I’m not quite sure what the best approach is .. I’m going to have 600 inidivudal xml files which all contains different product data .. these will be updated daily or at minmum weekly.What would be the smartest way to import all these files into 1 table ?Should I make a parser or should I do something else ?

1 month ago

FenchContributor

asked in Ingest

Table in ODX doesn't populate despite Override Data Type

Hi,A csv table with the first approx. 23,000 rows containing only integers in the first column, doesn’t fully populate in the ODX because in row 23,000-somewhere this field contains text:“Error obtaining value ‘E04012’ for column ‘ArtikelNR’. Failed to convert to data type: ‘int’.”The data type has been set to override from ‘int’ to ‘Text’ = ‘varchar(max)’.TX version 6718.1. Thanks in advance for any suggestions.

2 months ago

Page 1 / 9

Badge winners

Roy Vhas earned the badge Prepare Expert
rvgfoxhas earned the badge Deliver Expert
rvgfoxhas earned the badge Prepare Expert
rvgfoxhas earned the badge Ingest Expert
KajEmergohas earned the badge Ingest Expert

Show all badges

Terms and Conditions Cookie settings

Sign up

Already have an account? Login

Login with SSO

SSO login

Username *

E-mail address *

Full Name

(Private)

Only you and moderators can see this information

TX Partner / Customer *

Company

(Private)

Only you and moderators can see this information

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Login with SSO

SSO login

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.