Skip to main content

Ingest

Ask questions about Ingest Instances in TimeXtender Data Integration

  • 213 Topics
  • 1,163 Replies
213 Topics
B
Participant
BennyParticipant
asked in Ingest
Failed to read metadata from XmlDocument for endpoint X with transformation 'T' Input string was not in a correct format.

The sync of my ODX datasource returns the following error.  The datasource is a REST API endpoint of the form URL/{foreign_ID}, where foreign_id is a dynamic value that comes from a different endpoint within the same data source. The option "Perform exhaustive meta data scan” is enabled. The error returned is this:Failed to read metadata from XmlDocument for endpoint X with transformation 'T'Input string was not in a correct format.There is no further information.  The sync does work when I replace foreign_ID by a fixed value.  The endpoint contains a field that has a lot of values that look like integers, but some values contain letters. Since the above error message is the most verbose info I’ve got, I assumed that's probably the cause. However this conflicts with my understanding of what an “exhaustive meta data scan” should do.  Any help is appreciated. 

5
B
Participant
5 hours ago
P
Explorer
Pieter-JanExplorer
asked in Ingest
loading odx project information hangs

Hi, if i start timextender the first thing doen is “loading odx project information” this hangs. my version is 20.10.46.64 already restarted whole server , didn’t make any difference

3
Bernarddb
Problem Solver
12 hours ago
R
Explorer
Remy Kamphuis | VictaExplorer
asked in Ingest
Error BC365 connection after testing connection

Hi support,Following this ticket I will make one myself to keep things clear. We have set up a Business Central 365 connection, both via OAuth2.0 as service to service authentication. We have succesfully tested the connection with both authentication options. However, when we want to read objects, we receive the error “Invalid response from Business Central retrieving table Field for company”. Full log is added to this ticket as an attachment. We have walked through all steps from the prerequisites guide. Hence, we have a succesful connection. From the other ticket I understand that there are more versions of the Jet Analytics for Business Central extension. It has to be the newest one and I have to keep on trying. In the Extension Marketplace we only find two versions of the Jet Analytics for Business Central extension. The first from Jet Global Data Technologies is not available anymore and they point to the second; the one from insightsoftware. This is the one we have installed; ver

0
R
Explorer
3 days ago
oscarcleve
Contributor
oscarcleveContributor
asked in Ingest
Error synchronizing TimeXtender Dynamics 365 Business Central - Online data source

I get the following error message when synchronizing a TimeXtender Dynamics 365 Business Central - Online data source: “System.AggregateException: Ett eller flera fel har uppstått. ---> System.ApplicationException: Invalid response from Business Central retrieving table Field for company “ Authorize OAuth as well as Test Connection is successful in TimeXtender desktop. It seems like the Tenant and the Environment parameters are correct as connection fails when I alter these parameters. I am able to authorize and connect regardless what I input in the fields in the Account section. I use the Service to Service authentication with Client ID and Client Secret from the Azure app registration. I use TimeXtender v. 6718.1 and ODX Service v. 6718.1. Any suggestions on what to try next? 

9
R
Explorer
3 days ago
W
Explorer
woutersmikeExplorer
asked in Ingest
Data movement ODX -> DSA with mapping set

HiIt looks impossible to add a new field from the ODX onto the DSA, once you have added fields before. I’m not able to drag a new field (one of the grayed out fields) onto the table. Only solution seems to drop the existing mapping set and restart. Am I missing something? Situation as is:We are using TX-version is V21 Different agencies, all using the same ERP. Have created different ODX-sources for each agency. Created a mapping set to import data from ODX to DSA. Mapping set is a handy feature. Instead of dragging each data source individually, you can create a mapping set that will pull in all the tables with the same name and structure Problem seems to be that when you have created the mapping set, that you can’t change/add something afterwards. This can’t be the case I assume.In the example I have added 14 fields before. I now want to add (1) more but the application won’t let me drop it on the table (or mapping set).  Thanks for your thoughts/solutions

2
Christian Hauggaard
Community Manager
6 days ago
L
Visitor
lindaj.bekkerVisitor
asked in Ingest
Exception from HRESULT: 0xC020801C

Error creating DTS package Exception from HRESULT: 0xC020801C I can't deploy the data and can't syncronize the datasource. I am getting this error. Exception from HRESULT: 0xC020801C Please help

3
B
Starter
11 days ago
A
Contributor
aftabpContributor
asked in Ingest
Notification on critical errors

I have together with a solutions- and security architect used your guide to try setting up notifications but we keep on getting an error when i hit the button Test NotificationThis is the guide we have usedSet up Notifications on Critical Errors from the ODX Instance | Community (timextender.com)The part below also in place according to this guideNotifications on Critical Errors – TimeXtender SupportIs there someting missing?

3
A
Contributor
14 days ago
christian.koeken
Contributor
christian.koekenContributor
asked in Ingest
Incremental loading with APIs

Dear Support,My customer is using AFAS. From this tool they load data into TimeXtender with an API.They have a wish to load the data from AFAS incrementally in the ODX.Is it possible to load incrementally from an API to the ODX server and what are your suggestions to start with? Best regards,Christian Koeken

15
Thomas Lind
Community Manager
18 days ago
A
Contributor
aftabpContributor
asked in Ingest
Data capture with multiple API-endpoints

Hi,Has anyone worked with API from Energinet?I need some help extracing data from Energinet. Energinet delivers data with multiple endpoints. It starts with https://www.energinet.net/api/unit which gives me this [ { "unit_id": "1234ABCDfolder", "name": "My Company", "links": { "info": { "verb": "GET", "href": "/api/unitinfo/1234ABCDfolder" }, "drilldown": { "verb": "GET", "href": "/api/unit/1234ABCDfolder" } }, "datasources": [] }]Now, i have to drill down to get some info: https://www.energinet.net/api/unit/1234ACDfolder[ { "unit_id": 1Afolder", "name": "Company1", "links": { "info": { "verb": "GET", "href": "/api/unitinfo/1Afolder" }, "drilldown": { "verb": "GET", "href": "/api/unit/1Afolder" } }, "dat

18
A
Contributor
25 days ago
B
Participant
BennyParticipant
asked in Ingest
Why do datatypes in the Raw table change with the Valid?

Hello,I have a question about the RAW tables in TimeXtender. I noticed that the data types of the fields in the RAW table change when I modify them in the tool. I was under the impression that RAW tables should keep the original data types from the source, since this would be “RAW”.I ran into trouble when loading transferring from the ODX. I changed the datatype of a field and even added a transformation that resulted in a CAST in the transformation view. However, I got an error message saying: The given value of type String from the data source cannot be converted to type float of the specified target column.This should not be, because the source contains only data that is/should be convertible to a float. The Raw table has no data, which I find strange. Changing the fields data type to float has also changed the datatype of the Raw table. I would expect the Raw table to always have the same datatype as the source and that the changing of datatypes is handled in the transformation vie

2
Christian Hauggaard
Community Manager
28 days ago
T
Explorer
truttafiskerExplorer
asked in Ingest
Importing new data .. what to do ?

hi thereI need a little advise form you guys .. In the near future I need a new datasource but I’m not quite sure what the best approach is .. I’m going to have 600 inidivudal xml files which all contains different product data .. these will be updated daily or at minmum weekly.What would be the smartest way to import all these files into 1 table ?Should I make a parser or should I do something else ?

6
T
Explorer
28 days ago
F
Starter
FenchStarter
asked in Ingest
Table in ODX doesn't populate despite Override Data Type

Hi,A csv table with the first approx. 23,000 rows containing only integers in the first column, doesn’t fully populate in the ODX because in row 23,000-somewhere this field contains text:“Error obtaining value ‘E04012’ for column ‘ArtikelNR’. Failed to convert to data type: ‘int’.”The data type has been set to override from ‘int’ to ‘Text’ = ‘varchar(max)’.TX version 6718.1. Thanks in advance for any suggestions.

9
F
Starter
1 month ago
P
Contributor
Paul BridgeContributor
asked in Ingest
ODX Notifications Configured and Tested Successfully But Fail to Receive Email With Failure

HiI have set up ‘notifications on critical errors’ in ODX and can test successfully by clicking the [Test Notification] button. However, when I attempt to fail an ODX job on purpose to test it works (by purposefully using incorrect credentials to connect to the data source) the ODX job fails but I do not receive an email.If I receive a test notification email by clicking the [Test Notification] can I assume the mail server is correctly configured?Or is it that a set of incorrect credentials for the data source is NOT considered ‘critical’?Or could it be something else?ODX: 6675.2TX: 6698.1

4
P
Contributor
1 month ago
D
Contributor
dpjatContributor
asked in Ingest
Error: Data source mappings failed validation prior to odx data source update

Hi everyone, Trying to environment transfer but getting below error. Any idea's? 

6
D
Contributor
1 month ago
boyclaesen
Contributor
boyclaesenContributor
asked in Ingest
CSV provider fails after upgrade to 24.0.8963.0

Hello TX Team, I just updated the data source version in the portal. After the update the data of one of the sources was gone. Even though I can sync and get data.  If I test the connection in the portal I get this error: Exception has been thrown by the target of an invocation.In the desktop I am seeing a test table and not the tables from the blob. I am running the latest TX Version: 6698.1 and the latest ODX version: 6675.2 Two data sources are connected to the ODX (both csv files from a blob storage) Can someone please help or advise on the issue? Each time I update something in TX my flow breaks.  Thank you in advance. Kind Regards, Boy

7
boyclaesen
Contributor
1 month ago
avanrijn
Participant
avanrijnParticipant
asked in Ingest
The expected ODX instance id does not match the active ODX instance id....

Dear Sir,When I open my TX Client (6698.1) I have an error when opening my ODX instance.Even started from scratch a few times. New environment, new instance ODX and DWH.Going back to my TX client, try to open my just new created ODX instance and then I have this message: The expected instance id does not match the active instance id.…We can not use TimeXtender in our FourPoints tenant to assit our clients, please help.Error details:Service request failed: The expected instance id bd8b16fe-91e6-4142-bcdb-414d37613dd9 does not match the active instance id c1989d3e-4ed6-4f48-a8a4-4d880a2b257a (ODX.Model.Exceptions.ProjectIdException)Details:Service request failed: The expected instance id bd8b16fe-91e6-4142-bcdb-414d37613dd9 does not match the active instance id c1989d3e-4ed6-4f48-a8a4-4d880a2b257a (ODX.Model.Exceptions.ProjectIdException)Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException   at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C](WcfServerSettings ser

2
avanrijn
Participant
1 month ago
L
Visitor
linda.monincxVisitor
asked in Ingest
how to activate ssl on postgresql cdataconnection

Hi,I have a postgresql cd connector which works well with SSL set to false, we activated a self signed SSL certificate on the database server side, but connecting with tx setting ssl to true is not workingthe owner of the database mentioned i should accept the certificate but from TX there is no prompt to accept the SSL certificate, how do I need to proceed? Do we need to install anything on our end (tx server), it should not as it is a self signed certificate. Thanks your help!Linda Monincx

2
Christian Hauggaard
Community Manager
1 month ago
avanrijn
Participant
avanrijnParticipant
asked in Ingest
ODX Dev sources are different then ODX Prod sources

Dear Sir,We are migrating TimeXtender to the latest and the greatest Our client is using the old school Business Units for there ODX Data Sources.Development data sources are different then Production data sources.So our client wants to have the same ODX setup in their new version of TimeXtender (6675.2).So I need to setup 2 ODX servers for this right ? One for DEV and one for PROD.If that is true, I need two Window servers to install two ODX servers. One for DEV and one for PROD.Question:Or can I install/run two ODX servers on just one Window server ?Client is going to use TimeXtender ODX Server 6675.2Hope this makes any sense. Regards,Arthur

6
Christian Hauggaard
Community Manager
1 month ago
M
Explorer
MvestExplorer
asked in Ingest
TX freezes when opening the ODX

Hello,We recently updated our TX and ODX to version 6675.2. Things were working fine until yesterday. Now whenever we open the ODX inside TX, the whole program freezes (image 1). It does not seem to be related to our VM. I have tried giving myself and the ODX service account more permissions on the C:\ProgramData\TimeXtender (sub)folders but that did not help.The only fix so far seems to be restarting the TimeXtender_ODX_Service_6675.2 in Windows Services. This is also not always without issue (image 2).   

9
Christian Hauggaard
Community Manager
2 months ago
K
Contributor
KajEmergoContributor
asked in Ingest
Service Principal access to (DWH) Azure SQL db with ADF

Hi,One of the latest features is that we can use Azure Entra ID Service Principals in order for TX to authenticate with DWH storage such as Azure SQL db. Last week I tried to use this but encountered this issue when deploying one of the data areas:  We will use ADF for data transfer from ODX (data lake) to DWH. Is this by design and will this be made possible in the future? The version of the TX implementation is 6675.2

1
Christian Hauggaard
Community Manager
2 months ago
R
Participant
RobertUParticipant
asked in Ingest
Keep data source connections in sync in 6675.2

We have 30 companies with each their own BC installation. So right now we have 30 data source connection. I created one data source connection with all the table and fields that we need. After that i cloned that one. I created all the mapping sets, so for now i have the right setup for all the companies. But now comes the problem. What if i want to added a new table and columns to all the companies. Do i need to do that on all the 30 companies? When i want to clone them again i get the message that the name already exists. Is there any way to do this easily without having to delete everything again and clone each time.

1
rory.smith
TimeXtender Xpert
2 months ago
M
Explorer
MarcodenijsExplorer
asked in Ingest
Source in ODX Shows no error.

Because of another unrelated issue, I have discovered that the service account does not have acces to a certain folder where my source files are in. However, if I go to edit data source → Test Connection. It says it is connected successfully. If I go to the query tool to check my source, I get an error. Acces denied. And if run the sync/transfer tasks, I get a warning saying:The view [CSV].[AggregatedFiles] has no columns.The view is ignored And if I run this source in a job, from an Execution. I get no error/warning at all. How is this supposed to work?  

2
M
Explorer
2 months ago
wouter.goslinga
TimeXtender Xpert
wouter.goslingaTimeXtender Xpert
asked in Ingest
Connecting to Salesforce with TimeXtender SAAS

Does anyone have any experience with or a tutorial for extracting Salesforce data with TX SAAS? I'm trying to connect to Salesforce, getting a succesful connection message but when I synchronize the datasource, the sync task is successful but no table is shown: 

4
Christian Hauggaard
Community Manager
2 months ago
A
Contributor
aftabpContributor
asked in Ingest
Type String from the data source cannot be converted to type nvarchar

I am banging my head against the wall for this one for some while now. I would appriciate some help.Here is the RSD-file<api:script xmlns:api="http://apiscript.com/ns?v1" xmlns:xs="http://www.w3.org/2001/XMLSchema"> <!-- See Column Definitions to specify column behavior and use XPaths to extract column values from JSON. --> <api:info title="data" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <!-- You can modify the name, type, and column size here. --> <attr name="bildeLinke" xs:type="string" readonly="false" other:xPath="/json/data/bildeLinke" /> <attr name="bygning" xs:type="string" readonly="false" other:xPath="/json/data/bygning" /> <attr name="bygningsId" xs:type="string" readonly="false" other:xPath="/json/data/bygningsId" /> <attr name="del"

11
A
Contributor
2 months ago
V
Participant
VictorParticipant
asked in Ingest
OneLake source

Hello,TimeXtender: 20.10.31.64ODX:  20.10.31We have a case where a customer has to move from SQL database to a OneLake Parquet as the data extraction from one of their systems. We need to find a way to get this data into TimeXtender.I could find that there is the possibility for one lake parquet connector, but it seems tied to the new version of TX as I can’t find that connector in our version of tx/odx. Is there any possibility for us to do it another way while on our version? Thank you,Victor 

4
rory.smith
TimeXtender Xpert
2 months ago

Badge winners

  • Data Warehouse Expert
    Bernarddbhas earned the badge Data Warehouse Expert
  • Certified Solutions Architect
    gfredheihas earned the badge Certified Solutions Architect
  • Innovator
    Bennyhas earned the badge Innovator
  • Certified Solutions Architect
    Roy Vhas earned the badge Certified Solutions Architect
  • ODX Expert
    ignaciohas earned the badge ODX Expert
Show all badges
Terms and ConditionsCookie settings