Skip to main content
To homepage To homepage

Ingest

Ask questions about Ingest Instances in TimeXtender Data Integration

  • 310 Topics
  • 1,632 Replies
310 Topics
hugo.winkelhorst
Participant
hugo.winkelhorstParticipant
asked in Ingest
Using a field from an ERP to use as a Parameter for a REST call

I need to be able to call an API using a reference number from the ERP system ( which is already in the ODX) as part of the URL. It looks like the Dynamic parameters as descibed on the old support site could work. However it is stated that this will only work in the old fashioned business unit. Is there a solution that would work in the ODX or would a Power Automate/Logic App be the only solution. 

692
Christian Hauggaard
Community Manager
vw-victa
Contributor
vw-victaContributor
asked in Ingest
Incorrect Job Repository: Expected 1 found 2, after downgrade

Hello,I'm working on a project (new license model) where we want to use the Azure Data Factory for Data Movement. I've installed the TX 6143.1 version but got the message “Data Factory source is out of date”. Looking at the release notes this version of TX doesn't support ADF Data Movement at the moment:“Warning: The new version does not support the data source providers that move data using Azure Data Factory (e.g. "Azure Data Factory - SQL Server (11.0.0.0) 64 bit").”I've decided to downgrade to TX version 6117 but I'm getting the message as shown below (screenshot). It looks like there is another Repository from both installations.How can I solve this and remove one of the repositories. I want to use the ADF Movement so the repository for version 6117 is needed.Thanks in advance!VinceVicta B.V.

1558
vw-victa
Contributor
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Ingest
Error validating data storage version. The version is empty

Hi, I am trying out the new TimeXtender version and just set up my environment. Now when I use a transfer task I receive the following error: System.AggregateException: One or more errors occurred. ---> System.Exception: Error validating data storage version. The version is empty   at DataStorageEngine.SQL.SQLHelper.GetDataStorageVersion(SqlCommand command)   at DataStorageEngine.SQL.SQLStorageEngine.ValidateStorage(SqlCommand command, Boolean tryTakeOwnership, Boolean throwIfInvalidOwner)   at DataStorageEngine.SQL.SQLStorageEngine.TransferData(IDataSourceEngine dataSourceEngine, ExecutionTaskModel taskModel, List`1 tableModels, Boolean forceFullLoad, SecurityExecutionModel securityExecutionModel)   at ExecutionEngine.Action.StandardAction.Execute()   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()   at System.Threading.Tasks.Task.Execute()   --- End of inner exception stack trace ------> (Inner Exception #0) System.Exception: Error validating data storage versio

812
sierd.zuiderveld
Contributor
J
Starter
johannmStarter
asked in Ingest
ODX cdata XML missing attribute

I'm reading XML files from a folder using cdata XML provider. This is working fine and using incremental loading also works. The issue I'm having is that there is an attribute defined in my rsd file that is not always present in the XML files. When ODX starts reading the folder and the first file it parses doesn't have this field it skips the field for all following files. Similarly if the first file does have the attribute all the rest is parsed ok. Is this a bug or is there a setting I'm not aware of? Or maybe a definition in rds that could help?

1336
Thomas Lind
Community Manager
S
Starter
sturla.winger.svendsenStarter
asked in Ingest
Change db compatibility_level

Hi, We are running on MS SQL Server 2019, but all of the DBs created from TX  are still on compatibility level 120. Will changing the compatibility_level impact the TX solution?   br,Sturla

291
S
Contributor
D
Visitor
dylan brabecVisitor
asked in Ingest
SAP ByDesign Connection suddenly stopped working

Hi Guys,  I had an ODX connection to a SAP ByDesign instance that suddenly stopped at the end of last week and spit out the below error log. I am looking for any ideas on the direction to go. From how I am reading the error, I am assuming its originating at the ByDesign end, and I need to find a location to whitelist DiscoveryHub. (doesn't explain why it was working then suddenly not working without any other changes).   Thanks for any help.     If you need assistance, please submit this with your ticket. Service request failed: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.IX: HTTP protocol error. 401 Unauthorized.at rds190C.ERZ.q(String , String , FR , ERk , String , Boolean , String )at rds190C.ERZ.o(Boolean )at rds190C.FZZ.K(WDn )at rds190C.WaZ.q(Wg , WDt )at rds190C.WaZ.A(Wg , Wan )--- End of

561
S
Contributor
D
Starter
dror.svartzmanStarter
asked in Ingest
Dynamically Import tables into ODX

Hi, My source database contains over 300 tables, from which only 30 are relevant for our purposes. Instead of manually searching and checking the required tables, Is it possible to define a list of objects of interest(text)  and let TX pick it from there? Kind regards, Dror Svartzman

756
Christian Hauggaard
Community Manager
M
Starter
mikkel.hansenStarter
asked in Ingest
How to read Excel files stored in Sharepoint 365

Hi   Does anyone know hos to extract data from excel files stored in a Sharepoint 365 library?

5447
Thomas Lind
Community Manager
S
Participant
satish.padarthiParticipant
asked in Ingest
Limiting data pull on ODX

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?  

454
daniel
TimeXtender Xpert
jon.catt
Explorer
jon.cattExplorer
asked in Ingest
Data Source management

Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.

445
fwagner
Employee
B
Starter
bernardo.dichiaraStarter
asked in Ingest
Connection to AWS RDS instance

Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara

402
B
Starter
D
Contributor
dan.beggsContributor
asked in Ingest
RSD file move to production

I have recently been experimenting with using .rsd files for REST API data sources.  I have generated the .rsd files and then modified them to add pagination.  I now have two questions: 1. What is the appropriate way to move these .rsd files to production? Just copy the files, to the production server? Or is there some way in integrate the movement with the TimeXtender transfer to production process? 2. When moving the .rsd files to production, how can we have them dynamically use the URI for the production data source instead of the dev data source?  If we just copy the files from dev to prod, the files will still contain the dev data source.  Do we have to manually change this, or is there a way to pass this source address using a variable? Thank you.

322
D
Contributor
A
Starter
agusteStarter
asked in Ingest
Cannot find the object after upgrade to 20.10.28 - "_FDS" tables

After the upgrade this error is raised for various (not all) tables when trying to execute from SQL Server source.  It includes some table names with the "_FDS" extension. I tried googling the _FDS but nothing comes up, neither in TxT documentation nor outside.  Anyone who can give me a clue on how to proceed?  Error example:"Cannot find the object "DIRPARTYTABLE_FDS" because it does not exist or you do not have permissions." I can solve this be re-deploying each table but of course that is a very sub-optimal choice :(

544
Thomas Lind
Community Manager
R
Explorer
roland.peetersExplorer
asked in Ingest
CDATA XML Connection with max records

We want to extract data from the CBS (NL) this is a dataset with minimal 100.000 records and the connections allows a maximum of 10.000 records. https://dataderden.cbs.nl/ODataFeed/odata/03759ned/TypedDataset.xmlIs there a possibility to make a connection that downloads each time a set of 10.000 till all records are downloaded. 

491
Thomas Lind
Community Manager
A
Visitor
aksel.spenceVisitor
asked in Ingest
Cannot start ODX Service on computer '.'

Hi, I am following the tutorial to set up a sandbox environment. However, I get an error message at the end of the configuration I get an error: Can anyone help me resolve this issue?

1215
N
Starter
K
Visitor
kamalVisitor
asked in Ingest
Timextender Co-existence and Value Add with Qlik QDI already installed

Customer is a large user of Qlik Sense and also has Qlik ODI installed. He wants to create a Datawarehouse for his varied core data and has asked me if Timextender will add value when Qlik ODI already. And will the value add be marginal or substantial.

241
Thomas Lind
Community Manager
R
Explorer
roland.peetersExplorer
asked in Ingest
Cdata Evernote

Has anyone experience which fieldsto fill to get the CDATA evernote connector working ? 

161
Thomas Lind
Community Manager
M
Contributor
martin.d.larssonContributor
asked in Ingest
Stop or kill running task in ODX

I would like to have the ability to stop a running task in the ODX server. Right now I have a task that is running and has timed out after 1h several times. I think I need to synchronize the data source and that would fix the issue, but I have no way of stopping the running task. So I have to wait for it to time out and let the synchronization be pending.

2122
M
Contributor
M
Contributor
martin.d.larssonContributor
asked in Ingest
ODX: The SMTP server does not support authentication

I am unable to set up notifications on critical errors in the ODX server. I get the following error message:My guess is that our SMTP server only accepts AD authentication. Is there a workaround?

863
M
Contributor
J
Starter
j.brancartStarter
asked in Ingest
Unable to get root/node value

Goodmorning,currently I am trying to extract data from a REST API. However the JSON response is structured oddly. In the image below you can see a sample, the numerical values (704, 1406, 1517) whcih represent userID's, aData represents a JSON Object.I am able to extract the aData data. However I am not able to get the corresponding numeric values, since they are not a key:value pair. I suspect I am doing something wrong with my JSONPath and/or xpath. Below is party of my RSD file (except the methods):<api:info title="data" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <!-- You can modify the name, type, and column size here. --> <attr name="_id"xs:type="integer"readonly="false" key="true"other:xPath="/_id"/> <attr name="ID"xs:type="string"readonly="false"other:xPath(".")/> <attr name="aData"xs:type="string"readonly="false"other:xPath="/*"/> <input name="fromdate"xs:type="string"default=""/> </api:info&gt

363
Thomas Lind
Community Manager
mnoordam
Contributor
mnoordamContributor
asked in Ingest
Error after last upgrade ODX/TX

ODX Server is running fine, but transfer en sync jobs fail.Error occurs when I 'Select Tables'.What to do?Error in command: 'Select Tables...'.Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated.at DataSourceEngine.Custom.CustomSourceEngine.IsDataSourceVersionValid(Version version)at DataSourceEngine.Custom.CustomSourceEngine.GetCustomDataSource()at DataSourceEngine.Custom.CustomSourceEngine.<GetSupportedFilterModeType>b__48_0()at DataSourceEngine.Custom.CustomSourceEngine.GetSupportedFilterModeType()Details:Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated. ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultExceptionat TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, ProjectInformation projectInformation, Func`3 func)at TimeXtender.ODX.Engine.DataSourceController`1.GetSuppo

843
Thomas Lind
Community Manager
A
Visitor
andrew.charltonVisitor
asked in Ingest
Cdata XML Connector

Hi I am trying retrieve data through an API using XMLI am getting the following error. The API requires I use a wildcard  to retrieve all values. My XML works if I use Postman / Swagger to test.Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Details:Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Uw.qM(String )at dvo200m.Uw.u(String , Int32 , Int32 , Boolean )at dvo200m.fZ.Na(String , Int32 , Int32 )at dvo200m.ZG.H(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.ZG.H(Int32 , Int32 , Int32 )at dvo200m.ZG.GetValue(Int32 , Int32 )at CData.Sql.ResultSetBase.GetValue(Int32 colIndex, Int32 dataType)at dvo200m.Zv.L(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Zv.L

604
JTreadwell
Employee
S
Visitor
sander.koekVisitor
asked in Ingest
warning: table folder used by another table

Hello,I'm relatively new to TX.I'm getting the following warning when trying to load tables from an external source:The table folder 'Y' is used by another table with the id xxxx.How do I fix this?

2181
JTreadwell
Employee
E
Visitor
emilVisitor
asked in Ingest
CData data provider and Bearer Authentication

Hi,  I was wondering if the CData data provider supports Bearer Authentication. The API request I'm trying to make is to a small 3rd party Application. Regards, Emil H

702
Thomas Lind
Community Manager
M
Starter
maarten.vanheur
asked in Ingest
Unable to update the provider. The provider is currently locked by the application.

hi  am trying to update my CData Datasource providers (Update available) but when i click on the update button, this is what i get: Unable to update the provider.The provider is currently locked by the application. Details: Unable to update the provider. ...Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.CDataComponentInstallHelper.UninstallComponent(DataSourceComponentModel dataSourceComponentModel, Boolean isUpdate)at TimeXtender.DataManager.ManageCDataDataSourceProvidersCommand.UninstallProvider(Form parentWindow, CDataComponentModelWrapper componentModelWrapper, Boolean isUpdate) Time: 2020-12-09 09:00:29UTC: 2020-12-09 08:00:29Title: CloudDWH - TimeXtender 20.10.6.64Application: 20.10.6.64Repository: 20.10.6.64 (in Azure)SQL Server: Microsoft SQL Azure (RTM) - 12.0.2000.8 Oct 1 2020 18:48:35 Copyright (C) 2019 Microsoft Corporation Any idea what is causing this and what to do to make it work? thanks! M

482
Thomas Lind
Community Manager

Badge winners

Show all badges
Terms and ConditionsCookie settings