To homepage To homepage

- - Knowledge base overview
Product Updates
Training
Portal
For Partners
TimeXtender Classic

Home
Community overview
TimeXtender Desktop Q&A
Ingest

Ingest

Ask questions about Ingest Instances in TimeXtender Data Integration

237 Topics
1,273 Replies

When you subscribe we will email you when there is a new topic in this category

237 Topics

Recently active

Most replies Most views Newest first

hugo.winkelhorstParticipant

asked in Ingest

Amazon Redshift Connector SSL mode drop down missing options

For one of our clients I need to connect to a database on Amazon Redshift. The IT Vendor who made the system is telling us to use SSL mode Required ( https://docs.aws.amazon.com/redshift/latest/mgmt/connecting-ssl-support.html#connect-using-ssl ). Using this setting in the ODBC connector from Amazon itself works fine but the CData connector only gives a true false dropdown. I've checked if this perhaps was one of those fields where you can overrule the drop down with manual input but that's not the case for this one. Is there any way to get this working in the CData connector or would our only option for now by create DSN and then use the ADO ODBC option the the ODX to connect with the DSN.

1077

1 year ago

hugo.winkelhorstParticipant

asked in Ingest

Using a field from an ERP to use as a Parameter for a REST call

I need to be able to call an API using a reference number from the ERP system ( which is already in the ODX) as part of the URL. It looks like the Dynamic parameters as descibed on the old support site could work. However it is stated that this will only work in the old fashioned business unit. Is there a solution that would work in the ODX or would a Power Automate/Logic App be the only solution.

622

1 year ago

vw-victaContributor

asked in Ingest

Incorrect Job Repository: Expected 1 found 2, after downgrade

Hello,I'm working on a project (new license model) where we want to use the Azure Data Factory for Data Movement. I've installed the TX 6143.1 version but got the message “Data Factory source is out of date”. Looking at the release notes this version of TX doesn't support ADF Data Movement at the moment:“Warning: The new version does not support the data source providers that move data using Azure Data Factory (e.g. "Azure Data Factory - SQL Server (11.0.0.0) 64 bit").”I've decided to downgrade to TX version 6117 but I'm getting the message as shown below (screenshot). It looks like there is another Repository from both installations.How can I solve this and remove one of the repositories. I want to use the ADF Movement so the repository for version 6117 is needed.Thanks in advance!VinceVicta B.V.

1528

1 year ago

sierd.zuiderveldContributor

asked in Ingest

Error validating data storage version. The version is empty

Hi, I am trying out the new TimeXtender version and just set up my environment. Now when I use a transfer task I receive the following error: System.AggregateException: One or more errors occurred. ---> System.Exception: Error validating data storage version. The version is empty at DataStorageEngine.SQL.SQLHelper.GetDataStorageVersion(SqlCommand command) at DataStorageEngine.SQL.SQLStorageEngine.ValidateStorage(SqlCommand command, Boolean tryTakeOwnership, Boolean throwIfInvalidOwner) at DataStorageEngine.SQL.SQLStorageEngine.TransferData(IDataSourceEngine dataSourceEngine, ExecutionTaskModel taskModel, List`1 tableModels, Boolean forceFullLoad, SecurityExecutionModel securityExecutionModel) at ExecutionEngine.Action.StandardAction.Execute() at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0() at System.Threading.Tasks.Task.Execute() --- End of inner exception stack trace ------> (Inner Exception #0) System.Exception: Error validating data storage versio

752

1 year ago

johannmStarter

asked in Ingest

ODX cdata XML missing attribute

I'm reading XML files from a folder using cdata XML provider. This is working fine and using incremental loading also works. The issue I'm having is that there is an attribute defined in my rsd file that is not always present in the XML files. When ODX starts reading the folder and the first file it parses doesn't have this field it skips the field for all following files. Similarly if the first file does have the attribute all the rest is parsed ok. Is this a bug or is there a setting I'm not aware of? Or maybe a definition in rds that could help?

1196

1 year ago

sturla.winger.svendsenStarter

asked in Ingest

Change db compatibility_level

Hi, We are running on MS SQL Server 2019, but all of the DBs created from TX are still on compatibility level 120. Will changing the compatibility_level impact the TX solution? br,Sturla

211

1 year ago

dylan brabecVisitor

asked in Ingest

SAP ByDesign Connection suddenly stopped working

Hi Guys, I had an ODX connection to a SAP ByDesign instance that suddenly stopped at the end of last week and spit out the below error log. I am looking for any ideas on the direction to go. From how I am reading the error, I am assuming its originating at the ByDesign end, and I need to find a location to whitelist DiscoveryHub. (doesn't explain why it was working then suddenly not working without any other changes). Thanks for any help. If you need assistance, please submit this with your ticket. Service request failed: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.IX: HTTP protocol error. 401 Unauthorized.at rds190C.ERZ.q(String , String , FR , ERk , String , Boolean , String )at rds190C.ERZ.o(Boolean )at rds190C.FZZ.K(WDn )at rds190C.WaZ.q(Wg , WDt )at rds190C.WaZ.A(Wg , Wan )--- End of

461

1 year ago

dror.svartzmanStarter

asked in Ingest

Dynamically Import tables into ODX

Hi, My source database contains over 300 tables, from which only 30 are relevant for our purposes. Instead of manually searching and checking the required tables, Is it possible to define a list of objects of interest(text) and let TX pick it from there? Kind regards, Dror Svartzman

666

1 year ago

mikkel.hansenStarter

asked in Ingest

How to read Excel files stored in Sharepoint 365

Hi Does anyone know hos to extract data from excel files stored in a Sharepoint 365 library?

5107

1 year ago

satish.padarthiParticipant

asked in Ingest

Limiting data pull on ODX

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?

404

1 year ago

mnoordamContributor

asked in Ingest

Error after last upgrade ODX/TX

ODX Server is running fine, but transfer en sync jobs fail.Error occurs when I 'Select Tables'.What to do?Error in command: 'Select Tables...'.Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated.at DataSourceEngine.Custom.CustomSourceEngine.IsDataSourceVersionValid(Version version)at DataSourceEngine.Custom.CustomSourceEngine.GetCustomDataSource()at DataSourceEngine.Custom.CustomSourceEngine.<GetSupportedFilterModeType>b__48_0()at DataSourceEngine.Custom.CustomSourceEngine.GetSupportedFilterModeType()Details:Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated. ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultExceptionat TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, ProjectInformation projectInformation, Func`3 func)at TimeXtender.ODX.Engine.DataSourceController`1.GetSuppo

623

3 years ago

agusteStarter

asked in Ingest

Cannot find the object after upgrade to 20.10.28 - "_FDS" tables

After the upgrade this error is raised for various (not all) tables when trying to execute from SQL Server source. It includes some table names with the "_FDS" extension. I tried googling the _FDS but nothing comes up, neither in TxT documentation nor outside. Anyone who can give me a clue on how to proceed? Error example:"Cannot find the object "DIRPARTYTABLE_FDS" because it does not exist or you do not have permissions." I can solve this be re-deploying each table but of course that is a very sub-optimal choice :(

434

2 years ago

jon.cattExplorer

asked in Ingest

Data Source management

Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.

395

2 years ago

bernardo.dichiaraStarter

asked in Ingest

Connection to AWS RDS instance

Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara

262

2 years ago

anders.bengtssonStarter

asked in Ingest

Soap 1.2 Request from ODX - is it possible?

Hi,Have anyone succeeded with a Soap 1.2 call from ODX?We have a source that only have a Soap interface. I've done a lot of testing but so far very little success.For the moment it complains about my content-type header. Don't know why. I'm using the rest connector. Perhaps I should use a xml connector instead. If anyone could share a working example I would be more than happy. Perhaps it's not possible at all. I'm not sure. RegardsAnders Bengtsson

662

2 years ago

alfred.kristinssonStarter

asked in Ingest

Google Cloud Platform

Hi, Is there any development on creating a connector to upload data to Google Storage Bucket or Google BigQuery?My bestAlfreð

765

4 years ago

Søren SørensenContributor

asked in Ingest

Synchronized data mapping from ODX Server

I'm currently migrating an Azure MI solution to ADLS Gen2 and Synapse Analytics. The migration includes remapping all DSA table ... instead of using an old ODX, DSA will now use an ADLS Gen2 on ODX Server. Mapping tables bring all data source fields across ... it would be nice to have the usual option to only synchronize existing fields as it's a lot of fields to delete when getting the entire data source table.

1022

4 years ago

bunyamin.ozkilicVisitor

asked in Ingest

Extracting from Azure Service Bus

Hi, Is it possible to extract data from an Azure Service Bus into TX?

361

4 years ago

r.brummansStarter

asked in Ingest

Cdata adapter - CSV File 10(GB)

We are trying to get a csv file of 10 gb into TimeXtender but it takes very long for TimeXtender to get this loaded and sometimes we are getting an error (system out of memory). Is there a solution or something else we can try to get big csv files into TimeXtener or can we change the CSV file to get it loaded into TimeXtender? We are now using the Cdata adapter and already used the multiple/single file adapter. Thanks for the response!

333

4 years ago

andrew.charltonVisitor

asked in Ingest

Cdata connector for Zendesk

Hi I am trying to connect to Zendesk using the Cdata connector.I am getting the following error. Does anyone have this working. 'Initiate OAuth' does not have a 'REFRESH' option it only has NONE and GETANDREFRESHDetails:When using OAuth the 'Initiate OAuth' setting must be set to 'REFRESH'Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.DataSource_CData.CreateConnection()at TimeXtender.DataManager.DataSource_CData.TestConnection()at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy)When using OAuth the 'Initiate OAuth' setting must be set to 'REFRESH'Module: timeXtenderTimeXtender.DataManager.ExceptionWrapperExceptionat TimeXtender.DataManager.ConnectingThread.HandleError()at TimeXtender.DataManager.ConnectingThread.Execute(String title, Int32 progressSteps, List`1 actions)at TimeXtender.DataManager.ConnectingThread.ExecuteFastAction(String title, Action action, IWin32Window parentForm, CancelBehaviors cancelBehavior, ErrorBehaviors errorBehavi

191

4 years ago

andrew.charltonVisitor

asked in Ingest

Cdata XML Connector

Hi I am trying retrieve data through an API using XMLI am getting the following error. The API requires I use a wildcard to retrieve all values. My XML works if I use Postman / Swagger to test.Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Details:Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Uw.qM(String )at dvo200m.Uw.u(String , Int32 , Int32 , Boolean )at dvo200m.fZ.Na(String , Int32 , Int32 )at dvo200m.ZG.H(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.ZG.H(Int32 , Int32 , Int32 )at dvo200m.ZG.GetValue(Int32 , Int32 )at CData.Sql.ResultSetBase.GetValue(Int32 colIndex, Int32 dataType)at dvo200m.Zv.L(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Zv.L

Unable to update the provider. The provider is currently locked by the application.

hi am trying to update my CData Datasource providers (Update available) but when i click on the update button, this is what i get: Unable to update the provider.The provider is currently locked by the application. Details: Unable to update the provider. ...Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.CDataComponentInstallHelper.UninstallComponent(DataSourceComponentModel dataSourceComponentModel, Boolean isUpdate)at TimeXtender.DataManager.ManageCDataDataSourceProvidersCommand.UninstallProvider(Form parentWindow, CDataComponentModelWrapper componentModelWrapper, Boolean isUpdate) Time: 2020-12-09 09:00:29UTC: 2020-12-09 08:00:29Title: CloudDWH - TimeXtender 20.10.6.64Application: 20.10.6.64Repository: 20.10.6.64 (in Azure)SQL Server: Microsoft SQL Azure (RTM) - 12.0.2000.8 Oct 1 2020 18:48:35 Copyright (C) 2019 Microsoft Corporation Any idea what is causing this and what to do to make it work? thanks! M

452

3 years ago

ben.vd.helmStarter

asked in Ingest

Transfer Task error ODX server

Currently, we are rendering an error when we want to do a Transfer task for with the ODX server. We are trying to read an PxPlus data source via an ODBC driver, TimeXtender correctly shows all available tables and columns, and synchronizing also seems to work fine. However, when we try to transfer the data the following error is returned:The source does allow any schema's, and it seems that TimeXtender nevertheless tries to envoke a query with a schema (I think the error is returned because of the []. before the tablename). We have tried some things in the Query formatting and Character Replacement, but we can't get it to work properly. TimeXtender version: 20.10.1.64ODX Server version 20.10.1

431

3 years ago

martin.d.larssonContributor

asked in Ingest

ODX: The SMTP server does not support authentication

I am unable to set up notifications on critical errors in the ODX server. I get the following error message:My guess is that our SMTP server only accepts AD authentication. Is there a workaround?

743

3 years ago

emilVisitor

asked in Ingest

CData data provider and Bearer Authentication

Hi, I was wondering if the CData data provider supports Bearer Authentication. The API request I'm trying to make is to a small 3rd party Application. Regards, Emil H

562

3 years ago

Page 9 / 10

Badge winners

pkaustubhahas earned the badge Certified Solutions Architect
avanrijnhas earned the badge Ingest Expert
danielhas earned the badge Deliver Expert
p.ruijterhas earned the badge Jobs & Executions Expert
lstegmeierhas earned the badge Certified Solutions Architect

Show all badges

Terms and Conditions Cookie settings

Sign up

Already have an account? Login

Login with SSO

SSO login

Username *

E-mail address *

Full Name

(Private)

Only you and moderators can see this information

TX Partner / Customer *

Company

(Private)

Only you and moderators can see this information

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Login with SSO

SSO login

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.