To homepage To homepage

- - Knowledge base overview
Product Updates
Training
Portal
For Partners
TimeXtender Classic

Home
Community overview
TimeXtender Desktop Q&A
Ingest

Ingest

Ask questions about Ingest Instances in TimeXtender Data Integration

253 Topics
1,360 Replies

When you subscribe we will email you when there is a new topic in this category

253 Topics

mikkel.hansenStarter

How to read Excel files stored in Sharepoint 365

Hi Does anyone know hos to extract data from excel files stored in a Sharepoint 365 library?

5147

1 year ago

satish.padarthiParticipant

asked in Ingest

Limiting data pull on ODX

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?

414

1 year ago

jon.cattExplorer

asked in Ingest

Data Source management

Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.

395

2 years ago

bernardo.dichiaraStarter

asked in Ingest

Connection to AWS RDS instance

Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara

272

2 years ago

dan.beggsContributor

asked in Ingest

RSD file move to production

I have recently been experimenting with using .rsd files for REST API data sources. I have generated the .rsd files and then modified them to add pagination. I now have two questions: 1. What is the appropriate way to move these .rsd files to production? Just copy the files, to the production server? Or is there some way in integrate the movement with the TimeXtender transfer to production process? 2. When moving the .rsd files to production, how can we have them dynamically use the URI for the production data source instead of the dev data source? If we just copy the files from dev to prod, the files will still contain the dev data source. Do we have to manually change this, or is there a way to pass this source address using a variable? Thank you.

272

2 years ago

agusteStarter

asked in Ingest

Cannot find the object after upgrade to 20.10.28 - "_FDS" tables

After the upgrade this error is raised for various (not all) tables when trying to execute from SQL Server source. It includes some table names with the "_FDS" extension. I tried googling the _FDS but nothing comes up, neither in TxT documentation nor outside. Anyone who can give me a clue on how to proceed? Error example:"Cannot find the object "DIRPARTYTABLE_FDS" because it does not exist or you do not have permissions." I can solve this be re-deploying each table but of course that is a very sub-optimal choice :(

444

2 years ago

roland.peetersExplorer

asked in Ingest

CDATA XML Connection with max records

We want to extract data from the CBS (NL) this is a dataset with minimal 100.000 records and the connections allows a maximum of 10.000 records. https://dataderden.cbs.nl/ODataFeed/odata/03759ned/TypedDataset.xmlIs there a possibility to make a connection that downloads each time a set of 10.000 till all records are downloaded.

481

2 years ago

aksel.spenceVisitor

asked in Ingest

Cannot start ODX Service on computer '.'

Hi, I am following the tutorial to set up a sandbox environment. However, I get an error message at the end of the configuration I get an error: Can anyone help me resolve this issue?

1025

2 years ago

kamalVisitor

asked in Ingest

Timextender Co-existence and Value Add with Qlik QDI already installed

Customer is a large user of Qlik Sense and also has Qlik ODI installed. He wants to create a Datawarehouse for his varied core data and has asked me if Timextender will add value when Qlik ODI already. And will the value add be marginal or substantial.

201

3 years ago

roland.peetersExplorer

asked in Ingest

Cdata Evernote

Has anyone experience which fieldsto fill to get the CDATA evernote connector working ?

151

3 years ago

martin.d.larssonContributor

asked in Ingest

Stop or kill running task in ODX

I would like to have the ability to stop a running task in the ODX server. Right now I have a task that is running and has timed out after 1h several times. I think I need to synchronize the data source and that would fix the issue, but I have no way of stopping the running task. So I have to wait for it to time out and let the synchronization be pending.

1762

3 years ago

martin.d.larssonContributor

asked in Ingest

ODX: The SMTP server does not support authentication

I am unable to set up notifications on critical errors in the ODX server. I get the following error message:My guess is that our SMTP server only accepts AD authentication. Is there a workaround?

763

3 years ago

j.brancartStarter

asked in Ingest

Unable to get root/node value

Goodmorning,currently I am trying to extract data from a REST API. However the JSON response is structured oddly. In the image below you can see a sample, the numerical values (704, 1406, 1517) whcih represent userID's, aData represents a JSON Object.I am able to extract the aData data. However I am not able to get the corresponding numeric values, since they are not a key:value pair. I suspect I am doing something wrong with my JSONPath and/or xpath. Below is party of my RSD file (except the methods):<api:info title="data" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1">  <attr name="_id"xs:type="integer"readonly="false" key="true"other:xPath="/_id"/> <attr name="ID"xs:type="string"readonly="false"other:xPath(".")/> <attr name="aData"xs:type="string"readonly="false"other:xPath="/*"/> <input name="fromdate"xs:type="string"default=""/> </api:info&gt

343

3 years ago

mnoordamContributor

asked in Ingest

Error after last upgrade ODX/TX

ODX Server is running fine, but transfer en sync jobs fail.Error occurs when I 'Select Tables'.What to do?Error in command: 'Select Tables...'.Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated.at DataSourceEngine.Custom.CustomSourceEngine.IsDataSourceVersionValid(Version version)at DataSourceEngine.Custom.CustomSourceEngine.GetCustomDataSource()at DataSourceEngine.Custom.CustomSourceEngine.<GetSupportedFilterModeType>b__48_0()at DataSourceEngine.Custom.CustomSourceEngine.GetSupportedFilterModeType()Details:Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated. ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultExceptionat TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, ProjectInformation projectInformation, Func`3 func)at TimeXtender.ODX.Engine.DataSourceController`1.GetSuppo

623

3 years ago

andrew.charltonVisitor

asked in Ingest

Cdata XML Connector

Hi I am trying retrieve data through an API using XMLI am getting the following error. The API requires I use a wildcard to retrieve all values. My XML works if I use Postman / Swagger to test.Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Details:Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Uw.qM(String )at dvo200m.Uw.u(String , Int32 , Int32 , Boolean )at dvo200m.fZ.Na(String , Int32 , Int32 )at dvo200m.ZG.H(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.ZG.H(Int32 , Int32 , Int32 )at dvo200m.ZG.GetValue(Int32 , Int32 )at CData.Sql.ResultSetBase.GetValue(Int32 colIndex, Int32 dataType)at dvo200m.Zv.L(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Zv.L

524

3 years ago

sander.koekVisitor

asked in Ingest

warning: table folder used by another table

Hello,I'm relatively new to TX.I'm getting the following warning when trying to load tables from an external source:The table folder 'Y' is used by another table with the id xxxx.How do I fix this?

2061

3 years ago

emilVisitor

asked in Ingest

CData data provider and Bearer Authentication

Hi, I was wondering if the CData data provider supports Bearer Authentication. The API request I'm trying to make is to a small 3rd party Application. Regards, Emil H

Unable to update the provider. The provider is currently locked by the application.

hi am trying to update my CData Datasource providers (Update available) but when i click on the update button, this is what i get: Unable to update the provider.The provider is currently locked by the application. Details: Unable to update the provider. ...Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.CDataComponentInstallHelper.UninstallComponent(DataSourceComponentModel dataSourceComponentModel, Boolean isUpdate)at TimeXtender.DataManager.ManageCDataDataSourceProvidersCommand.UninstallProvider(Form parentWindow, CDataComponentModelWrapper componentModelWrapper, Boolean isUpdate) Time: 2020-12-09 09:00:29UTC: 2020-12-09 08:00:29Title: CloudDWH - TimeXtender 20.10.6.64Application: 20.10.6.64Repository: 20.10.6.64 (in Azure)SQL Server: Microsoft SQL Azure (RTM) - 12.0.2000.8 Oct 1 2020 18:48:35 Copyright (C) 2019 Microsoft Corporation Any idea what is causing this and what to do to make it work? thanks! M

472

3 years ago

ben.vd.helmStarter

asked in Ingest

Transfer Task error ODX server

Currently, we are rendering an error when we want to do a Transfer task for with the ODX server. We are trying to read an PxPlus data source via an ODBC driver, TimeXtender correctly shows all available tables and columns, and synchronizing also seems to work fine. However, when we try to transfer the data the following error is returned:The source does allow any schema's, and it seems that TimeXtender nevertheless tries to envoke a query with a schema (I think the error is returned because of the []. before the tablename). We have tried some things in the Query formatting and Character Replacement, but we can't get it to work properly. TimeXtender version: 20.10.1.64ODX Server version 20.10.1

441

4 years ago

andrew.charltonVisitor

asked in Ingest

Cdata connector for Zendesk

Hi I am trying to connect to Zendesk using the Cdata connector.I am getting the following error. Does anyone have this working. 'Initiate OAuth' does not have a 'REFRESH' option it only has NONE and GETANDREFRESHDetails:When using OAuth the 'Initiate OAuth' setting must be set to 'REFRESH'Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.DataSource_CData.CreateConnection()at TimeXtender.DataManager.DataSource_CData.TestConnection()at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy)When using OAuth the 'Initiate OAuth' setting must be set to 'REFRESH'Module: timeXtenderTimeXtender.DataManager.ExceptionWrapperExceptionat TimeXtender.DataManager.ConnectingThread.HandleError()at TimeXtender.DataManager.ConnectingThread.Execute(String title, Int32 progressSteps, List`1 actions)at TimeXtender.DataManager.ConnectingThread.ExecuteFastAction(String title, Action action, IWin32Window parentForm, CancelBehaviors cancelBehavior, ErrorBehaviors errorBehavi

201

4 years ago

r.brummansStarter

asked in Ingest

Cdata adapter - CSV File 10(GB)

We are trying to get a csv file of 10 gb into TimeXtender but it takes very long for TimeXtender to get this loaded and sometimes we are getting an error (system out of memory). Is there a solution or something else we can try to get big csv files into TimeXtener or can we change the CSV file to get it loaded into TimeXtender? We are now using the Cdata adapter and already used the multiple/single file adapter. Thanks for the response!

333

4 years ago

bunyamin.ozkilicVisitor

asked in Ingest

Extracting from Azure Service Bus

Hi, Is it possible to extract data from an Azure Service Bus into TX?

371

4 years ago

alfred.kristinssonStarter

asked in Ingest

Google Cloud Platform

Hi, Is there any development on creating a connector to upload data to Google Storage Bucket or Google BigQuery?My bestAlfreð

765

4 years ago

Søren SørensenContributor

asked in Ingest

Synchronized data mapping from ODX Server

I'm currently migrating an Azure MI solution to ADLS Gen2 and Synapse Analytics. The migration includes remapping all DSA table ... instead of using an old ODX, DSA will now use an ADLS Gen2 on ODX Server. Mapping tables bring all data source fields across ... it would be nice to have the usual option to only synchronize existing fields as it's a lot of fields to delete when getting the entire data source table.

1052

4 years ago

stefan.timmermanStarter

asked in Ingest

csv filename changed after load

When I am using the Single text file and I am loading a csv file, TX replaces and removes the file to the Backup folder as specified. The filename before load: E:\BAG\CoordinatenBAG2019.csv And the filename after loading: E:\BAG\CoordinatenBAG2019__20191105_163142_ Now I have to rename the file every time i want to do a reload. How can I prevent this?

162

5 years ago

Page 10 / 11

Badge winners

Dikshahas earned the badge Certified Solutions Architect
brett.taylorhas earned the badge Certified Solutions Architect
RobvdBrinkhas earned the badge Certified Solutions Architect
aftabphas earned the badge Ingest Expert
Leo Rogemanhas earned the badge Certified Solutions Architect

Show all badges

Terms and Conditions Cookie settings

Sign up

Already have an account? Login

Login with SSO

SSO login

Username *

E-mail address *

Full Name

(Private)

Only you and moderators can see this information

TX Partner / Customer *

Company

(Private)

Only you and moderators can see this information

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Login with SSO

SSO login

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.