Ingest

Hi   Does anyone know hos to extract data from excel files stored in a Sharepoint 365 library?

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?  

Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.

Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara

I have recently been experimenting with using .rsd files for REST API data sources.  I have generated the .rsd files and then modified them to add pagination.  I now have two questions: 1. What is the appropriate way to move these .rsd files to production? Just copy the files, to the production server? Or is there some way in integrate the movement with the TimeXtender transfer to production process? 2. When moving the .rsd files to production, how can we have them dynamically use the URI for the production data source instead of the dev data source?  If we just copy the files from dev to prod, the files will still contain the dev data source.  Do we have to manually change this, or is there a way to pass this source address using a variable? Thank you.

After the upgrade this error is raised for various (not all) tables when trying to execute from SQL Server source.  It includes some table names with the "_FDS" extension. I tried googling the _FDS but nothing comes up, neither in TxT documentation nor outside.  Anyone who can give me a clue on how to proceed?  Error example:"Cannot find the object "DIRPARTYTABLE_FDS" because it does not exist or you do not have permissions." I can solve this be re-deploying each table but of course that is a very sub-optimal choice :(

We want to extract data from the CBS (NL) this is a dataset with minimal 100.000 records and the connections allows a maximum of 10.000 records. https://dataderden.cbs.nl/ODataFeed/odata/03759ned/TypedDataset.xmlIs there a possibility to make a connection that downloads each time a set of 10.000 till all records are downloaded. 

Hi, I am following the tutorial to set up a sandbox environment. However, I get an error message at the end of the configuration I get an error: Can anyone help me resolve this issue?

Customer is a large user of Qlik Sense and also has Qlik ODI installed. He wants to create a Datawarehouse for his varied core data and has asked me if Timextender will add value when Qlik ODI already. And will the value add be marginal or substantial.

Has anyone experience which fieldsto fill to get the CDATA evernote connector working ? 

I would like to have the ability to stop a running task in the ODX server. Right now I have a task that is running and has timed out after 1h several times. I think I need to synchronize the data source and that would fix the issue, but I have no way of stopping the running task. So I have to wait for it to time out and let the synchronization be pending.

I am unable to set up notifications on critical errors in the ODX server. I get the following error message:My guess is that our SMTP server only accepts AD authentication. Is there a workaround?

Goodmorning,currently I am trying to extract data from a REST API. However the JSON response is structured oddly. In the image below you can see a sample, the numerical values (704, 1406, 1517) whcih represent userID's, aData represents a JSON Object.I am able to extract the aData data. However I am not able to get the corresponding numeric values, since they are not a key:value pair. I suspect I am doing something wrong with my JSONPath and/or xpath. Below is party of my RSD file (except the methods):<api:info title="data" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <!-- You can modify the name, type, and column size here. --> <attr name="_id"xs:type="integer"readonly="false" key="true"other:xPath="/_id"/> <attr name="ID"xs:type="string"readonly="false"other:xPath(".")/> <attr name="aData"xs:type="string"readonly="false"other:xPath="/*"/> <input name="fromdate"xs:type="string"default=""/> </api:info&gt

ODX Server is running fine, but transfer en sync jobs fail.Error occurs when I 'Select Tables'.What to do?Error in command: 'Select Tables...'.Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated.at DataSourceEngine.Custom.CustomSourceEngine.IsDataSourceVersionValid(Version version)at DataSourceEngine.Custom.CustomSourceEngine.GetCustomDataSource()at DataSourceEngine.Custom.CustomSourceEngine.<GetSupportedFilterModeType>b__48_0()at DataSourceEngine.Custom.CustomSourceEngine.GetSupportedFilterModeType()Details:Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated. ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultExceptionat TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, ProjectInformation projectInformation, Func`3 func)at TimeXtender.ODX.Engine.DataSourceController`1.GetSuppo

Hi I am trying retrieve data through an API using XMLI am getting the following error. The API requires I use a wildcard  to retrieve all values. My XML works if I use Postman / Swagger to test.Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Details:Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Uw.qM(String )at dvo200m.Uw.u(String , Int32 , Int32 , Boolean )at dvo200m.fZ.Na(String , Int32 , Int32 )at dvo200m.ZG.H(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.ZG.H(Int32 , Int32 , Int32 )at dvo200m.ZG.GetValue(Int32 , Int32 )at CData.Sql.ResultSetBase.GetValue(Int32 colIndex, Int32 dataType)at dvo200m.Zv.L(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Zv.L

Hello,I'm relatively new to TX.I'm getting the following warning when trying to load tables from an external source:The table folder 'Y' is used by another table with the id xxxx.How do I fix this?

Hi,  I was wondering if the CData data provider supports Bearer Authentication. The API request I'm trying to make is to a small 3rd party Application. Regards, Emil H

hi  am trying to update my CData Datasource providers (Update available) but when i click on the update button, this is what i get: Unable to update the provider.The provider is currently locked by the application. Details: Unable to update the provider. ...Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.CDataComponentInstallHelper.UninstallComponent(DataSourceComponentModel dataSourceComponentModel, Boolean isUpdate)at TimeXtender.DataManager.ManageCDataDataSourceProvidersCommand.UninstallProvider(Form parentWindow, CDataComponentModelWrapper componentModelWrapper, Boolean isUpdate) Time: 2020-12-09 09:00:29UTC: 2020-12-09 08:00:29Title: CloudDWH - TimeXtender 20.10.6.64Application: 20.10.6.64Repository: 20.10.6.64 (in Azure)SQL Server: Microsoft SQL Azure (RTM) - 12.0.2000.8 Oct 1 2020 18:48:35 Copyright (C) 2019 Microsoft Corporation Any idea what is causing this and what to do to make it work? thanks! M

Currently, we are rendering an error when we want to do a Transfer task for with the ODX server. We are trying to read an PxPlus data source via an ODBC driver, TimeXtender correctly shows all available tables and columns, and synchronizing also seems to work fine. However, when we try to transfer the data the following error is returned:The source does allow any schema's, and it seems that TimeXtender nevertheless tries to envoke a query with a schema (I think the error is returned because of the []. before the tablename). We have tried some things in the Query formatting and Character Replacement, but we can't get it to work properly. TimeXtender version: 20.10.1.64ODX Server version 20.10.1

Hi I am trying to connect to Zendesk using the Cdata connector.I am getting the following error. Does anyone have this working. 'Initiate OAuth' does not have a  'REFRESH' option it only has NONE and GETANDREFRESHDetails:When using OAuth the 'Initiate OAuth' setting must be set to 'REFRESH'Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.DataSource_CData.CreateConnection()at TimeXtender.DataManager.DataSource_CData.TestConnection()at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy)When using OAuth the 'Initiate OAuth' setting must be set to 'REFRESH'Module: timeXtenderTimeXtender.DataManager.ExceptionWrapperExceptionat TimeXtender.DataManager.ConnectingThread.HandleError()at TimeXtender.DataManager.ConnectingThread.Execute(String title, Int32 progressSteps, List`1 actions)at TimeXtender.DataManager.ConnectingThread.ExecuteFastAction(String title, Action action, IWin32Window parentForm, CancelBehaviors cancelBehavior, ErrorBehaviors errorBehavi

We are trying to get a csv file of 10 gb into TimeXtender but it takes very long for TimeXtender to get this loaded and sometimes we are getting an error (system out of memory). Is there a solution or something else we can try to get big csv files into TimeXtener or can we change the CSV file to get it loaded into TimeXtender? We are now using the Cdata adapter and already used the multiple/single file adapter.   Thanks for the response!

Hi, Is it possible to extract data from an Azure Service Bus into TX?

Hi, Is there any development on creating a connector to upload data to Google Storage Bucket or Google BigQuery?My bestAlfreð

I'm currently migrating an Azure MI solution to ADLS Gen2 and Synapse Analytics. The migration includes remapping all DSA table ... instead of using an old ODX, DSA will now use an ADLS Gen2 on ODX Server. Mapping tables bring all data source fields across ... it would be nice to have the usual option to only synchronize existing fields as it's a lot of fields to delete when getting the entire data source table.

When I am using the Single text file and I am loading a csv file, TX replaces and removes the file to the Backup folder as specified. The filename before load:  E:\BAG\CoordinatenBAG2019.csv And the filename after loading:  E:\BAG\CoordinatenBAG2019__20191105_163142_ Now I have to rename the file every time i want to do a reload. How can I prevent this?