Ingest

Hello,I'm working on a project (new license model) where we want to use the Azure Data Factory for Data Movement. I've installed the TX 6143.1 version but got the message “Data Factory source is out of date”. Looking at the release notes this version of TX doesn't support ADF Data Movement at the moment:“Warning: The new version does not support the data source providers that move data using Azure Data Factory (e.g. "Azure Data Factory - SQL Server (11.0.0.0) 64 bit").”I've decided to downgrade to TX version 6117 but I'm getting the message as shown below (screenshot). It looks like there is another Repository from both installations.How can I solve this and remove one of the repositories. I want to use the ADF Movement so the repository for version 6117 is needed.Thanks in advance!VinceVicta B.V.

Hi, I am trying out the new TimeXtender version and just set up my environment. Now when I use a transfer task I receive the following error: System.AggregateException: One or more errors occurred. ---> System.Exception: Error validating data storage version. The version is empty   at DataStorageEngine.SQL.SQLHelper.GetDataStorageVersion(SqlCommand command)   at DataStorageEngine.SQL.SQLStorageEngine.ValidateStorage(SqlCommand command, Boolean tryTakeOwnership, Boolean throwIfInvalidOwner)   at DataStorageEngine.SQL.SQLStorageEngine.TransferData(IDataSourceEngine dataSourceEngine, ExecutionTaskModel taskModel, List`1 tableModels, Boolean forceFullLoad, SecurityExecutionModel securityExecutionModel)   at ExecutionEngine.Action.StandardAction.Execute()   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()   at System.Threading.Tasks.Task.Execute()   --- End of inner exception stack trace ------> (Inner Exception #0) System.Exception: Error validating data storage versio

I'm reading XML files from a folder using cdata XML provider. This is working fine and using incremental loading also works. The issue I'm having is that there is an attribute defined in my rsd file that is not always present in the XML files. When ODX starts reading the folder and the first file it parses doesn't have this field it skips the field for all following files. Similarly if the first file does have the attribute all the rest is parsed ok. Is this a bug or is there a setting I'm not aware of? Or maybe a definition in rds that could help?

Hi, We are running on MS SQL Server 2019, but all of the DBs created from TX  are still on compatibility level 120. Will changing the compatibility_level impact the TX solution?   br,Sturla

Hi Guys,  I had an ODX connection to a SAP ByDesign instance that suddenly stopped at the end of last week and spit out the below error log. I am looking for any ideas on the direction to go. From how I am reading the error, I am assuming its originating at the ByDesign end, and I need to find a location to whitelist DiscoveryHub. (doesn't explain why it was working then suddenly not working without any other changes).   Thanks for any help.     If you need assistance, please submit this with your ticket. Service request failed: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.IX: HTTP protocol error. 401 Unauthorized.at rds190C.ERZ.q(String , String , FR , ERk , String , Boolean , String )at rds190C.ERZ.o(Boolean )at rds190C.FZZ.K(WDn )at rds190C.WaZ.q(Wg , WDt )at rds190C.WaZ.A(Wg , Wan )--- End of

Hi, My source database contains over 300 tables, from which only 30 are relevant for our purposes. Instead of manually searching and checking the required tables, Is it possible to define a list of objects of interest(text)  and let TX pick it from there? Kind regards, Dror Svartzman

Hi   Does anyone know hos to extract data from excel files stored in a Sharepoint 365 library?

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?  

Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.

Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara

I have recently been experimenting with using .rsd files for REST API data sources.  I have generated the .rsd files and then modified them to add pagination.  I now have two questions: 1. What is the appropriate way to move these .rsd files to production? Just copy the files, to the production server? Or is there some way in integrate the movement with the TimeXtender transfer to production process? 2. When moving the .rsd files to production, how can we have them dynamically use the URI for the production data source instead of the dev data source?  If we just copy the files from dev to prod, the files will still contain the dev data source.  Do we have to manually change this, or is there a way to pass this source address using a variable? Thank you.

After the upgrade this error is raised for various (not all) tables when trying to execute from SQL Server source.  It includes some table names with the "_FDS" extension. I tried googling the _FDS but nothing comes up, neither in TxT documentation nor outside.  Anyone who can give me a clue on how to proceed?  Error example:"Cannot find the object "DIRPARTYTABLE_FDS" because it does not exist or you do not have permissions." I can solve this be re-deploying each table but of course that is a very sub-optimal choice :(

We want to extract data from the CBS (NL) this is a dataset with minimal 100.000 records and the connections allows a maximum of 10.000 records. https://dataderden.cbs.nl/ODataFeed/odata/03759ned/TypedDataset.xmlIs there a possibility to make a connection that downloads each time a set of 10.000 till all records are downloaded. 

Hi, I am following the tutorial to set up a sandbox environment. However, I get an error message at the end of the configuration I get an error: Can anyone help me resolve this issue?

Customer is a large user of Qlik Sense and also has Qlik ODI installed. He wants to create a Datawarehouse for his varied core data and has asked me if Timextender will add value when Qlik ODI already. And will the value add be marginal or substantial.

Has anyone experience which fieldsto fill to get the CDATA evernote connector working ? 

I would like to have the ability to stop a running task in the ODX server. Right now I have a task that is running and has timed out after 1h several times. I think I need to synchronize the data source and that would fix the issue, but I have no way of stopping the running task. So I have to wait for it to time out and let the synchronization be pending.

I am unable to set up notifications on critical errors in the ODX server. I get the following error message:My guess is that our SMTP server only accepts AD authentication. Is there a workaround?

Goodmorning,currently I am trying to extract data from a REST API. However the JSON response is structured oddly. In the image below you can see a sample, the numerical values (704, 1406, 1517) whcih represent userID's, aData represents a JSON Object.I am able to extract the aData data. However I am not able to get the corresponding numeric values, since they are not a key:value pair. I suspect I am doing something wrong with my JSONPath and/or xpath. Below is party of my RSD file (except the methods):<api:info title="data" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <!-- You can modify the name, type, and column size here. --> <attr name="_id"xs:type="integer"readonly="false" key="true"other:xPath="/_id"/> <attr name="ID"xs:type="string"readonly="false"other:xPath(".")/> <attr name="aData"xs:type="string"readonly="false"other:xPath="/*"/> <input name="fromdate"xs:type="string"default=""/> </api:info&gt

ODX Server is running fine, but transfer en sync jobs fail.Error occurs when I 'Select Tables'.What to do?Error in command: 'Select Tables...'.Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated.at DataSourceEngine.Custom.CustomSourceEngine.IsDataSourceVersionValid(Version version)at DataSourceEngine.Custom.CustomSourceEngine.GetCustomDataSource()at DataSourceEngine.Custom.CustomSourceEngine.<GetSupportedFilterModeType>b__48_0()at DataSourceEngine.Custom.CustomSourceEngine.GetSupportedFilterModeType()Details:Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated. ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultExceptionat TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, ProjectInformation projectInformation, Func`3 func)at TimeXtender.ODX.Engine.DataSourceController`1.GetSuppo

Hi I am trying retrieve data through an API using XMLI am getting the following error. The API requires I use a wildcard  to retrieve all values. My XML works if I use Postman / Swagger to test.Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Details:Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Uw.qM(String )at dvo200m.Uw.u(String , Int32 , Int32 , Boolean )at dvo200m.fZ.Na(String , Int32 , Int32 )at dvo200m.ZG.H(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.ZG.H(Int32 , Int32 , Int32 )at dvo200m.ZG.GetValue(Int32 , Int32 )at CData.Sql.ResultSetBase.GetValue(Int32 colIndex, Int32 dataType)at dvo200m.Zv.L(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Zv.L

Hello,I'm relatively new to TX.I'm getting the following warning when trying to load tables from an external source:The table folder 'Y' is used by another table with the id xxxx.How do I fix this?

Hi,  I was wondering if the CData data provider supports Bearer Authentication. The API request I'm trying to make is to a small 3rd party Application. Regards, Emil H

hi  am trying to update my CData Datasource providers (Update available) but when i click on the update button, this is what i get: Unable to update the provider.The provider is currently locked by the application. Details: Unable to update the provider. ...Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.CDataComponentInstallHelper.UninstallComponent(DataSourceComponentModel dataSourceComponentModel, Boolean isUpdate)at TimeXtender.DataManager.ManageCDataDataSourceProvidersCommand.UninstallProvider(Form parentWindow, CDataComponentModelWrapper componentModelWrapper, Boolean isUpdate) Time: 2020-12-09 09:00:29UTC: 2020-12-09 08:00:29Title: CloudDWH - TimeXtender 20.10.6.64Application: 20.10.6.64Repository: 20.10.6.64 (in Azure)SQL Server: Microsoft SQL Azure (RTM) - 12.0.2000.8 Oct 1 2020 18:48:35 Copyright (C) 2019 Microsoft Corporation Any idea what is causing this and what to do to make it work? thanks! M

Currently, we are rendering an error when we want to do a Transfer task for with the ODX server. We are trying to read an PxPlus data source via an ODBC driver, TimeXtender correctly shows all available tables and columns, and synchronizing also seems to work fine. However, when we try to transfer the data the following error is returned:The source does allow any schema's, and it seems that TimeXtender nevertheless tries to envoke a query with a schema (I think the error is returned because of the []. before the tablename). We have tried some things in the Query formatting and Character Replacement, but we can't get it to work properly. TimeXtender version: 20.10.1.64ODX Server version 20.10.1