Data Sources Q&A

We were able to get this CSV file data source stored in an Azure Data Lake Gen2 storage container to work, but thought it may be useful to share, as we found that that the setup worked best when we were careful not to enter any other settings, but instead just entered those settings that were needed and described below. Source File: CSV.Storage Location:  Azure Data Lake Gen2 storage containerAuthentication Method: App Registration added to the storage container via a role assignment of "Storage Blob Data Contributor". Started by adding a new data source and chose the following:On the data source details page, entered the information for the 9 items outlined below, being careful not to enter information in any other boxes and just updating the necessary items. Item #1 will already be set to CSV based on the initial selection above, so that does not need to be updated. The following numbers correspond to the red boxes in the screenshot below.  Provider Name: This should be CSV based on

Hello,I am trying to extract data from azure AD. I am at the point where I can get data using the microsoft Graph API, and have it loaded into Timextender.The issue I am facing has to do with pagination. Microsoft graph API returns an url containing information of the next 'page’ of data. According to documentation I should adjust my RSD file as follows:  <api:set attr="DataModel" value="DOCUMENT" />  <api:set attr="URI" value="https://graph.microsoft.com/v1.0/groups" />     <api:set attr="EnablePaging" value="true" />  <api:set attr="pageurlpath" value="/json/@odata.nextLink" />  <api:set attr="RepeatElement" value="/json/value/" />This does not however loop over the pages, but still only gives me a top 100 of groups. I have a feeling maybe I need to escape either the @ or the . in the pageurlpath. Or am I missing something more obvious? Kind regards,Rutger

Hi,  I am wondering if it is at all possible to use data stored in a TimeXtender table as variables in a REST API call. I have two use cases that hopefully explain what I am trying to achieve A combination of two REST API's where one requires the output of the other: The first one retrieves all possible classes that can be attended, the second one retrieves all people enrolled in such a class. But the class name is a parameter in the header. I'd like to store the class names in a table and then loop through them (not sure if that's the way to go) and request all enrolled students. A Machine Learning functionIn, for example, Azure Machine Learning Studio I am able to host a model using a REST API. Then, I can call the model and by inserting the parameter values I receive a predicted value. I'd like to do this in the data warehouse since it saves time compared to requesting it every time a dashboard reloads. But again, I'd need to input values from a TimeXtender table.  Is there a recomm

Hi all,I need to pass multiple custom headers in a RSD file:Host: xxxxx.cloud.xxxxx.com Authorization: Bearer dfdflejlflefdjeljfeoj Content-Length: 26Is this the correct way to do this? <api:set attr="Header:Name#1" value="Authorization" /> <api:set attr="Header:Value#1" value="Bearer dfdflejlflefdjeljfeoj" /> <api:set attr="Header:Name#2" value="Host" /> <api:set attr="Header:Value#2" value="xxxxx.cloud.xxxxx.com" /> <api:set attr="Header:Name#3" value="Content-Length" /> <api:set attr="Header:Value#3" value="26" />Greets, Rogier

We have a project perspective called 'Reference' which contains ODX tables. When we are executing it through the execution package it is throwing an error  but when we try executing manually it is executing successfully.the file format which we are extracting is  XLSX. can you please help us to resolve this issue.

Is it possible to connect to ActiveMQ (https://activemq.apache.org) queue (as a source)?I use c# client app to fetch the data from the queue and was wondering if it is possible to use TimeXtender instead. 

I have a setup of a TimeXtender 20.10.40.64, ODX, ADL, ADF, Self hosted IR which I get to work just fine. I need to extract data from an IFS10 source, Oracle database, and it works until syncing then it seems to start an endless loop and never finish or gives an error. In TX I havesetup a new data source, Azure Data Factory - Oracle included all connection info information In Select tables I click “Search” and get all the tables available in the Oracle DB I Include a couple a tables Setup a transfer task Syncing starts running and I can see in ADF that is is running but it never receives any data from the data sourceI have tested from a SQL data source with ADF and it works just fine, both sync and transferI have in ADF tested to preview tables in the dataset created by TX and I can preview tables from Oracle DB just fine. I have even tried to create my own pipeline in ADF to copy data from the same data source to the same sink that TX created and it works just fine. It creates a parqu

Hi,Is it possible to connect to several databases that are on the same SQL server with one data source connection?We have tried to connect to multiple databases on the same SQL Server using the provider “TimeXtender SQL Data Source 17.0.1.0”.We tried leaving the Database parameter blank, putting in *, and writing a comma-separated list of databases, but neither way works. Has anyone had any success doing this with this connector or another?We’re using version 6221.1.Thanks!

I have an Excel sheet with percentages (11 decimals). The decimal sign is comma. See example below.Year    Period    CostPercentage2020    1    0,018001882020    2    0,016852519But when I read the data in TX then I see the below result:   I have tried to use the culture feature see below but no success. Find a screen dump belowWhy does TX / Cdata not read the data as is? The “,” is interpreted as a Thousand separator.Any help will be appreciated.When I have a file with a “.” (dot) as a decimal sign I convert the data to numeric precision 38,scale 11 and that works. 

Hi,I am using a REST API (CData source) to get source data. Is it possible to specify that you want to do a POST rather than GET in a CData source?If so is there any Guide? 

Hello, I am currently trying to integrate Exact data using the TX Exact Online connector. I need to integrate data from a bunch of different divisions; I was wondering if the only way to do so was to individually add each division as a new data source or if there was another way ? 

Hello everyone,After the odx transfer task for API, when I click on the preview, I get the “invalid column name” error. This warning also occurs while executing in the data warehouse and stops execute.  What should I do? I wanted to use aliases but I have 575 columns.I tried to re-deploy the table with differential deployment disabled.  Version: 6143.1 My column name example is below: it is very long‘properties_parameter_WS10M_RANGE_202109’ ThanksBest Regards

Dear community, Reach out to this community due to an issue with a JSON datasource connector.The situation:TimeXtender on premise (v20.10.40) using a Cdata ADO.net Provider for JSON 2021 (21.0.8011.0) in the Business Unit layer of the project. The connector uses a general account-password access for this datasource.User 1 logs on to the server TimeXtender is running on, does read data for this connector and got all the information expected.User 2 logs on to the server TimeXtender is running on, does read data and get just some information but not even related to this source. No error.Both users use the same connector with that general account to connect to this JSON datasource, but with different results.I asked for logfiles with verbosity = 3 of both users and attached are anonymized files. I am not sure how to interpret the differences in the logs.The log with the wrong results starts with a time out but playing around with this kind of setting does not change the outcome. Also some

Hi community,One of our customers want to report on NACE Code (see: https://nacev2.com/en). We are trying to find a (free/open) data source to map customers to the correct NACE Code.We do have the Dutch KVK/registration number and the EU VAT Number. Using one of these identifiers, we want to map the correct NACE Code.Does anyone have experience with this? 

Hi Support,Our client is using ETL Agile v20. They want to connect to Infor's datalake. Infor provide us with their Compass JDBC driver. Is it possible to import a JDBC driver into Jet to connect to their datalake? Are JDBC's supported with ETL Agile or will this be possible at all in a future release? Many thanks,Kashif

Hi all,When using the latest version of the CData Excel Online connector for extracting files from Sharepoint, we get a rather useless message after hitting the button ‘Authorize OAuth’. We are using the OAuth Grant Type ‘CODE’, meaning that we are only going to see the files that the account we are authenticating with can see on Sharepoint. The message we get after authenticating is like this: The message does not tell us what permissions we are missing, the account does have access to Sharepoint. However, it does not have access to the Graph Explorer. What kind of permissions do we need when authenticating this provider with a user account? Does it purely depend on the user account or does the App Registration require permissions as well? If so, which ones?

Is there any information on when/if the Cdata connector for Microsoft Dataverse will be available in timextender

I have a SQL Server Database that I have access to using my credentials, but need to set it up using a service account (AD Account). I have tested that this account has access to the SQL Server using the provided username/password in Power BI Desktop.Here are some screenshot of what I’m experiencing.Changed Authentication to AD Password Authentication:Changed the Encrypt connection option: It seems like the username is not transfered to the server…We are using TX 20.10.38.64TIA

Hi, We are trying to connect to a REST api and are using the JSON CData provider version 22.0.8257.0.We are connecting to two seperate datasources:Companies within Europe; Companies outside of EuropeThe problem with the second datasource is that the decimal seperator is mixed up.We tried some of the culture settings but it doesn’t seem to work.What is the best way to solve this?

Dear support,Historically, my customer is using several dozens of CData CSV or Excel file data sources.They have setup all those sources as Global Databases. Now they have to refactor file paths in all environments. Last Friday we were investigating if it was possible to retrieve the CDATA connection strings to those files by querying the repo but without success. For standard TX file data sources, it's possible to retrieve XML properties from GlobalDatabase tables but for CDATA (see picture 1), there is no obvious link to a CDataDataSourceID and even if we succeed to make this link, the connection string in the CDataDataSources table is hashed (see picture 2). Any possibility to decrypt this string or is the CData configuration stored somewhere else? Also nothing about CData connection string when we generate the project documentation =(

I have been trying for quite a while to connect to an REST endpoint requiring authentication. Have gone through the the cdata documentation and various ressources on the support site.I have working setups both in postman and SSIS Script Task, but is very keen on migrating to a more native TX setup (maintainability), will be migratning several more in the time to come.The process is as follows:Get Authentication Token (HTTP POST) The POSTed information is send as ‘x-www-form-urlencoded’ in the body part (Postman) The response is a json object, containing the token in a attribute Get Actual Data using the Authentication Token (HTTP GET with token as a url parameter)The source in this case i ArcGIS, and the documentation does not mention anything about a standardised authentication scheme.Is there a way around implementing this in any of the standardised authentication schemes, or do I need to go in the direction of RSD files?Please adviceThanks in advance.

I am loading a table from an Oracle source with the ODX. When I load the table without an incremental selection rule, the table loads fine. But when I add an incremental rule on a datetime column (change date column in the source table) I get the error:ORA-01861: literal does not match format stringDoes the ODX server pass the correct where clause to the Oracle DB for the incremental load? Or am I doing something wrong?Any help greatly appreciated!

Hi to all,In order to improve performance of data loading from Netsuite , we were advised to use Netsuite ODBC provided connetor and use Suiteanalytics. I have download the odbc connector provided by Netsuite, and installed it on the Timextender VM, i get an succesful connection in connecting to NS, using ODBC-test connection. However i cannot acess the odbc driver in Timextender ODX, so how do i do that. Keeping in mind that the Netsuite CData connector uses Rest-calls with limits 1000 records.. so that is not feasable. thank you in advance  Peter  

Hello,I’m using the CData ADO.NET Provider for JSON 2021 and get this error message in the logg file.[HTTP|Res: 29] HTTP/1.1 200 OK, 548950 Bytes Transferred[HTTP|Res: 29] Request completed in 6828 ms.[EXEC|Page  ] Page successful: 1000 results (6844 ms) NextPage: [30000][EXEC|Messag] Executed query: [SELECT [Actualizations_id], [ActualizationType.Code],[META|Schema] Engine Invalid object name 'sys_resultset_close'[MDUL|SbMDUL] Drop BulkRows table:ErrorInfo[INFO|Connec] Executed sys_disconnect: Success: (16 ms)[INFO|Connec] Closed JSON connection The execution log file reports:Executing table [JSON].[LCSOC_EC_Actualizations]:failed with error:System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out What does it mean and what to do about it?Cheers/Reith 

Hi! I have asked a similar question like this before. I am trying to request an API token and use that token inside an API get. I do this because a token is only valid for 23 hours. I need to give the POST a few paramters: A client ID, Client Secret, grant type and a customer ID to identify who I am.The API documentation says it uses OAUTH2.0 but I have not gotten it to work. I right now have the following code which returns the warning: The view "REST"."json" has no columns.The view is ignoredBelow my code: <api:script xmlns:api=http://apiscript.com/ns?v1 xmlns:xs=http://www.w3.org/2001/XMLSchema>  <!-- See Column Definitions to specify column behavior and use XPaths to extract column values from JSON. -->  <api:info title="API" desc="Generated schema file." xmlns:other=http://apiscript.com/ns?v1>    <!-- You can modify the name, type, and column size here. -->    <attr name="categoryName"   xs:type="string"    readonly="false"      other:xPath="/json/catego