Skip to main content
To homepage To homepage

Data Sources Q&A

Ask questions of about setting up data sources

151 Topics
P
Contributor
pontus.berglundContributor
asked in REST APIs
Connecting to App Store Connect API

Hi, My client wants to connect to the App Store Connect API (https://developer.apple.com/documentation/appstoreconnectapi) but we are having trouble with getting the authorization to work. Calls to the API require JSON Web Tokens (JWT) for authorization, specifically using the “ES256” signature algorithm. We tried using the CData Rest connector but found in the documentation that “...the JWT signature algorithm cannot be set directly. Only the RS256 algorithm is supported” https://cdn.cdata.com/help/DWH/ado/pg_oauth.htm#jwt Has anyone experience connecting to the App Store Connect API?

1635
Christian Hauggaard
Community Manager
ignacio
Contributor
ignacioContributor
asked in General
TX customer data source

Hi Friends I have used TX CDS to connect SQL Server because It was a best practice recommendation, but now I don’t know if CDS will be deprecated, What is the best connector for SQL Server? CDS will be deprecated? Regards Ignacio

693
Thomas Lind
Community Manager
J
Participant
JeroenSParticipant
asked in REST APIs
Nested calls with POST API

We are struggling with nested calls in a POST API with custom body. We don't change the URI on every input, but need to change the body on every request: We use Cursor based pagination using rows@next for pagination. And as it seems you can only use one pagination per rsd, we can only get one iteration using nested calls. Query slicers only seem to be able to slice URI's (https://cdn.cdata.com/help/DWG/jdbc/pg_queryslicer.htm). In our example, we are extracting ReservationId's from a Reservation request and need them as a body input for ReservationItems in batches of 1000. Any help would be appreciated, let me know if you need anymore information.

22312
Thomas Lind
Community Manager
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in REST APIs
CData REST API connector hangs when loading large datasets

We’re facing issues with CData REST API connector when requesting an API for a large dataset. TX sends the request, but seems to never receive a response. The execution fails when it hits the timeout limit (currently set to 3600 seconds). In the logs (verbosity 4) I see that nothing happens between the time that the request was sent and the moment of timeout. I put the same URI, headers and parameters in Azure Data Factory. After 9 minutes it receives a response of 204MB and 176K rows. In Postman, I received a response after 8 minutes. While I agree that it might be better to somehow make smaller API request. In fact, when I limit the date range to only this year, TX gets a response in about a minute. However, I still expect TX/CData to finish the request when the dataset is larger and it takes more time before the response is generated by the server. Due to NDAs I cannot post logs, RSDs or credentials here, but I’ll send some additional files via email. Tx version 20.10.39CData REST A

47715
Christian Hauggaard
Community Manager
J
Participant
JeroenSParticipant
asked in REST APIs
POST request body REST connection

We have an API in which we have to pass a POST request with a request body to obtain the data. In Qlik Sense and Postman we have a basic connection established. However, there you can easily specify that the call should be a POST and you can also easily fetch the request body. In the CDATA REST connector in TX, we do not know where to fetch this request body in the connection. The demo endpoint we are trying to connect is: https://api.mews-demo.com/api/connector/v1/configuration/get with the request body: { "ClientToken": "E0D439EE522F44368DC78E1BFB03710C-D24FB11DBE31D4621C4817E028D9E1D", "AccessToken": "7059D2C25BF64EA681ACAB3A00B859CC-D91BFF2B1E3047A3E0DEC1D57BE1382", "Client": "NameOfYourCompanyOrApplication" } Any help would be appreciated.

5339
Thomas Lind
Community Manager
rogier.helmus
Problem Solver
rogier.helmusProblem Solver
asked in General
Overview connection tables and fields loaded with ODX server (documentation)

Hi all, I have a customer at which the data & analytics team has to report which data (tables & fields) is loaded into the data lake with ODX server for a certain source. This is because the source contains GDPR data and the data & analytics team has to prove to the legal team that they aren’t loading GDPR data into the data lake and further upstream. Unfortunately the TX documentation feature documents from the DSA and onward. The DSA documentation isn’t feasible for this request since we’re renaming fields and adding transformations. Is there a workaround to get this overview for a ODX server connection? Kind regards, Rogier TimeXtender version: 20.10.39

681
Christian Hauggaard
Community Manager
T
Starter
timonStarter
asked in RSD File Customization
Pagination and recursive query

Hi, I have problem with pagination and recursive query I have rest api endpoint: https://api.procountor.com/api/invoices which returns invoice headers as"id": 6591273,"partnerId": 1208831,"type": "PURCHASE_INVOICE","status": "PAID","invoiceNumber": 16...etc. pagination works fine, I get every invoice headers (thousands) when pagination is set like this in RSD-file:<api:set attr="EnablePaging" value="true"/><api:set attr="pagenumberparam" value="page" /><api:set attr="pagesizeparam" value="size" /><api:set attr="pagesize" value="100" /> But the actual details of invoice comes from endpoint like this:https://api.procountor.com/api/invoices/6591273 So, I have to iterate thru one by one every invoice id that I get from https://api.procountor.com/api/invoices I have followed instructions from herehttps://legacysupport.timextender.com/hc/en-us/articles/360052383191-Creating-and-using-RSD-files-for-CData-providers#one-nested-call and I can query invoices successfully, but the problem is that

5476
Thomas Lind
Community Manager
A
Starter
a.chikshinStarter
asked in RSD File Customization
Nested fields filtering in RSD file.

Hi, I have a problem with data catching from JSON file. The file looks like this: And I would like to get values from data field but only for en_US locale. I was trying to add filter in RSD file like below but it did not help: Can that type of filtering be used there? Greets, Aleksei

2377
Thomas Lind
Community Manager
E
Contributor
ebayContributor
asked in REST APIs
nested API pagination problem

Hello, To implement pagination in the API endpoint " https://domainname/api/v2/search/tickets?updated_since=2023-01-01T02:00:00Z&page{} ", you need to provide the page parameter in a nested format. I prepared a custom RSD file specific to this API after reading the "Nested parameter" article. I have created a loop starting from 1 in the given code. However, I'm not able to see any data. I'm not receiving any errors during the transfer and synchronization processes. You can find the RSD file attached.I would appreciate in resolving this issue.Best Regards

1593
Thomas Lind
Community Manager
R
Starter
remcoStarter
asked in General
Metadata TimeXtender Repository

I am looking for a way to find all tables in a perspective in a way I can analyse the differences between perspectives. In SQL in the metadata repository I would like to join ProjectPerspectives to the Datatables to find all Perspectives with certain tables, find which tables are not in a perspective and are therefor missed while loading data etc. I do not see an identifier thats Unique between the two so I am hoping one of you does :). Thanks in advance, Remco

2003
R
Starter
N
Starter
nohikhStarter
asked in REST APIs
Setting up post curl in "script action"

Hi TimeXtender I have an urgent request (!)I am trying to set up a Script action (which I will later use in a table as a post-script) that executes a POST CURL in a different tool. I have tried to execute the POST CURL in Postman and it is working.Now I want to do the same from TimeXtender. I have an URL and a Token.How can I set it up? Looking forward to hearing from you. Ismail

1021
Thomas Lind
Community Manager
G
Community Manager
Greg LennoxCommunity Manager
posted in General
Configuring a CSV data source stored in an Azure Data Lake Gen2 storage container

We were able to get this CSV file data source stored in an Azure Data Lake Gen2 storage container to work, but thought it may be useful to share, as we found that that the setup worked best when we were careful not to enter any other settings, but instead just entered those settings that were needed and described below. Source File: CSV. Storage Location: Azure Data Lake Gen2 storage container Authentication Method: App Registration added to the storage container via a role assignment of "Storage Blob Data Contributor". Started by adding a new data source and chose the following: On the data source details page, entered the information for the 9 items outlined below, being careful not to enter information in any other boxes and just updating the necessary items. Item #1 will already be set to CSV based on the initial selection above, so that does not need to be updated. The following numbers correspond to the red boxes in the screenshot below. Provider Name: This should be CSV based on

3140
G
Community Manager
R
Starter
RutgerNijlandStarter
asked in RSD File Customization
Pagination azure AD graph API with RSD

Hello, I am trying to extract data from azure AD. I am at the point where I can get data using the microsoft Graph API, and have it loaded into Timextender. The issue I am facing has to do with pagination. Microsoft graph API returns an url containing information of the next 'page’ of data. According to documentation I should adjust my RSD file as follows: <api:set attr="DataModel" value="DOCUMENT" /> <api:set attr="URI" value="https://graph.microsoft.com/v1.0/groups" /> <api:set attr="EnablePaging" value="true" /> <api:set attr="pageurlpath" value="/json/@odata.nextLink" /> <api:set attr="RepeatElement" value="/json/value/" /> This does not however loop over the pages, but still only gives me a top 100 of groups. I have a feeling maybe I need to escape either the @ or the . in the pageurlpath. Or am I missing something more obvious? Kind regards, Rutger

4438
R
Starter
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in REST APIs
Use Table data in REST API

Hi, I am wondering if it is at all possible to use data stored in a TimeXtender table as variables in a REST API call. I have two use cases that hopefully explain what I am trying to achieve A combination of two REST API's where one requires the output of the other: The first one retrieves all possible classes that can be attended, the second one retrieves all people enrolled in such a class. But the class name is a parameter in the header. I'd like to store the class names in a table and then loop through them (not sure if that's the way to go) and request all enrolled students. A Machine Learning function In, for example, Azure Machine Learning Studio I am able to host a model using a REST API. Then, I can call the model and by inserting the parameter values I receive a predicted value. I'd like to do this in the data warehouse since it saves time compared to requesting it every time a dashboard reloads. But again, I'd need to input values from a TimeXtender table. Is there a recomme

2851
Christian Hauggaard
Community Manager
rogier.helmus
Problem Solver
rogier.helmusProblem Solver
asked in RSD File Customization
Passing multiple custom headers in a REST API RSD file

Hi all, I need to pass multiple custom headers in a RSD file: Host: xxxxx.cloud.xxxxx.com Authorization: Bearer dfdflejlflefdjeljfeoj Content-Length: 26 Is this the correct way to do this? <api:set attr="Header:Name#1" value="Authorization" /> <api:set attr="Header:Value#1" value="Bearer dfdflejlflefdjeljfeoj" /> <api:set attr="Header:Name#2" value="Host" /> <api:set attr="Header:Value#2" value="xxxxx.cloud.xxxxx.com" /> <api:set attr="Header:Name#3" value="Content-Length" /> <api:set attr="Header:Value#3" value="26" /> Greets, Rogier

2453
Thomas Lind
Community Manager
S
Starter
SurendraStarter
asked in General
External table is not in the expected format

We have a project perspective called 'Reference' which contains ODX tables. When we are executing it through the execution package it is throwing an error but when we try executing manually it is executing successfully. the file format which we are extracting is XLSX. can you please help us to resolve this issue.

1326
Christian Hauggaard
Community Manager
S
Starter
Steini JonssonStarter
asked in General
Active MQ source

Is it possible to connect to ActiveMQ (https://activemq.apache.org) queue (as a source)?I use c# client app to fetch the data from the queue and was wondering if it is possible to use TimeXtender instead.

473
Thomas Lind
Community Manager
S
Contributor
SpellingContributor
asked in Oracle
Sync not working - OracleDB - ADF

I have a setup of a TimeXtender 20.10.40.64, ODX, ADL, ADF, Self hosted IR which I get to work just fine. I need to extract data from an IFS10 source, Oracle database, and it works until syncing then it seems to start an endless loop and never finish or gives an error. In TX I have setup a new data source, Azure Data Factory - Oracle included all connection info information In Select tables I click “Search” and get all the tables available in the Oracle DB I Include a couple a tables Setup a transfer task Syncing starts running and I can see in ADF that is is running but it never receives any data from the data source I have tested from a SQL data source with ADF and it works just fine, both sync and transfer I have in ADF tested to preview tables in the dataset created by TX and I can preview tables from Oracle DB just fine. I have even tried to create my own pipeline in ADF to copy data from the same data source to the same sink that TX created and it works just fine. It creates a pa

34320
S
Contributor
P
Contributor
pontus.berglundContributor
asked in General
Connecting to multple databases on the same SQL Server

Hi, Is it possible to connect to several databases that are on the same SQL server with one data source connection? We have tried to connect to multiple databases on the same SQL Server using the provider “TimeXtender SQL Data Source 17.0.1.0”. We tried leaving the Database parameter blank, putting in *, and writing a comma-separated list of databases, but neither way works. Has anyone had any success doing this with this connector or another? We’re using version 6221.1. Thanks!

1016
AvanWijnen
Employee
L
Contributor
LorenzoContributor
asked in General
Read Excel decimal data with CDATA

I have an Excel sheet with percentages (11 decimals). The decimal sign is comma. See example below. Year Period CostPercentage2020 1 0,018001882020 2 0,016852519 But when I read the data in TX then I see the below result: I have tried to use the culture feature see below but no success. Find a screen dump below Why does TX / Cdata not read the data as is? The “,” is interpreted as a Thousand separator. Any help will be appreciated. When I have a file with a “.” (dot) as a decimal sign I convert the data to numeric precision 38,scale 11 and that works.

36911
Christian Hauggaard
Community Manager
M
Starter
mwr1991Starter
asked in REST APIs
POST rather than GET?

Hi, I am using a REST API (CData source) to get source data. Is it possible to specify that you want to do a POST rather than GET in a CData source? If so is there any Guide?

2665
Thomas Lind
Community Manager
A
Starter
alexfeldStarter
asked in General
Using Exact with multiple divisions as a data source

Hello, I am currently trying to integrate Exact data using the TX Exact Online connector. I need to integrate data from a bunch of different divisions; I was wondering if the only way to do so was to individually add each division as a new data source or if there was another way ?

1262
bas.hopstaken
TimeXtender Xpert
E
Contributor
ebayContributor
asked in General
invalid column name

Hello everyone, After the odx transfer task for API, when I click on the preview, I get the “invalid column name” error. This warning also occurs while executing in the data warehouse and stops execute. What should I do? I wanted to use aliases but I have 575 columns. I tried to re-deploy the table with differential deployment disabled. Version: 6143.1 My column name example is below: it is very long ‘properties_parameter_WS10M_RANGE_202109’ Thanks Best Regards

4135
E
Contributor
A
Starter
adijksmanStarter
asked in General
Cdata JSON connector in Business Unit different results

Dear community, Reach out to this community due to an issue with a JSON datasource connector. The situation: TimeXtender on premise (v20.10.40) using a Cdata ADO.net Provider for JSON 2021 (21.0.8011.0) in the Business Unit layer of the project. The connector uses a general account-password access for this datasource. User 1 logs on to the server TimeXtender is running on, does read data for this connector and got all the information expected. User 2 logs on to the server TimeXtender is running on, does read data and get just some information but not even related to this source. No error. Both users use the same connector with that general account to connect to this JSON datasource, but with different results. I asked for logfiles with verbosity = 3 of both users and attached are anonymized files. I am not sure how to interpret the differences in the logs. The log with the wrong results starts with a time out but playing around with this kind of setting does not change the outcome. Als

683
A
Starter
bas.hopstaken
TimeXtender Xpert
bas.hopstakenTimeXtender Xpert
asked in General
Is there a (free/open) data source available to map companies to NACE Code?

Hi community, One of our customers want to report on NACE Code (see: https://nacev2.com/en). We are trying to find a (free/open) data source to map customers to the correct NACE Code. We do have the Dutch KVK/registration number and the EU VAT Number. Using one of these identifiers, we want to map the correct NACE Code. Does anyone have experience with this?

15374
bas.hopstaken
TimeXtender Xpert

Most helpful members this week

Badge winners

  • Innovator
    Bernarddbhas earned the badge Innovator
  • Certified Solutions Architect
    JeroenStahas earned the badge Certified Solutions Architect
  • Ingest Expert
    nmohas earned the badge Ingest Expert
  • Ingest Expert
    oscarclevehas earned the badge Ingest Expert
  • Ingest Expert
    fwagnerhas earned the badge Ingest Expert
Show all badges

Popular tags

Terms and ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings