To homepage To homepage

Data Sources Q&A

Ask questions of about setting up data sources

60 Topics

T
Starter
timonStarter
asked in RSD File Customization

Pagination and recursive query

Hi,I have problem with pagination and recursive queryI have rest api endpoint:https://api.procountor.com/api/invoiceswhich returns invoice headers as"id": 6591273,"partnerId": 1208831,"type": "PURCHASE_INVOICE","status": "PAID","invoiceNumber": 16...etc.pagination works fine, I get every invoice headers (thousands) when pagination is set like this in RSD-file:<api:set attr="EnablePaging" value="true"/><api:set attr="pagenumberparam" value="page" /><api:set attr="pagesizeparam" value="size" /><api:set attr="pagesize" value="100" />But the actual details of invoice comes from endpoint like this:https://api.procountor.com/api/invoices/6591273So, I have to iterate thru one by one every invoice id that I get from https://api.procountor.com/api/invoices I have followed instructions from herehttps://legacysupport.timextender.com/hc/en-us/articles/360052383191-Creating-and-using-RSD-files-for-CData-providers#one-nested-calland I can query invoices successfully, but the

6
Thomas Lind
Community Manager
1 day ago
J
Starter
JeroenSStarter
asked in REST APIs

POST request body REST connection

We have an API in which we have to pass a POST request with a request body to obtain the data. In Qlik Sense and Postman we have a basic connection established. However, there you can easily specify that the call should be a POST and you can also easily fetch the request body. In the CDATA REST connector in TX, we do not know where to fetch this request body in the connection. The demo endpoint we are trying to connect is:https://api.mews-demo.com/api/connector/v1/configuration/getwith the request body:{"ClientToken": "E0D439EE522F44368DC78E1BFB03710C-D24FB11DBE31D4621C4817E028D9E1D","AccessToken": "7059D2C25BF64EA681ACAB3A00B859CC-D91BFF2B1E3047A3E0DEC1D57BE1382","Client": "NameOfYourCompanyOrApplication"}Any help would be appreciated.

7
wouter.goslinga
Participant
4 days ago
A
Starter
a.chikshinStarter
asked in RSD File Customization

Nested fields filtering in RSD file.

Hi,I have a problem with data catching from JSON file. The file looks like this:And I would like to get values from data field but only for en_US locale.I was trying to add filter in RSD file like below but it did not help:Can that type of filtering be used there?Greets, Aleksei

7
Thomas Lind
Community Manager
5 days ago
E
Contributor
ebayContributor
asked in REST APIs

nested API pagination problem

Hello,To implement pagination in the API endpoint "https://domainname/api/v2/search/tickets?updated_since=2023-01-01T02:00:00Z&page{}", you need to provide the page parameter in a nested format. I prepared a custom RSD file specific to this API after reading the "Nested parameter" article. I have created a loop starting from 1 in the given code.  However, I'm not able to see any data. I'm not receiving any errors during the transfer and synchronization processes. You can find the RSD file attached.I would appreciate in resolving this issue.Best Regards

3
Thomas Lind
Community Manager
5 days ago
J
Visitor
Johnny YVisitor
asked in RSD File Customization

Using a nested REST API in combination with pagination (using the Graph API)

Hello everyone, I hope someone can help me with this.I am working on getting Azure AD Groups via the Graph API and then retrieving the members through a nested API call.I saw a post concerning a nested REST API call together with pagination in which one of the commenters (Gijs) had the exact same API which I am also using (commented by Gijs):https://support.timextender.com/rsd-file-customization-96/using-a-nested-rest-api-in-combination-with-paging-858However, the suggestion didn't work for my use-case as it only ‘expanded’ the nested values, but didn't paginate. I only got the members of the first 100 groups.I used the RSD-file from the commenter Gijs with the addition of two points:two additional rows to enable pagination; [memberout.userPrincipalName| allownull()] instead of [memberout.userPrincipalName] as I was getting a [500] error with this specific attribute.I've made them bold in the code down below.Would someone be able to give me some pointers to what I'm missing in the RSD

0
J
Visitor
5 days ago
L
Contributor
LorenzoContributor
asked in General

Properties Global database settings

Where can I find a description of the properties of the Global Database settings in general and in my case regarding a SQL server DB especially the “max rows to copy”. I have used 0 (hopefully then there is no limit but I have also seen that values are used).

2
Christian Hauggaard
Community Manager
5 days ago
N
Starter
Niek.GuijtStarter
asked in REST APIs

Rest API rate limit

Hi,I'm currently connecting to a new api.https://ads-api.autotelex.com/swagger/index.html?urls.primaryName=Autotelex%20%7C%20Advertisement%20API%20V2%20(Beta)In my RSD file I call /api/v2/stock to get the ids for a stock, then I call /api/v2/stock/{adsStockId}/summary using the ids from the first call.The problem I run in to is that i can only make 300 calls per minute for the second call. Whenever I run into this limit my execute fails with the message: "Too many requests".Is there any way to limit or reduce the amount of calls I make per minute?Kind regards,Niek

7
Christian Hauggaard
Community Manager
5 days ago
R
Starter
remcoStarter
asked in General

Metadata TimeXtender Repository

I am looking for a way to find all tables in a perspective in a way I can analyse the differences between perspectives. In SQL in the metadata repository I would like to join ProjectPerspectives to the Datatables to find all Perspectives with certain tables, find which tables are not in a perspective and are therefor missed while loading data etc. I do not see an identifier thats Unique between the two so I am hoping one of you does :).  Thanks in advance, Remco

3
R
Starter
15 days ago
N
Starter
nohikhStarter
asked in REST APIs

Setting up post curl in "script action"

Hi TimeXtenderI have an urgent request (!)I am trying to set up a Script action (which I will later use in a table as a post-script) that executes a POST CURL in a different tool.I have tried to execute the POST CURL in Postman and it is working.Now I want to do the same from TimeXtender.I have an URL and a Token.How can I set it up? Looking forward to hearing from you.Ismail

1
Thomas Lind
Community Manager
16 days ago
G
Community Manager
Greg LennoxCommunity Manager
posted in General

Configuring a CSV data source stored in an Azure Data Lake Gen2 storage container

We were able to get this CSV file data source stored in an Azure Data Lake Gen2 storage container to work, but thought it may be useful to share, as we found that that the setup worked best when we were careful not to enter any other settings, but instead just entered those settings that were needed and described below. Source File: CSV.Storage Location:  Azure Data Lake Gen2 storage containerAuthentication Method: App Registration added to the storage container via a role assignment of "Storage Blob Data Contributor". Started by adding a new data source and chose the following:On the data source details page, entered the information for the 9 items outlined below, being careful not to enter information in any other boxes and just updating the necessary items. Item #1 will already be set to CSV based on the initial selection above, so that does not need to be updated. The following numbers correspond to the red boxes in the screenshot below.  Provider Name: This should be CSV based on

0
G
Community Manager
19 days ago
R
Starter
RutgerNijlandStarter
asked in RSD File Customization

Pagination azure AD graph API with RSD

Hello,I am trying to extract data from azure AD. I am at the point where I can get data using the microsoft Graph API, and have it loaded into Timextender.The issue I am facing has to do with pagination. Microsoft graph API returns an url containing information of the next 'page’ of data. According to documentation I should adjust my RSD file as follows:  <api:set attr="DataModel" value="DOCUMENT" />  <api:set attr="URI" value="https://graph.microsoft.com/v1.0/groups" />     <api:set attr="EnablePaging" value="true" />  <api:set attr="pageurlpath" value="/json/@odata.nextLink" />  <api:set attr="RepeatElement" value="/json/value/" />This does not however loop over the pages, but still only gives me a top 100 of groups. I have a feeling maybe I need to escape either the @ or the . in the pageurlpath. Or am I missing something more obvious? Kind regards,Rutger

7
R
Starter
23 days ago
A
Starter
andreas.skagestad
asked in REST APIs

REST connection with JSONROWS - Columns and rows within same array

Hi,I am trying to parse a response using the REST connector from an API which returns a JSONROWS-format where the first row contains the name of the columns, while the following rows contain the values.The response is on the form:{ "response":[ [ {"name":"test1"}, {"name":"test2"} ], [ 1, 2 ], [ 3, 4 ], [ 5, 6 ] ]}I have tried several different xPath-configurations. The following gives the correct columns, but returns zero rows:xPath:        column:/response;columnname:/response.name;row:/responseI was hoping that at least this would have parsed all the values as strings with the first row containing the {“name”:”testN”} in the corresponding columns.How do I work with this response?

4
Thomas Lind
Community Manager
24 days ago
S
Starter
sierd.zuiderveldStarter
asked in REST APIs

Use Table data in REST API

Hi,  I am wondering if it is at all possible to use data stored in a TimeXtender table as variables in a REST API call. I have two use cases that hopefully explain what I am trying to achieve A combination of two REST API's where one requires the output of the other: The first one retrieves all possible classes that can be attended, the second one retrieves all people enrolled in such a class. But the class name is a parameter in the header. I'd like to store the class names in a table and then loop through them (not sure if that's the way to go) and request all enrolled students. A Machine Learning functionIn, for example, Azure Machine Learning Studio I am able to host a model using a REST API. Then, I can call the model and by inserting the parameter values I receive a predicted value. I'd like to do this in the data warehouse since it saves time compared to requesting it every time a dashboard reloads. But again, I'd need to input values from a TimeXtender table.  Is there a recomm

1
Christian Hauggaard
Community Manager
25 days ago
rogier.helmus
Starter
rogier.helmusStarter
asked in RSD File Customization

Passing multiple custom headers in a REST API RSD file

Hi all,I need to pass multiple custom headers in a RSD file:Host: xxxxx.cloud.xxxxx.com Authorization: Bearer dfdflejlflefdjeljfeoj Content-Length: 26Is this the correct way to do this? <api:set attr="Header:Name#1" value="Authorization" /> <api:set attr="Header:Value#1" value="Bearer dfdflejlflefdjeljfeoj" /> <api:set attr="Header:Name#2" value="Host" /> <api:set attr="Header:Value#2" value="xxxxx.cloud.xxxxx.com" /> <api:set attr="Header:Name#3" value="Content-Length" /> <api:set attr="Header:Value#3" value="26" />Greets, Rogier

3
Thomas Lind
Community Manager
25 days ago
S
Starter
SurendraStarter
asked in General

External table is not in the expected format

We have a project perspective called 'Reference' which contains ODX tables. When we are executing it through the execution package it is throwing an error  but when we try executing manually it is executing successfully.the file format which we are extracting is  XLSX. can you please help us to resolve this issue.

6
Christian Hauggaard
Community Manager
29 days ago
S
Starter
Steini JonssonStarter
asked in General

Active MQ source

Is it possible to connect to ActiveMQ (https://activemq.apache.org) queue (as a source)?I use c# client app to fetch the data from the queue and was wondering if it is possible to use TimeXtender instead. 

3
Thomas Lind
Community Manager
29 days ago
S
Contributor
SpellingContributor
asked in Oracle

Sync Oracle slow for ODX server

Hi,I have a setup of a TimeXtender 20.10.41.64, ODX, ADL, ADF, Self hosted IR which I get to work just fine. I need to extract data from an IFS10 source, Oracle database, and the sync is too slow so it times out and fail after 2 hours. The data source is provided by a third party and which means that the customer doesn’t have control to change any settings and 2 hours should be enough time for a sync. The customer have a couple of TX environments After many tests and discussing with the customer a similar problem have occurred before, but in an environment not using ODX server, where a sync took over 2 hours and this was fixed in Timextender release 20.10.3, issue “8889: Oracle slow synchronization - affects all bit specific data sources”. After this release the customer says the sync only takes about 10-15 min. Could this be a problem in ODX server as well? I managed to get a successful sync with version 20.10.40 which took about 2 hours but after an upgrade to 20.10.41 I’ve  managed

1
Thomas Lind
Community Manager
29 days ago
andri
Contributor
andriContributor
asked in General

BC Adapter - Merge extension tables option

In version 20.10.39 you sneaked in a new features in the BC Adapter data source: 17627: Business Central adapter - Merge extension tables option for SQL Server provider Added option to merge a table and its extension tables together as one table. This feature could be very useful but I can’t find any documentation on how it works and if there are any limits or considerations that need to be taken into account.Initial testing suggest that it works for some tables but maybe not for tables in extension modules?

10
Thomas Lind
Community Manager
1 month ago
S
Contributor
SpellingContributor
asked in Oracle

Sync not working - OracleDB - ADF

I have a setup of a TimeXtender 20.10.40.64, ODX, ADL, ADF, Self hosted IR which I get to work just fine. I need to extract data from an IFS10 source, Oracle database, and it works until syncing then it seems to start an endless loop and never finish or gives an error. In TX I havesetup a new data source, Azure Data Factory - Oracle included all connection info information In Select tables I click “Search” and get all the tables available in the Oracle DB I Include a couple a tables Setup a transfer task Syncing starts running and I can see in ADF that is is running but it never receives any data from the data sourceI have tested from a SQL data source with ADF and it works just fine, both sync and transferI have in ADF tested to preview tables in the dataset created by TX and I can preview tables from Oracle DB just fine. I have even tried to create my own pipeline in ADF to copy data from the same data source to the same sink that TX created and it works just fine. It creates a parqu

20
S
Contributor
1 month ago
P
Explorer
pontus.berglundExplorer
asked in General

Connecting to multple databases on the same SQL Server

Hi,Is it possible to connect to several databases that are on the same SQL server with one data source connection?We have tried to connect to multiple databases on the same SQL Server using the provider “TimeXtender SQL Data Source 17.0.1.0”.We tried leaving the Database parameter blank, putting in *, and writing a comma-separated list of databases, but neither way works. Has anyone had any success doing this with this connector or another?We’re using version 6221.1.Thanks!

6
AvanWijnen
Community Manager
1 month ago
L
Contributor
LorenzoContributor
asked in General

Read Excel decimal data with CDATA

I have an Excel sheet with percentages (11 decimals). The decimal sign is comma. See example below.Year    Period    CostPercentage2020    1    0,018001882020    2    0,016852519But when I read the data in TX then I see the below result:   I have tried to use the culture feature see below but no success. Find a screen dump belowWhy does TX / Cdata not read the data as is? The “,” is interpreted as a Thousand separator.Any help will be appreciated.When I have a file with a “.” (dot) as a decimal sign I convert the data to numeric precision 38,scale 11 and that works. 

11
Christian Hauggaard
Community Manager
1 month ago
M
Starter
mwr1991Starter
asked in REST APIs

POST rather than GET?

Hi,I am using a REST API (CData source) to get source data. Is it possible to specify that you want to do a POST rather than GET in a CData source?If so is there any Guide? 

5
Thomas Lind
Community Manager
1 month ago
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in REST APIs

CData REST API connector hangs when loading large datasets

We’re facing issues with CData REST API connector when requesting an API for a large dataset. TX sends the request, but seems to never receive a response. The execution fails when it hits the timeout limit (currently set to 3600 seconds).In the logs (verbosity 4) I see that nothing happens between the time that the request was sent and the moment of timeout. I put the same URI, headers and parameters in Azure Data Factory. After 9 minutes it receives a response of 204MB and 176K rows. In Postman, I received a response after 8 minutes. While I agree that it might be better to somehow make smaller API request. In fact, when I limit the date range to only this year, TX gets a response in about a minute. However, I still expect TX/CData to finish the request when the dataset is larger and it takes more time before the response is generated by the server.Due to NDAs I cannot post logs, RSDs or credentials here, but I’ll send some additional files via email.Tx version 20.10.39CData REST API

12
erik.van.mastrigt
TimeXtender Xpert
1 month ago
S
Starter
sierd.zuiderveldStarter
asked in RSD File Customization

SOAP API setup

Hi, I have some trouble setting up a SOAP API within the RSD file. The envelope returns data as follows : <s:Envelope xmlns:s="http://schemas.xmlsoap.org/soap/envelope/"> <s:Body> <getCertificateListByCompanyResponse xmlns="http://tempuri.org/"> <getCertificateListByCompanyResult xmlns:a="http://schemas.datacontract.org/2004/07/" xmlns:i="http://www.w3.org/2001/XMLSchema-instance"> <a:ObtainedCertificate> <a:CategoryName>text1</a:CategoryName> <a:CertificateCode>12345</a:CertificateCode> <a:CertificateID>12345</a:CertificateID> <a:CertificateName>text2</a:CertificateName> <a:CertificateNumber/> <a:DateAssigned>12345</a:DateAssigned> <a:DateExpire/> <a:DateObtained>12345</a:DateObtained> <a:Expired>false</a:Expired&g

1
Thomas Lind
Community Manager
1 month ago
A
Starter
alexfeldStarter
asked in General

Using Exact with multiple divisions as a data source

Hello, I am currently trying to integrate Exact data using the TX Exact Online connector. I need to integrate data from a bunch of different divisions; I was wondering if the only way to do so was to individually add each division as a new data source or if there was another way ? 

2
bas.hopstaken
TimeXtender Xpert
1 month ago

Badge winners

  • Certified Solutions Architect
    ParcifalVGhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    rasmusgadensgaardhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    JensFylkissonhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    f_keferhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    kerry_bespokehas earned the badge Certified Solutions Architect
Show all badges
Terms and ConditionsCookie settings