To homepage To homepage

REST APIs

Ask questions about connecting to Rest APIs within TimeXtender

  • 18 Topics
  • 126 Replies

18 Topics

A
Starter
andreas.skagestad
asked in REST APIs

REST connection with JSONROWS - Columns and rows within same array

Hi,I am trying to parse a response using the REST connector from an API which returns a JSONROWS-format where the first row contains the name of the columns, while the following rows contain the values.The response is on the form:{ "response":[ [ {"name":"test1"}, {"name":"test2"} ], [ 1, 2 ], [ 3, 4 ], [ 5, 6 ] ]}I have tried several different xPath-configurations. The following gives the correct columns, but returns zero rows:xPath:        column:/response;columnname:/response.name;row:/responseI was hoping that at least this would have parsed all the values as strings with the first row containing the {“name”:”testN”} in the corresponding columns.How do I work with this response?

6
Christian Hauggaard
Community Manager
26 days ago
D
Starter
dpjatStarter
asked in REST APIs

Help with REST API based on table

Hi everyone, I’ve been searching but haven’t been able to find in previous threads. For an API i'm trying to extract to TX, i'm running into some issues. The API extracts some geographical building data, based on an ID. I have these ID's from a seperate source already in the warehouse.What I want to do is get the ID from the ODX-table and for each ID run a call to the API. I'm new to this scripting language and maybe im overlooking it in existing documentation but for me it seems impossible. Any idea's and suggestions would be welcome, thanks!

10
Christian Hauggaard
Community Manager
30 days ago
N
Starter
Niek.GuijtStarter
asked in REST APIs

Rest API rate limit

Hi,I'm currently connecting to a new api.https://ads-api.autotelex.com/swagger/index.html?urls.primaryName=Autotelex%20%7C%20Advertisement%20API%20V2%20(Beta)In my RSD file I call /api/v2/stock to get the ids for a stock, then I call /api/v2/stock/{adsStockId}/summary using the ids from the first call.The problem I run in to is that i can only make 300 calls per minute for the second call. Whenever I run into this limit my execute fails with the message: "Too many requests".Is there any way to limit or reduce the amount of calls I make per minute?Kind regards,Niek

8
J
Contributor
1 month ago
J
Contributor
jacqueline.hofmeijerContributor
asked in REST APIs

Use variables on Query tables

Hi,I have a project that is using the cdata connector as a datasource, and because of issues with paging and nested call we have created query tables to get the correct results (using queryslicer in the rsd-files).Because of performance issues the tables have to be setup for incremental loading, but I cannot get this working because I need the incremental value in the call.Is it somehow possible to use a variable or a field from another table in the Quey tables to get the incremental value?When using a fixed date the logic is working fine (as shown below) but that's not workable:    SELECT *     FROM [REST].[EventRegistration_Detail]      WHERE [file_name] IN         (SELECT [Name]          FROM [REST].[EventRegistration_List]         WHERE [Properties.Last-Modified] > '2023-01-01')  (using TX 20.10.30.64 with Business Units) Any good suggestions on this? Kind regards,Jacqueline

4
Thomas Lind
Community Manager
1 month ago
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in REST APIs

CData REST API connector loads incomplete data when paging is used

Issue: tables with paging stop loading while data is still incompleteWe have an execution package with loads data from AFAS GetConnectors. There are 7 Business Units in TX, each loading data from a separate AFAS implementation.  Per implementation AFAS supports up to 20 parallel connections. From this perspective the Max. Threads 10 should not be a problem.AFAS uses paging with record offset for tables that are too big to load. All Business Units have a similar set of tables. I’ll use AfasIncluzio as an example, as this one has the most data.This table is currently the only one loaded with pagingTX_Financiele_MutatiesWhen we look at the execution log on package level, we can see that the Total Time varies per day:  The AFAS API is quite stable in terms of speed. Hence I can tell that all executions under 15 minutes did not load all data. Further investigation learned that this only happens on table Tx_Financiele_Mutaties, which is currently the only one with paging.This is the Executio

10
erik.van.mastrigt
TimeXtender Xpert
1 month ago
Niels Jonker
Contributor
Niels JonkerContributor
asked in REST APIs

RSD pagination with incrementing value

Hey community,I am trying to set up pagination for my REST connector to ADP. I need to use the CData parameters $skip & $top.My first call should be: https://api.eu.adp.com/hr/v2/workers?$skip=0&$top=100Then I need to increment the $skip parameter by 100 so the next call would be: https://api.eu.adp.com/hr/v2/workers?$skip=100&$top=100In need to end when I receive an empty response. Anyone that has experience with this?

4
Matt Thomas
Starter
4 months ago
P
Contributor
pontus.berglundContributor
asked in REST APIs

Connecting to App Store Connect API

Hi,My client wants to connect to the App Store Connect API (https://developer.apple.com/documentation/appstoreconnectapi) but we are having trouble with getting the authorization to work.Calls to the API require JSON Web Tokens (JWT) for authorization, specifically using the “ES256” signature algorithm. We tried using the CData Rest connector but found in the documentation that “...the JWT signature algorithm cannot be set directly. Only the RS256 algorithm is supported”  https://cdn.cdata.com/help/DWH/ado/pg_oauth.htm#jwtHas anyone experience connecting to the App Store Connect API?

5
Christian Hauggaard
Community Manager
5 months ago
J
Explorer
JeroenSExplorer
asked in REST APIs

Nested calls with POST API

We are struggling with nested calls in a POST API with custom body. We don't change the URI on every input, but need to change the body on every request:We use Cursor based pagination using rows@next for pagination. And as it seems you can only use one pagination per rsd, we can only get one iteration using nested calls.Query slicers only seem to be able to slice URI's (https://cdn.cdata.com/help/DWG/jdbc/pg_queryslicer.htm). In our example, we are extracting ReservationId's from a Reservation request and need them as a body input for ReservationItems in batches of 1000.Any help would be appreciated, let me know if you need anymore information.

12
Thomas Lind
Community Manager
5 months ago
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in REST APIs

CData REST API connector hangs when loading large datasets

We’re facing issues with CData REST API connector when requesting an API for a large dataset. TX sends the request, but seems to never receive a response. The execution fails when it hits the timeout limit (currently set to 3600 seconds).In the logs (verbosity 4) I see that nothing happens between the time that the request was sent and the moment of timeout. I put the same URI, headers and parameters in Azure Data Factory. After 9 minutes it receives a response of 204MB and 176K rows. In Postman, I received a response after 8 minutes. While I agree that it might be better to somehow make smaller API request. In fact, when I limit the date range to only this year, TX gets a response in about a minute. However, I still expect TX/CData to finish the request when the dataset is larger and it takes more time before the response is generated by the server.Due to NDAs I cannot post logs, RSDs or credentials here, but I’ll send some additional files via email.Tx version 20.10.39CData REST API

15
Christian Hauggaard
Community Manager
5 months ago
J
Explorer
JeroenSExplorer
asked in REST APIs

POST request body REST connection

We have an API in which we have to pass a POST request with a request body to obtain the data. In Qlik Sense and Postman we have a basic connection established. However, there you can easily specify that the call should be a POST and you can also easily fetch the request body. In the CDATA REST connector in TX, we do not know where to fetch this request body in the connection. The demo endpoint we are trying to connect is:https://api.mews-demo.com/api/connector/v1/configuration/getwith the request body:{"ClientToken": "E0D439EE522F44368DC78E1BFB03710C-D24FB11DBE31D4621C4817E028D9E1D","AccessToken": "7059D2C25BF64EA681ACAB3A00B859CC-D91BFF2B1E3047A3E0DEC1D57BE1382","Client": "NameOfYourCompanyOrApplication"}Any help would be appreciated.

9
Thomas Lind
Community Manager
5 months ago
E
Contributor
ebayContributor
asked in REST APIs

nested API pagination problem

Hello,To implement pagination in the API endpoint "https://domainname/api/v2/search/tickets?updated_since=2023-01-01T02:00:00Z&page{}", you need to provide the page parameter in a nested format. I prepared a custom RSD file specific to this API after reading the "Nested parameter" article. I have created a loop starting from 1 in the given code.  However, I'm not able to see any data. I'm not receiving any errors during the transfer and synchronization processes. You can find the RSD file attached.I would appreciate in resolving this issue.Best Regards

3
Thomas Lind
Community Manager
6 months ago
N
Starter
nohikhStarter
asked in REST APIs

Setting up post curl in "script action"

Hi TimeXtenderI have an urgent request (!)I am trying to set up a Script action (which I will later use in a table as a post-script) that executes a POST CURL in a different tool.I have tried to execute the POST CURL in Postman and it is working.Now I want to do the same from TimeXtender.I have an URL and a Token.How can I set it up? Looking forward to hearing from you.Ismail

1
Thomas Lind
Community Manager
6 months ago
S
Contributor
sierd.zuiderveldContributor
asked in REST APIs

Use Table data in REST API

Hi,  I am wondering if it is at all possible to use data stored in a TimeXtender table as variables in a REST API call. I have two use cases that hopefully explain what I am trying to achieve A combination of two REST API's where one requires the output of the other: The first one retrieves all possible classes that can be attended, the second one retrieves all people enrolled in such a class. But the class name is a parameter in the header. I'd like to store the class names in a table and then loop through them (not sure if that's the way to go) and request all enrolled students. A Machine Learning functionIn, for example, Azure Machine Learning Studio I am able to host a model using a REST API. Then, I can call the model and by inserting the parameter values I receive a predicted value. I'd like to do this in the data warehouse since it saves time compared to requesting it every time a dashboard reloads. But again, I'd need to input values from a TimeXtender table.  Is there a recomm

1
Christian Hauggaard
Community Manager
6 months ago
M
Starter
mwr1991Starter
asked in REST APIs

POST rather than GET?

Hi,I am using a REST API (CData source) to get source data. Is it possible to specify that you want to do a POST rather than GET in a CData source?If so is there any Guide? 

5
Thomas Lind
Community Manager
7 months ago
M
Contributor
Michel van DrunenContributor
asked in REST APIs

JSON Connection decimal seperator mixed up

Hi, We are trying to connect to a REST api and are using the JSON CData provider version 22.0.8257.0.We are connecting to two seperate datasources:Companies within Europe; Companies outside of EuropeThe problem with the second datasource is that the decimal seperator is mixed up.We tried some of the culture settings but it doesn’t seem to work.What is the best way to solve this?

9
Christian Hauggaard
Community Manager
8 months ago
E
Participant
EvidaXremParticipant
asked in REST APIs

Connecting to Authenticated REST Endpoint

I have been trying for quite a while to connect to an REST endpoint requiring authentication. Have gone through the the cdata documentation and various ressources on the support site.I have working setups both in postman and SSIS Script Task, but is very keen on migrating to a more native TX setup (maintainability), will be migratning several more in the time to come.The process is as follows:Get Authentication Token (HTTP POST) The POSTed information is send as ‘x-www-form-urlencoded’ in the body part (Postman) The response is a json object, containing the token in a attribute Get Actual Data using the Authentication Token (HTTP GET with token as a url parameter)The source in this case i ArcGIS, and the documentation does not mention anything about a standardised authentication scheme.Is there a way around implementing this in any of the standardised authentication schemes, or do I need to go in the direction of RSD files?Please adviceThanks in advance.

10
Christian Hauggaard
Community Manager
9 months ago
R
Starter
reiolsStarter
asked in REST APIs

Error when retrieving data

Hello,I’m using the CData ADO.NET Provider for JSON 2021 and get this error message in the logg file.[HTTP|Res: 29] HTTP/1.1 200 OK, 548950 Bytes Transferred[HTTP|Res: 29] Request completed in 6828 ms.[EXEC|Page  ] Page successful: 1000 results (6844 ms) NextPage: [30000][EXEC|Messag] Executed query: [SELECT [Actualizations_id], [ActualizationType.Code],[META|Schema] Engine Invalid object name 'sys_resultset_close'[MDUL|SbMDUL] Drop BulkRows table:ErrorInfo[INFO|Connec] Executed sys_disconnect: Success: (16 ms)[INFO|Connec] Closed JSON connection The execution log file reports:Executing table [JSON].[LCSOC_EC_Actualizations]:failed with error:System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out What does it mean and what to do about it?Cheers/Reith 

5
Christian Hauggaard
Community Manager
9 months ago
D
Contributor
dan.beggsContributor
asked in REST APIs

CData REST provider using API key

We have a new REST API data source that we are trying to connect to.  This data source takes only an API key through the Authorization: Bearer <api_token> request header.  I am using the CData ADO.NET Provider for REST 2019.  I have added the API URI and the custom header (bearer token), and even selected OAuth 2.0 and added a Callback URL of http://localhost:33333.  No matter what I do, it seems as though the API key is not being passed correctly.  The message I get in the response is "{"message":"Invalid Token"}" and "HTTP/1.1 401 Unauthorized".  I am able to connect to this data source using Postman with the Authorization: Bearer token.  Can anyone give advise on specific settings for using only an API key? Thanks, Dan

9
D
Contributor
1 year ago

Badge winners

Show all badges
Terms and ConditionsCookie settings