To homepage To homepage

REST APIs

Ask questions about connecting to Rest APIs within TimeXtender

  • 13 Topics
  • 82 Replies

13 Topics

J
Starter
JeroenSStarter
asked in REST APIs

POST request body REST connection

We have an API in which we have to pass a POST request with a request body to obtain the data. In Qlik Sense and Postman we have a basic connection established. However, there you can easily specify that the call should be a POST and you can also easily fetch the request body. In the CDATA REST connector in TX, we do not know where to fetch this request body in the connection. The demo endpoint we are trying to connect is:https://api.mews-demo.com/api/connector/v1/configuration/getwith the request body:{"ClientToken": "E0D439EE522F44368DC78E1BFB03710C-D24FB11DBE31D4621C4817E028D9E1D","AccessToken": "7059D2C25BF64EA681ACAB3A00B859CC-D91BFF2B1E3047A3E0DEC1D57BE1382","Client": "NameOfYourCompanyOrApplication"}Any help would be appreciated.

7
wouter.goslinga
Participant
4 days ago
E
Contributor
ebayContributor
asked in REST APIs

nested API pagination problem

Hello,To implement pagination in the API endpoint "https://domainname/api/v2/search/tickets?updated_since=2023-01-01T02:00:00Z&page{}", you need to provide the page parameter in a nested format. I prepared a custom RSD file specific to this API after reading the "Nested parameter" article. I have created a loop starting from 1 in the given code.  However, I'm not able to see any data. I'm not receiving any errors during the transfer and synchronization processes. You can find the RSD file attached.I would appreciate in resolving this issue.Best Regards

3
Thomas Lind
Community Manager
5 days ago
N
Starter
Niek.GuijtStarter
asked in REST APIs

Rest API rate limit

Hi,I'm currently connecting to a new api.https://ads-api.autotelex.com/swagger/index.html?urls.primaryName=Autotelex%20%7C%20Advertisement%20API%20V2%20(Beta)In my RSD file I call /api/v2/stock to get the ids for a stock, then I call /api/v2/stock/{adsStockId}/summary using the ids from the first call.The problem I run in to is that i can only make 300 calls per minute for the second call. Whenever I run into this limit my execute fails with the message: "Too many requests".Is there any way to limit or reduce the amount of calls I make per minute?Kind regards,Niek

7
Christian Hauggaard
Community Manager
5 days ago
N
Starter
nohikhStarter
asked in REST APIs

Setting up post curl in "script action"

Hi TimeXtenderI have an urgent request (!)I am trying to set up a Script action (which I will later use in a table as a post-script) that executes a POST CURL in a different tool.I have tried to execute the POST CURL in Postman and it is working.Now I want to do the same from TimeXtender.I have an URL and a Token.How can I set it up? Looking forward to hearing from you.Ismail

1
Thomas Lind
Community Manager
16 days ago
A
Starter
andreas.skagestad
asked in REST APIs

REST connection with JSONROWS - Columns and rows within same array

Hi,I am trying to parse a response using the REST connector from an API which returns a JSONROWS-format where the first row contains the name of the columns, while the following rows contain the values.The response is on the form:{ "response":[ [ {"name":"test1"}, {"name":"test2"} ], [ 1, 2 ], [ 3, 4 ], [ 5, 6 ] ]}I have tried several different xPath-configurations. The following gives the correct columns, but returns zero rows:xPath:        column:/response;columnname:/response.name;row:/responseI was hoping that at least this would have parsed all the values as strings with the first row containing the {“name”:”testN”} in the corresponding columns.How do I work with this response?

4
Thomas Lind
Community Manager
24 days ago
S
Starter
sierd.zuiderveldStarter
asked in REST APIs

Use Table data in REST API

Hi,  I am wondering if it is at all possible to use data stored in a TimeXtender table as variables in a REST API call. I have two use cases that hopefully explain what I am trying to achieve A combination of two REST API's where one requires the output of the other: The first one retrieves all possible classes that can be attended, the second one retrieves all people enrolled in such a class. But the class name is a parameter in the header. I'd like to store the class names in a table and then loop through them (not sure if that's the way to go) and request all enrolled students. A Machine Learning functionIn, for example, Azure Machine Learning Studio I am able to host a model using a REST API. Then, I can call the model and by inserting the parameter values I receive a predicted value. I'd like to do this in the data warehouse since it saves time compared to requesting it every time a dashboard reloads. But again, I'd need to input values from a TimeXtender table.  Is there a recomm

1
Christian Hauggaard
Community Manager
25 days ago
M
Starter
mwr1991Starter
asked in REST APIs

POST rather than GET?

Hi,I am using a REST API (CData source) to get source data. Is it possible to specify that you want to do a POST rather than GET in a CData source?If so is there any Guide? 

5
Thomas Lind
Community Manager
1 month ago
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in REST APIs

CData REST API connector hangs when loading large datasets

We’re facing issues with CData REST API connector when requesting an API for a large dataset. TX sends the request, but seems to never receive a response. The execution fails when it hits the timeout limit (currently set to 3600 seconds).In the logs (verbosity 4) I see that nothing happens between the time that the request was sent and the moment of timeout. I put the same URI, headers and parameters in Azure Data Factory. After 9 minutes it receives a response of 204MB and 176K rows. In Postman, I received a response after 8 minutes. While I agree that it might be better to somehow make smaller API request. In fact, when I limit the date range to only this year, TX gets a response in about a minute. However, I still expect TX/CData to finish the request when the dataset is larger and it takes more time before the response is generated by the server.Due to NDAs I cannot post logs, RSDs or credentials here, but I’ll send some additional files via email.Tx version 20.10.39CData REST API

12
erik.van.mastrigt
TimeXtender Xpert
1 month ago
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in REST APIs

CData REST API connector loads incomplete data when paging is used

Issue: tables with paging stop loading while data is still incompleteWe have an execution package with loads data from AFAS GetConnectors. There are 7 Business Units in TX, each loading data from a separate AFAS implementation.  Per implementation AFAS supports up to 20 parallel connections. From this perspective the Max. Threads 10 should not be a problem.AFAS uses paging with record offset for tables that are too big to load. All Business Units have a similar set of tables. I’ll use AfasIncluzio as an example, as this one has the most data.This table is currently the only one loaded with pagingTX_Financiele_MutatiesWhen we look at the execution log on package level, we can see that the Total Time varies per day:  The AFAS API is quite stable in terms of speed. Hence I can tell that all executions under 15 minutes did not load all data. Further investigation learned that this only happens on table Tx_Financiele_Mutaties, which is currently the only one with paging.This is the Executio

9
erik.van.mastrigt
TimeXtender Xpert
2 months ago
M
Starter
Michel van DrunenStarter
asked in REST APIs

JSON Connection decimal seperator mixed up

Hi, We are trying to connect to a REST api and are using the JSON CData provider version 22.0.8257.0.We are connecting to two seperate datasources:Companies within Europe; Companies outside of EuropeThe problem with the second datasource is that the decimal seperator is mixed up.We tried some of the culture settings but it doesn’t seem to work.What is the best way to solve this?

9
Christian Hauggaard
Community Manager
2 months ago
E
Participant
EvidaXremParticipant
asked in REST APIs

Connecting to Authenticated REST Endpoint

I have been trying for quite a while to connect to an REST endpoint requiring authentication. Have gone through the the cdata documentation and various ressources on the support site.I have working setups both in postman and SSIS Script Task, but is very keen on migrating to a more native TX setup (maintainability), will be migratning several more in the time to come.The process is as follows:Get Authentication Token (HTTP POST) The POSTed information is send as ‘x-www-form-urlencoded’ in the body part (Postman) The response is a json object, containing the token in a attribute Get Actual Data using the Authentication Token (HTTP GET with token as a url parameter)The source in this case i ArcGIS, and the documentation does not mention anything about a standardised authentication scheme.Is there a way around implementing this in any of the standardised authentication schemes, or do I need to go in the direction of RSD files?Please adviceThanks in advance.

10
Christian Hauggaard
Community Manager
3 months ago
R
Starter
reiolsStarter
asked in REST APIs

Error when retrieving data

Hello,I’m using the CData ADO.NET Provider for JSON 2021 and get this error message in the logg file.[HTTP|Res: 29] HTTP/1.1 200 OK, 548950 Bytes Transferred[HTTP|Res: 29] Request completed in 6828 ms.[EXEC|Page  ] Page successful: 1000 results (6844 ms) NextPage: [30000][EXEC|Messag] Executed query: [SELECT [Actualizations_id], [ActualizationType.Code],[META|Schema] Engine Invalid object name 'sys_resultset_close'[MDUL|SbMDUL] Drop BulkRows table:ErrorInfo[INFO|Connec] Executed sys_disconnect: Success: (16 ms)[INFO|Connec] Closed JSON connection The execution log file reports:Executing table [JSON].[LCSOC_EC_Actualizations]:failed with error:System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out What does it mean and what to do about it?Cheers/Reith 

5
Christian Hauggaard
Community Manager
3 months ago
D
Contributor
dan.beggsContributor
asked in REST APIs

CData REST provider using API key

We have a new REST API data source that we are trying to connect to.  This data source takes only an API key through the Authorization: Bearer <api_token> request header.  I am using the CData ADO.NET Provider for REST 2019.  I have added the API URI and the custom header (bearer token), and even selected OAuth 2.0 and added a Callback URL of http://localhost:33333.  No matter what I do, it seems as though the API key is not being passed correctly.  The message I get in the response is "{"message":"Invalid Token"}" and "HTTP/1.1 401 Unauthorized".  I am able to connect to this data source using Postman with the Authorization: Bearer token.  Can anyone give advise on specific settings for using only an API key? Thanks, Dan

9
D
Contributor
7 months ago

Badge winners

  • Certified Solutions Architect
    ParcifalVGhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    rasmusgadensgaardhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    JensFylkissonhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    f_keferhas earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    kerry_bespokehas earned the badge Certified Solutions Architect
Show all badges
Terms and ConditionsCookie settings