REST APIs

I am having issues getting the new ODX TimeXtender Rest API to connect using OAuth2 and an authentication service to generate an expiring bearer token. I have been able to generate a token successfully using Postman, and I have been able to configure the standard ODX CData Rest datasource successfully with the authentication service. But using the same setup I am getting errors on the TimeXtender Rest service. This is the OAuth2 settings from the standard Rest Data Source CData Rest OAuth settings that work This is the OAuth settings from the new TimeXtender Rest datasource that don’t work. TimeXtender Rest API The only thing potentially unusual was that when setting up my postman request to generate the Bearer Toekn the connection instructions specifically stated to setup the body as follows: Postman However I did not have to set the encoding in the standard CData Rest. I did try generating the bearer token in postman and then using that as a not expiring Bearer token to verify my cor

Hi all, I am using a Cdata Restapi to connect to a datasource, and it has been working fine up to now. It seems they have changed one of the fields, used for incremental loading, and this has now become too long to fit in a integer data type. I have had contact with the support team of the datasource and it seems the field had always been setup as a int64 field (not documented very well), but the value wasn't that big in the past. Now I get errors when retrieving data , stating that the field is too small. How can I adjust the field definition in TX so that it is a bigint field instead of int32? I tried with override datatype, but initially it still wants to load the data in int32. Using the TX 20.10 version, with business units and a cdata restapi connection. Has anyone experience with this? Kind regards, Jacqueline

In many of the tutorials for dealing with specific types of APIs reference is made to internal variables like {TX_CurrentPage} and others that can be leveraged to implement things like pagination. As far as I can find there does not seem to be a list of such items and what they do. Could this be made available?

I'm trying to connect to an InfluxDB source, where a POST request is expected, including flux script in the body to filter data. The output is in CSV format. I have this working in Postman, but how should I configure this in TimeXtender? Anything I try results in the error below, which also means no RSD is generated. [500] Could not execute the specified command: HTTP protocol error. 405 Method Not Allowed

Hi, I'm using the TimeXtender REST Data Source (5.0) and trying to set up pagination.Right now the relevant table from the data source contains 3999 rows.However the table should contain 4092 rows. In the API documentation I couldn't find a XPath or a header containing a link to the next page.Could someone help me with configuring the pagination in the portal. (maybe by looping over the max row count) Thank you.

Hi all, I have an api which is connecting to a restlet endpoint. trying to get this in timextender but I'm getting errors all the time. to set this up in Postman I have added a screenshot of the values i'm adding to my call, which is then added as a header to the call (see header png). Transferring this to TX gives me a 403 forbidden. I'm thinking this is because of encoding or the HMAC signing. But I have tried a lot of things but not getting the call through. Any suggestions as to how I can add a restlet with Oauth1.0? If more information is needed please let me know

Hey, I have a question about our REST API. We need to implement client certificates, similar to here in Postman: Is this possible with the new REST provider? If not, what are the steps to do it with the old one?

Hi, I am trying to parse a response using the REST connector from an API which returns a JSONROWS-format where the first row contains the name of the columns, while the following rows contain the values. The response is on the form: { "response":[ [ {"name":"test1"}, {"name":"test2"} ], [ 1, 2 ], [ 3, 4 ], [ 5, 6 ] ]} I have tried several different xPath-configurations. The following gives the correct columns, but returns zero rows:xPath: column:/response;columnname:/response.name;row:/response I was hoping that at least this would have parsed all the values as strings with the first row containing the {“name”:”testN”} in the corresponding columns. How do I work with this response?

Hi everyone, I’ve been searching but haven’t been able to find in previous threads. For an API i'm trying to extract to TX, i'm running into some issues. The API extracts some geographical building data, based on an ID. I have these ID's from a seperate source already in the warehouse. What I want to do is get the ID from the ODX-table and for each ID run a call to the API. I'm new to this scripting language and maybe im overlooking it in existing documentation but for me it seems impossible. Any idea's and suggestions would be welcome, thanks!

Hi, I'm currently connecting to a new api. https://ads-api.autotelex.com/swagger/index.html?urls.primaryName=Autotelex%20%7C%20Advertisement%20API%20V2%20(Beta) In my RSD file I call /api/v2/stock to get the ids for a stock, then I call /api/v2/stock/{adsStockId}/summary using the ids from the first call.The problem I run in to is that i can only make 300 calls per minute for the second call. Whenever I run into this limit my execute fails with the message: "Too many requests".Is there any way to limit or reduce the amount of calls I make per minute? Kind regards,Niek

Hi, I have a project that is using the cdata connector as a datasource, and because of issues with paging and nested call we have created query tables to get the correct results (using queryslicer in the rsd-files). Because of performance issues the tables have to be setup for incremental loading, but I cannot get this working because I need the incremental value in the call. Is it somehow possible to use a variable or a field from another table in the Quey tables to get the incremental value? When using a fixed date the logic is working fine (as shown below) but that's not workable: SELECT * FROM [REST].[EventRegistration_Detail] WHERE [file_name] IN (SELECT [Name] FROM [REST].[EventRegistration_List] WHERE [Properties.Last-Modified] > '2023-01-01') (using TX 20.10.30.64 with Business Units) Any good suggestions on this? Kind regards, Jacqueline

Issue: tables with paging stop loading while data is still incomplete We have an execution package with loads data from AFAS GetConnectors. There are 7 Business Units in TX, each loading data from a separate AFAS implementation. Per implementation AFAS supports up to 20 parallel connections. From this perspective the Max. Threads 10 should not be a problem. AFAS uses paging with record offset for tables that are too big to load. All Business Units have a similar set of tables. I’ll use AfasIncluzio as an example, as this one has the most data. This table is currently the only one loaded with paging TX_Financiele_Mutaties When we look at the execution log on package level, we can see that the Total Time varies per day: The AFAS API is quite stable in terms of speed. Hence I can tell that all executions under 15 minutes did not load all data. Further investigation learned that this only happens on table Tx_Financiele_Mutaties, which is currently the only one with paging. This is the Exec

Hey community, I am trying to set up pagination for my REST connector to ADP. I need to use the CData parameters $skip & $top. My first call should be: https://api.eu.adp.com/hr/v2/workers?$skip=0&$top=100 Then I need to increment the $skip parameter by 100 so the next call would be: https://api.eu.adp.com/hr/v2/workers?$skip=100&$top=100 In need to end when I receive an empty response. Anyone that has experience with this?

Hi, My client wants to connect to the App Store Connect API (https://developer.apple.com/documentation/appstoreconnectapi) but we are having trouble with getting the authorization to work. Calls to the API require JSON Web Tokens (JWT) for authorization, specifically using the “ES256” signature algorithm. We tried using the CData Rest connector but found in the documentation that “...the JWT signature algorithm cannot be set directly. Only the RS256 algorithm is supported” https://cdn.cdata.com/help/DWH/ado/pg_oauth.htm#jwt Has anyone experience connecting to the App Store Connect API?

We are struggling with nested calls in a POST API with custom body. We don't change the URI on every input, but need to change the body on every request: We use Cursor based pagination using rows@next for pagination. And as it seems you can only use one pagination per rsd, we can only get one iteration using nested calls. Query slicers only seem to be able to slice URI's (https://cdn.cdata.com/help/DWG/jdbc/pg_queryslicer.htm). In our example, we are extracting ReservationId's from a Reservation request and need them as a body input for ReservationItems in batches of 1000. Any help would be appreciated, let me know if you need anymore information.

We’re facing issues with CData REST API connector when requesting an API for a large dataset. TX sends the request, but seems to never receive a response. The execution fails when it hits the timeout limit (currently set to 3600 seconds). In the logs (verbosity 4) I see that nothing happens between the time that the request was sent and the moment of timeout. I put the same URI, headers and parameters in Azure Data Factory. After 9 minutes it receives a response of 204MB and 176K rows. In Postman, I received a response after 8 minutes. While I agree that it might be better to somehow make smaller API request. In fact, when I limit the date range to only this year, TX gets a response in about a minute. However, I still expect TX/CData to finish the request when the dataset is larger and it takes more time before the response is generated by the server. Due to NDAs I cannot post logs, RSDs or credentials here, but I’ll send some additional files via email. Tx version 20.10.39CData REST A

We have an API in which we have to pass a POST request with a request body to obtain the data. In Qlik Sense and Postman we have a basic connection established. However, there you can easily specify that the call should be a POST and you can also easily fetch the request body. In the CDATA REST connector in TX, we do not know where to fetch this request body in the connection. The demo endpoint we are trying to connect is: https://api.mews-demo.com/api/connector/v1/configuration/get with the request body: { "ClientToken": "E0D439EE522F44368DC78E1BFB03710C-D24FB11DBE31D4621C4817E028D9E1D", "AccessToken": "7059D2C25BF64EA681ACAB3A00B859CC-D91BFF2B1E3047A3E0DEC1D57BE1382", "Client": "NameOfYourCompanyOrApplication" } Any help would be appreciated.

Hello, To implement pagination in the API endpoint " https://domainname/api/v2/search/tickets?updated_since=2023-01-01T02:00:00Z&page{} ", you need to provide the page parameter in a nested format. I prepared a custom RSD file specific to this API after reading the "Nested parameter" article. I have created a loop starting from 1 in the given code. However, I'm not able to see any data. I'm not receiving any errors during the transfer and synchronization processes. You can find the RSD file attached.I would appreciate in resolving this issue.Best Regards

Hi TimeXtender I have an urgent request (!)I am trying to set up a Script action (which I will later use in a table as a post-script) that executes a POST CURL in a different tool. I have tried to execute the POST CURL in Postman and it is working.Now I want to do the same from TimeXtender. I have an URL and a Token.How can I set it up? Looking forward to hearing from you. Ismail

Hi, I am wondering if it is at all possible to use data stored in a TimeXtender table as variables in a REST API call. I have two use cases that hopefully explain what I am trying to achieve A combination of two REST API's where one requires the output of the other: The first one retrieves all possible classes that can be attended, the second one retrieves all people enrolled in such a class. But the class name is a parameter in the header. I'd like to store the class names in a table and then loop through them (not sure if that's the way to go) and request all enrolled students. A Machine Learning function In, for example, Azure Machine Learning Studio I am able to host a model using a REST API. Then, I can call the model and by inserting the parameter values I receive a predicted value. I'd like to do this in the data warehouse since it saves time compared to requesting it every time a dashboard reloads. But again, I'd need to input values from a TimeXtender table. Is there a recomme

Hi, I am using a REST API (CData source) to get source data. Is it possible to specify that you want to do a POST rather than GET in a CData source? If so is there any Guide?

Hi, We are trying to connect to a REST api and are using the JSON CData provider version 22.0.8257.0.We are connecting to two seperate datasources: Companies within Europe; Companies outside of Europe The problem with the second datasource is that the decimal seperator is mixed up.We tried some of the culture settings but it doesn’t seem to work.What is the best way to solve this?

I have been trying for quite a while to connect to an REST endpoint requiring authentication. Have gone through the the cdata documentation and various ressources on the support site. I have working setups both in postman and SSIS Script Task, but is very keen on migrating to a more native TX setup (maintainability), will be migratning several more in the time to come. The process is as follows: Get Authentication Token (HTTP POST) The POSTed information is send as ‘x-www-form-urlencoded’ in the body part (Postman) The response is a json object, containing the token in a attribute Get Actual Data using the Authentication Token (HTTP GET with token as a url parameter) The source in this case i ArcGIS, and the documentation does not mention anything about a standardised authentication scheme. Is there a way around implementing this in any of the standardised authentication schemes, or do I need to go in the direction of RSD files?Please adviceThanks in advance.

Hello, I’m using the CData ADO.NET Provider for JSON 2021 and get this error message in the logg file. [HTTP|Res: 29] HTTP/1.1 200 OK, 548950 Bytes Transferred[HTTP|Res: 29] Request completed in 6828 ms.[EXEC|Page ] Page successful: 1000 results (6844 ms) NextPage: [30000][EXEC|Messag] Executed query: [SELECT [Actualizations_id], [ActualizationType.Code],[META|Schema] Engine Invalid object name 'sys_resultset_close'[MDUL|SbMDUL] Drop BulkRows table:ErrorInfo[INFO|Connec] Executed sys_disconnect: Success: (16 ms)[INFO|Connec] Closed JSON connection The execution log file reports: Executing table [JSON].[LCSOC_EC_Actualizations]:failed with error:System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out What does it mean and what to do about it? Cheers /Reith

We have a new REST API data source that we are trying to connect to. This data source takes only an API key through the Authorization: Bearer <api_token> request header. I am using the CData ADO.NET Provider for REST 2019. I have added the API URI and the custom header (bearer token), and even selected OAuth 2.0 and added a Callback URL of http://localhost:33333. No matter what I do, it seems as though the API key is not being passed correctly. The message I get in the response is "{"message":"Invalid Token"}" and "HTTP/1.1 401 Unauthorized". I am able to connect to this data source using Postman with the Authorization: Bearer token. Can anyone give advise on specific settings for using only an API key? Thanks, Dan