Skip to main content
To homepage To homepage

Data Sources Q&A

Ask questions of about setting up data sources

168 Topics
M
Explorer
MvestExplorer
asked in REST APIs
Error handling 500 errors from dynamic endpoint

I’m using TimeXtender REST Data Source v10.2.0.0 with two endpoints: A static endpoint that returns a list of IDs. A dynamic endpoint that retrieves additional data for those IDs. The problem is that not all IDs from the first endpoint exist in the second. When the dynamic endpoint tries a ‘non-existent ID’, the API returns a 500 server error, stopping the data transfer.This is an external API, so I have no control over it. From what I can see, the datasource provider doesn’t offer error handling (like try/catch or “skip if failed”).I could create a curated list of valid IDs, but there are thousands of IDs that can change at any time, making this impractical. I could also ask the API provider to return empty JSONs instead of errors, but I’d prefer to handle it on my side.Any advice?

110
M
Explorer
B
Contributor
bjornContributor
asked in REST APIs
Table flattening - Order/OrderLines

Hi,I got this structure(see below) from my rest api and I need to add order_id into each line of order_line. How can I flatten out order_lines with the order_id? I have tryed different  ways, but when I have two order lines only one get the right order_id value…. Order/Orderlinesbest regards,Bjørn A.

343
B
Contributor
L
Contributor
Leo RogemanContributor
asked in REST APIs
MixPanel TX Rest API JSONL

Hi, I’m trying to connect to a API using Timextender REST version 7.1.0.0 but my result is only one row of data. In Postman I get much more data. It might be because the API returns JSONL and TX tries to handle it as JSON. I’m trying to convert it to Text but it still doesn’t work.  Earlier I managed to complete the goal in Power Query even with pagination.  Now I’ve hit a brick wall and I need your help to proceed. My result in ODX:  My result in Postman:Here’s my connection profile:{  "Name": "MixPanel",  "Description": "",  "Provider": {    "TemplateId": "d4aa4001-fd7b-4c65-b76d-f9710d551c1e",    "DisplayName": "TimeXtender REST",    "ProviderVersion": "7.1.0.0",    "X64BitVersion": true,    "ProviderType": 6  },  "RestProperties": {    "Pills": [      {        "Name": "Authentication",        "Description": "Configure authentication settings to securely access the API using tokens, keys, or other credentials.",        "Id": "rest-general-authentication",        "IsSelected": true 

5311
L
Contributor
L
Participant
luuk.boumanParticipant
asked in REST APIs
Almost empty records on API endpoint call

Hi,We're observing strange behavior with the new enhanced REST data source provider.When we do the call on this endpoint in the old connector or in Postman, we get a return of 197 records. This is a single payload, 1 page, with fully filled rows, including a populated PK field.Now, when we do the same call with the enhanced REST data source provider we receive 589 records. 392 of these have null values on all records except for one field, a descriptive but not otherwise important. Importantly the PK field of these records is also null.Now we have two questions: Why is the new REST provider delivering more records than other providers/tools? How can we effectively filter out these records in the actual call? As it seems we are now only able to successfully filter out these almost empty records at the DSA.Best, Luuk 

7714
L
Participant
J
Contributor
juriaan.hensbroekContributor
asked in REST APIs
TX Rest Dynamic value Endpoint query

I'm using dynamic values function in the TX REST connector 9.1.0.0. I use id's from another endpoint to loop through in my second endpoint path. This works well when I use “From Endpoint Table” but now I want to add a filter to only get the id's with a flag “hasresponse=true”.I've read the page but I still get an error with my Endpoint query. “No such table” the error message says. I've tried several things like adding a schema. But all with the same response. Is there something wrong with my syntax?Error: 

26618
J
Contributor
L
Contributor
Leo RogemanContributor
asked in General
How to load data from an XML-RPC API (Odoo)?

Hello,I'm trying to load data from an Odoo system that only exposes an XML-RPC API (no REST or SOAP). I want to bring this data into TimeXtender Portal, but I’m working under a few constraints: I do not have TimeXtender Premium, so I can't use custom scripts or PowerShell. I don’t want to introduce any external tools like Python wrappers or middleware. I can successfully call the XML-RPC API in Postman and retrieve data. I'm looking for a way to either automate or streamline this process without Premium features or external software. I’ve considered the XML data source, but it seems incompatible with XML-RPC since it doesn’t support HTTP POST or dynamic method calls.Has anyone found a way to work with XML-RPC APIs in TimeXtender under these limitations, or automated a file-based import process from tools like Postman?Any suggestions or workarounds would be appreciated.Let me know if you want to see the xml script. 

5913
Thomas Lind
Community Manager
M
Starter
matthieu.carratStarter
asked in General
Data source : Table/Field renaming in data source (Display Name)

Dear All, We have a “Dynamics Business Central (NAV)” data source with multiple adapters (multiple ERPs). We recently needed to “synchronize” the object to get the last BC evolution (new fields, ...). Unfortunately, the “Display name” of some tables/fields changed. 😒 Ex:-“Lot”“Lot No_ Information” table is now named “Lot No. Information” -“Demand Forecast”“Production Forecast Entry” table is now named “Demand Forecast Entry” Our default was to use “Display Name” (instead of Database Name) in the data selection and staging deployment. Our main concern is our significant number of sql views associated to these selected tables/fields with “hardcoded” name. We know that is recommended to use parameters to avoid problem with renaming but we didn’t implement the params in this case missing time and practicality with the sql code. 😥 Do we have an alternative solution without significant adjustments in our tables/fields selections and associated staging sql custom views ? TXT version: OnPrem

402
M
Starter
T
Starter
Tim TurnerStarter
asked in General
Excel Connector beyond 256 COlumns

Hello,We have a case in TimeXtender Classic where we need to read more than 256 Columns from the Excel connector.My understanding is that the underlying driver does support it, but by default it will only Return the first 256 Columns, and thus that is all we see when reading objects from the DataSource.Does anyone know if there is a way to expose more columns beyond the 256 already shown?ThanksTim

434
T
Starter
J
Starter
JDDOmniStarter
asked in REST APIs
Converting CDATA AD connector to Timextender REST

Hi,I've got a couple of installations with customers using CDATA for AD/Entra integration, with the upgrade I found an article to advise moving them to REST.I am however a bit lost on how to connect a REST API to Entra, and I couldn't find good documentation to fill it in.Could someone assist us for a moment or maybe point us toward more complete documentation specifically on using the Enhanced Data Source to connect to Entra?  Thanks in advance, Jan DD

202
J
Starter
Pontus Olausson
Contributor
Pontus OlaussonContributor
asked in REST APIs
How to Handle 400 Errors in TimeXtender REST Data Source with Dynamic Values?

Hi,We are using a REST data source with dynamic values to fetch data for approximately 12,000 records, where each record corresponds to an individual API call.Occasionally, we encounter issues with the API provider where some calls return a 400 error. Unfortunately, it’s unpredictable which dynamic values will cause these errors.Currently, it appears that the TimeXtender REST data source stops processing upon encountering a 400 error, resulting in a "Completed with errors" status.Is there a way to configure the REST data source to continue processing the remaining dynamic values, skipping over those that result in a 400 error? Ideally, it would also log the calls that failed for review. Best regards,Pontus

1186
J
Contributor
R
Starter
Robbert_TStarter
asked in REST APIs
Pagination for REST API Azure active directory

Hi,I'd like to make a new data source connection using REST to connect with our Azure storage table.Thus far I have managed to get the connection setup, however pagination remains a issue.When testing our connection and following the steps in the debug logging file I see that when a table has a next: "x-ms-continuation-NextPartitionKey” and "x-ms-continuation-NextRowKey” it will return this in the header (not the body). But if the table doesn't have this it will stop since the "x-ms-continuation-NextPartitionKey” header was not found.As I am applying these pagination parameters as query parameter I need to be able to solve this issue.Is there maybe a way to apply a default value to these variables (manipulating query doesn't work as the variable itself already won't be found) or some way to dynamically replace a URL? Example table with no NextPartition/rowkey:When variable value replaced with default:Thanks for any input someone can provide.Kind regards,Robbert

844
R
Starter
hugo.winkelhorst
Participant
hugo.winkelhorstParticipant
asked in REST APIs
Add a dynamic value to a table flattening of a REST API

Is it possible to add the dynamic values used in a nested call to a table flattening.In this particular case the first call gets the list of documents and feed the id as a dynamic value to the 2nd call. The response doesn't include any reference to the document and without the id we cannot link the details to a document. I've tried to add it as a static node (name: Document_ID  value {id})but that only results in errors.  

1319
Thomas Lind
Community Manager
rbrandsma
Contributor
rbrandsmaContributor
asked in General
Prod execution fails after changing names in a table in Dev

Hi!Recently I have helped a customer upgrade their TX environment to version 20.10.66.64. With this upgrade it was advised to switch from an ODX setup to Business Units. So we recreated all datasources in the BUs and chose to set up just 1 BU for a datasource to service both Dev & Prod. Now the customer had to rename 2 column names in a table in the datawarehouse DSA on Dev. The next morning the execution package for Prod had halted with an error message stating there were 2 invalid column names. It could not find the 2 new columns. Performed a deploy on Prod and it ran normally. The next morning the Dev environment had not finished because of an error. There were 2 invalid column names, but this time the error message mentioned the old/original column names. We think the cause for this is in using only 1 BU for both Dev and Prod. And see 2 kinds of solutions Use 2 BUs, which would result in Using 2x as much data storage Retrieving data from the original sources 2 times to retriev

284
rory.smith
TimeXtender Xpert
J
Visitor
Joop van der LindenVisitor
posted in REST APIs
Json data, using GraphQl connector, return an error.

I need some help retrieving JSON data via GraphQl.When testing the connection in TimeXtender, I got a "Connection OK" message.After Synchronizing Data Source in TimeXtender an error message is displayed :   System.Data.CData.GraphQL.GraphQLDataReader ExecuteDataReader(System.Data.CommandBehavior)  [500] Could not execute the specified command: The defined query is null. : "UserViews"."query"  System.Data.CData.GraphQL.GraphQLDataReader ExecuteDataReader(System.Data.CommandBehavior)  [500] Could not execute the specified command: The defined query is null. : "UserViews"."variables"==========================================================================================================================We received the following connection string from our IT department--------------------------------------------------------------------------------------------------------------------------curl --location 'https://xxxxxxxxxx.com/um/users/graphql' \--header 'accept: */*' \--header 'Referer: h

61
Thomas Lind
Community Manager
B
Participant
Boglarka BaranyParticipant
asked in REST APIs
API Rest Pagination for Freshdesk

Hi, is there anyone who managed to get the Freshdesk pagination working? I tried different ways but it is not working for me. Let me just describe what I did so far.trying with using Query Parameters and {TX_NextPage}, I tried using that since the freshdesk url is very easy to adjust with the page number, so I added this:My URL is:Pagination should look something like this https://[domain].freshdesk.com/api/v2/tickets?page=[number]So, I added in the connection settings first the pagination rule which looks like this:and I added the endpoint later for tickets.This didn’t work, so I tried the same but adding it in the endpoint with Override pagination rules, unfortunately that didn’t work either. Any other parameters, such as pagesize, or include-stats works, perfectly fine, but the pagination simply doesn’t. So after trying this two, I tried another way. Trying using the header link from response. The query response posts the next page link in the headers, so I tried utilizing that setu

17215
B
Participant
P
Participant
pkaustubhaParticipant
asked in SAP
SAP Public Cloud - TimeXtender Connection

Hi,I was able to connect with SAP Public and Private Cloud, SAP C4C (SAP CRM),  in the past using SAP Cloud for Customer (CDATA) connector which is no longer supported by TX. Please let me know on priority how we can connect to SAP Public and Private Cloud, C4C and other SAP Cloud Product using TDI.  Please let me know with new options available what connector I need to use and how I can connect above mentioned data sources with TDI. I have a demo with a prospect. Need help on priority. Also share the steps and example, if possible

261
Christian Hauggaard
Community Manager
M
Starter
MvHollandStarter
asked in General
Issue using multiple BC adapters at the same time.

Hi,We are currently experiencing a problem with using multiple BC  (NAV) Adapters at the same time. The two connectors are set up with individual app registrations as one is in the same Azure Tenant as where we are kicking off the execution, and one is in a different tenant all together. When I execute these tables one at a time or one source at a time, it runs smoothly with no issues. The issue is trying to run both sources at the same time. When I try that, it gives the following error:  The connectors are set up correctly as I am able to run them seperately. Does anyone have a fix or workaround for this issue? For the record: we are on Version 20.10.44.64 and we are using Business Units. 

668
M
Starter
G
Visitor
gislihbVisitor
asked in ODBC
Connect to MongoDB

I'm trying to connect to MongoDB and load data  into Timextender I have a ODBC driver setup, and test connection works. In Timextender I have ODBC Generic Data setup, and test connection works and to Synchronize Data Source works as well.But when I try to execute the data transfer from MongoDB into Timextender then I get an error.  

1214
peter.jensen
TimeXtender Xpert
P
Participant
pkaustubhaParticipant
asked in SAP
SAP HANA and SAP ECC with SQL/Oracle Database Connection with TimeXtender

Hi, Previously, we used SAP HANA (CDATA) connector to connect SAP HANA with TimeXtender. I understand from documentation that we can use Azure Data Factory - SAP Table and TimeXtender SAP Table Data Source for connecting with SAP HANA Data Sources.  My question is withADF- SAP Table, does customer need to have ADF Subscription/Licenses. Also if they want deployment target as SQL Server On Premise. How can we user the same, TimeXtender SAP Table Data Source - Can we use this without Theobald Connector, if yes, how to use this with SQL server On Premise.Let me know the steps and example at the earliest.  

401
rory.smith
TimeXtender Xpert
J
Starter
jasperpStarter
asked in REST APIs
Passing a dynamic value as an additional column next to the output of the call it is used in?

I am using a Power BI endpoint (https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/get-refresh-history) where I need datasetIds to get the refreshes of that dataset. I am using the TimeXtender REST data provider, in which I loop over a list of dataset ids using a dynamic value. The problem is that in the output of the Get Refresh History endpoint the dataset Id is not included.Therefore, my question is: Is it possible to pass a dynamic value used in a call as an additional column next to the output of the call? I don't see any option for this in the portal. If I were to extract the data using Power BI, I would do the call for every row in a table containing the required dataset Ids and expand the resulting column. This way, the original table column containing the dataset Ids will always be related to the dataset refreshes. Can I do the same using TimeXtender?

844
M
Contributor
MartinMemelink
Contributor
MartinMemelinkContributor
posted in REST APIs
REST data source multiple XSLT tables performance test

The TimeXtender REST Data Source has the ability to add an API endpoint with table flattening in multiple ways: either adding the endpoint once with multple tables or adding the same endpoint multiple times. I've done some tests to find out which is fastest.The test was done on an API with an unstructured JSON data source, with root nodes on multiple levels where the XSLT Table Builder can iterate over. This means I needed to add 4 flattened tables on the same endpoint, each with different root nodes. Version numbers were REST provider version 9.0, TDI 6935.1, with Ingest running on and Azure VM and storage on ADLS Gen 2.Two ways of setting up the same endpoint with four tablesMy hypothisis was that 1x endpoint with 4x tables would be quicker than 4x endpoints with easch 1x table, because TimeXtender would call the API once and the multiple XSLT tansformations can happen on the same result data, rather than the API being called multiple times which would add unnecessary tansfer of data

311
Thomas Lind
Community Manager
Stijn Verhoeff
Explorer
Stijn VerhoeffExplorer
asked in REST APIs
Error when Importing API Swagger

We are using the new 'Import Swagger/OpenAPI’ feature in the TX REST Data Source (absolutely loving that btw), but are encountering an error.  When importing the URL for a Weather API, we receive the following error message:Error: Exception Type: Microsoft.OpenApi.Readers.Exceptions.OpenApiUnsupportedSpecVersionException Message: OpenAPI specification version '3.1.0' is not supported. So far we've had no trouble importing Open API spec 3.0.0 documentation. Is there a compatibility issue with the latest 3.1.0 spec?

1325
Thomas Lind
Community Manager
peter.jensen
TimeXtender Xpert
peter.jensenTimeXtender Xpert
asked in SAP
SAP datasphere connection

Hi,what is the best (performing) way to extract data from SAP datasphere?I read about an API connection (OData), but is this the ‘optimal’ way to do this ?https://community.sap.com/t5/technology-q-a/how-to-export-data-from-sap-datasphere-or-its-database-sap-hana-cloud-to/qaq-p/13708728https://help.sap.com/docs/SAP_DATASPHERE/43509d67b8b84e66a30851e832f66911/7a453609c8694b029493e7d87e0de60a.htmlBest Regards,Peter

370
peter.jensen
TimeXtender Xpert
anders.e.jonsson
Contributor
anders.e.jonssonContributor
asked in REST APIs
REST Data source - How to set replace value in Table builder?

Hi,I’m trying to use the transformation Set replace value in the Table Builder. Described in tutorial like this: I tried a simple SQL string function (LEFT(NodeName,5). It looks proper in the XSLT Output: The execution worked fine. No errors. But both columns PatientNameHash and PatientName produces the same result in the Ingest table. The full name.Anyone who knows how to format a transformation in Set replace value?Is the content of the template “string-replace-all” available for viewing?BRAnders

7710
anders.e.jonsson
Contributor
J
Contributor
juriaan.hensbroekContributor
posted in REST APIs
REST API with Pagination (MoreApp)

Hi all! This morning, I retrieved data with the REST API of MoreApp.com. The API is quite straightforward. I encountered some challenges that I'd like to share with you. If there’s anything incorrect in this description, please let me know so I can adjust it.PreparationI am using the TX REST connector version 7.1.0.0.You will also need an API key, which must be created by the administrator in the app.The data I need to retrieve is located at the base URL: https://api.moreapp.com/api/v1.0. The specific data I am fetching is "submissions," or filled-out surveys. The POST API used to fetch this data is structured as follows:https://api.moreapp.com/api/v1.0/customers/{customerId}/forms/{formId}/submissions/filter/{page}Customer is fixed. FormId needs to be looked up. Page is required for pagination.Authentication is achieved by including the X-Api-Key in the header.Step 1 – Retrieve the correct FormIdsYou can do this via Postman or TimeXtender. It is a simple GET API:https://api.moreapp.co

2221
J
Contributor

Badge winners

Show all badges
Terms and ConditionsCookie settings