Skip to main content
To homepage To homepage

Data Sources Q&A

Ask questions of about setting up data sources

156 Topics
P
Participant
pkaustubhaParticipant
asked in SAP
SAP HANA and SAP ECC with SQL/Oracle Database Connection with TimeXtender

Hi, Previously, we used SAP HANA (CDATA) connector to connect SAP HANA with TimeXtender. I understand from documentation that we can use Azure Data Factory - SAP Table and TimeXtender SAP Table Data Source for connecting with SAP HANA Data Sources.  My question is withADF- SAP Table, does customer need to have ADF Subscription/Licenses. Also if they want deployment target as SQL Server On Premise. How can we user the same, TimeXtender SAP Table Data Source - Can we use this without Theobald Connector, if yes, how to use this with SQL server On Premise.Let me know the steps and example at the earliest.  

81
rory.smith
TimeXtender Xpert
P
Participant
pkaustubhaParticipant
asked in SAP
SAP Public Cloud - TimeXtender Connection

Hi,I was able to connect with SAP Public and Private Cloud, SAP C4C (SAP CRM),  in the past using SAP Cloud for Customer (CDATA) connector which is no longer supported by TX. Please let me know on priority how we can connect to SAP Public and Private Cloud, C4C and other SAP Cloud Product using TDI.  Please let me know with new options available what connector I need to use and how I can connect above mentioned data sources with TDI. I have a demo with a prospect. Need help on priority. Also share the steps and example, if possible

60
P
Participant
J
Starter
jasperpStarter
asked in REST APIs
Passing a dynamic value as an additional column next to the output of the call it is used in?

I am using a Power BI endpoint (https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/get-refresh-history) where I need datasetIds to get the refreshes of that dataset. I am using the TimeXtender REST data provider, in which I loop over a list of dataset ids using a dynamic value. The problem is that in the output of the Get Refresh History endpoint the dataset Id is not included.Therefore, my question is: Is it possible to pass a dynamic value used in a call as an additional column next to the output of the call? I don't see any option for this in the portal. If I were to extract the data using Power BI, I would do the call for every row in a table containing the required dataset Ids and expand the resulting column. This way, the original table column containing the dataset Ids will always be related to the dataset refreshes. Can I do the same using TimeXtender?

664
M
Starter
B
Explorer
Boglarka BaranyExplorer
asked in REST APIs
API Rest Pagination for Freshdesk

Hi, is there anyone who managed to get the Freshdesk pagination working? I tried different ways but it is not working for me. Let me just describe what I did so far.trying with using Query Parameters and {TX_NextPage}, I tried using that since the freshdesk url is very easy to adjust with the page number, so I added this:My URL is:Pagination should look something like this https://[domain].freshdesk.com/api/v2/tickets?page=[number]So, I added in the connection settings first the pagination rule which looks like this:and I added the endpoint later for tickets.This didn’t work, so I tried the same but adding it in the endpoint with Override pagination rules, unfortunately that didn’t work either. Any other parameters, such as pagesize, or include-stats works, perfectly fine, but the pagination simply doesn’t. So after trying this two, I tried another way. Trying using the header link from response. The query response posts the next page link in the headers, so I tried utilizing that setu

5711
Thomas Lind
Community Manager
MartinMemelink
Contributor
MartinMemelinkContributor
posted in REST APIs
REST data source multiple XSLT tables performance test

The TimeXtender REST Data Source has the ability to add an API endpoint with table flattening in multiple ways: either adding the endpoint once with multple tables or adding the same endpoint multiple times. I've done some tests to find out which is fastest.The test was done on an API with an unstructured JSON data source, with root nodes on multiple levels where the XSLT Table Builder can iterate over. This means I needed to add 4 flattened tables on the same endpoint, each with different root nodes. Version numbers were REST provider version 9.0, TDI 6935.1, with Ingest running on and Azure VM and storage on ADLS Gen 2.Two ways of setting up the same endpoint with four tablesMy hypothisis was that 1x endpoint with 4x tables would be quicker than 4x endpoints with easch 1x table, because TimeXtender would call the API once and the multiple XSLT tansformations can happen on the same result data, rather than the API being called multiple times which would add unnecessary tansfer of data

101
Thomas Lind
Community Manager
Stijn Verhoeff
Starter
Stijn VerhoeffStarter
asked in REST APIs
Error when Importing API Swagger

We are using the new 'Import Swagger/OpenAPI’ feature in the TX REST Data Source (absolutely loving that btw), but are encountering an error.  When importing the URL for a Weather API, we receive the following error message:Error: Exception Type: Microsoft.OpenApi.Readers.Exceptions.OpenApiUnsupportedSpecVersionException Message: OpenAPI specification version '3.1.0' is not supported. So far we've had no trouble importing Open API spec 3.0.0 documentation. Is there a compatibility issue with the latest 3.1.0 spec?

1045
Thomas Lind
Community Manager
J
Contributor
juriaan.hensbroekContributor
asked in REST APIs
TX Rest Dynamic value Endpoint query

I'm using dynamic values function in the TX REST connector 9.1.0.0. I use id's from another endpoint to loop through in my second endpoint path. This works well when I use “From Endpoint Table” but now I want to add a filter to only get the id's with a flag “hasresponse=true”.I've read the page but I still get an error with my Endpoint query. “No such table” the error message says. I've tried several things like adding a schema. But all with the same response. Is there something wrong with my syntax?Error: 

332
J
Contributor
M
Starter
MvHollandStarter
asked in General
Issue using multiple BC adapters at the same time.

Hi,We are currently experiencing a problem with using multiple BC  (NAV) Adapters at the same time. The two connectors are set up with individual app registrations as one is in the same Azure Tenant as where we are kicking off the execution, and one is in a different tenant all together. When I execute these tables one at a time or one source at a time, it runs smoothly with no issues. The issue is trying to run both sources at the same time. When I try that, it gives the following error:  The connectors are set up correctly as I am able to run them seperately. Does anyone have a fix or workaround for this issue? For the record: we are on Version 20.10.44.64 and we are using Business Units. 

497
Christian Hauggaard
Community Manager
peter.jensen
TimeXtender Xpert
peter.jensenTimeXtender Xpert
asked in SAP
SAP datasphere connection

Hi,what is the best (performing) way to extract data from SAP datasphere?I read about an API connection (OData), but is this the ‘optimal’ way to do this ?https://community.sap.com/t5/technology-q-a/how-to-export-data-from-sap-datasphere-or-its-database-sap-hana-cloud-to/qaq-p/13708728https://help.sap.com/docs/SAP_DATASPHERE/43509d67b8b84e66a30851e832f66911/7a453609c8694b029493e7d87e0de60a.htmlBest Regards,Peter

140
peter.jensen
TimeXtender Xpert
anders.e.jonsson
Contributor
anders.e.jonssonContributor
asked in REST APIs
REST Data source - How to set replace value in Table builder?

Hi,I’m trying to use the transformation Set replace value in the Table Builder. Described in tutorial like this: I tried a simple SQL string function (LEFT(NodeName,5). It looks proper in the XSLT Output: The execution worked fine. No errors. But both columns PatientNameHash and PatientName produces the same result in the Ingest table. The full name.Anyone who knows how to format a transformation in Set replace value?Is the content of the template “string-replace-all” available for viewing?BRAnders

5310
anders.e.jonsson
Contributor
J
Contributor
juriaan.hensbroekContributor
posted in REST APIs
REST API with Pagination (MoreApp)

Hi all! This morning, I retrieved data with the REST API of MoreApp.com. The API is quite straightforward. I encountered some challenges that I'd like to share with you. If there’s anything incorrect in this description, please let me know so I can adjust it.PreparationI am using the TX REST connector version 7.1.0.0.You will also need an API key, which must be created by the administrator in the app.The data I need to retrieve is located at the base URL: https://api.moreapp.com/api/v1.0. The specific data I am fetching is "submissions," or filled-out surveys. The POST API used to fetch this data is structured as follows:https://api.moreapp.com/api/v1.0/customers/{customerId}/forms/{formId}/submissions/filter/{page}Customer is fixed. FormId needs to be looked up. Page is required for pagination.Authentication is achieved by including the X-Api-Key in the header.Step 1 – Retrieve the correct FormIdsYou can do this via Postman or TimeXtender. It is a simple GET API:https://api.moreapp.co

1111
J
Contributor
B
Contributor
bjornContributor
asked in General
Snowflake as data source

Hi,I need to connect to Snowflake as a data source.I have downloaded the latest odbc version for windows from https://www.snowflake.com/en/developers/downloads/odbc/ and installed the provider.From XPilot I get an answer how to configure the odbc data source, but I cant find the “Private Key” field in no 4. That field seem to be “missing” in the config dialog.  Step 3: Configure the ODBC Data Source with the Private KeyOpen the ODBC Data Source Administrator Application and go to the System DSN tab. Press "Add" and select SnowflakeDSIIDriver. Click Finish. In the Snowflake Configuration Dialog, provide a name for the data source. Enter the connection details: User: The Snowflake user name. Private Key: The path to the rsa_key.pem file. Database, Schema, Warehouse: Specify the database, schema, and warehouse. Tracing: Set to 0. Test the connection to ensure it is successful. Press OK. Any suggestion on this? Where should I to put the filepath?regards,Bjørn A.

986
B
Contributor
Pontus Olausson
Contributor
Pontus OlaussonContributor
asked in REST APIs
How to Handle 400 Errors in TimeXtender REST Data Source with Dynamic Values?

Hi,We are using a REST data source with dynamic values to fetch data for approximately 12,000 records, where each record corresponds to an individual API call.Occasionally, we encounter issues with the API provider where some calls return a 400 error. Unfortunately, it’s unpredictable which dynamic values will cause these errors.Currently, it appears that the TimeXtender REST data source stops processing upon encountering a 400 error, resulting in a "Completed with errors" status.Is there a way to configure the REST data source to continue processing the remaining dynamic values, skipping over those that result in a 400 error? Ideally, it would also log the calls that failed for review. Best regards,Pontus

765
Thomas Lind
Community Manager
G
Visitor
gislihbVisitor
asked in ODBC
Connect to MongoDB

I'm trying to connect to MongoDB and load data  into Timextender I have a ODBC driver setup, and test connection works. In Timextender I have ODBC Generic Data setup, and test connection works and to Synchronize Data Source works as well.But when I try to execute the data transfer from MongoDB into Timextender then I get an error.  

1013
peter.jensen
TimeXtender Xpert
J
Starter
JakubStarter
asked in General
Empty data source provider list

Hi, I’m trying to add new data source provider but it looks like all of them dissapeared. Last week everithing works well. Licence is active, I using version 2.10.36.64. Any idea about the root cause?

1064
Christian Hauggaard
Community Manager
S
Explorer
Stijn HensenExplorer
asked in General
Unable to add new CData Data Source

Hello,I understand support for CData has been removed, see However, we cannot use existing drivers anymore either, as we don’t have the option anymore to add a CData Data Source via ODX.  If we click on Add Data Source, we only see some standard data sources, no CData drivers anymore.  If we click on Manage Data Source Providers, we do see the installed CData drivers. We use a lot of different Sharepoint connections to import certain data, and we cannot create a new Sharepoint connection now, without upgrading.  How can we add a CData Data Source now?  Upgrading of the client is currently not possible. This is a blocking issue!  How can we still add a CData data source?Thanks,Stijn Hensen

531
Christian Hauggaard
Community Manager
anders.e.jonsson
Contributor
anders.e.jonssonContributor
posted in REST APIs
Hooray for TimeXtender's REST Data source

HI,For the first time in my life, I have enjoyed working with a REST API 😁.It is actually a pleasure to use TimeXtender's new REST data source now.Swagger import, Dynamic values, Table builder etc.There will be more to be desired of course, but hats off to the developers who built it and to Thomas who have made tutorials that are comprehensive and easy to understand.Nice job! 🎉BRAndersP.S. It feels good to be undividedly positive once in a while too 😊

360
anders.e.jonsson
Contributor
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in General
Microsoft Dataverse Connector

I cannot see it in the Data Source Providers:Can you give me a setup guide? 

913
Christian Hauggaard
Community Manager
X
Contributor
Xiaoqing HuContributor
asked in General
Connect to JSON data source via api possible on on-prem but not cloud

Hello,With TimeXtender business unit on prem at an internal server, we were able to call an API via below settings, and load the data successfully.  However, when we set up the same data source on TimeXtender Portal with basically the same setting. The data source tested either timeout or with error ‘Exception has been thrown by the target of an invocation.’, or connection tested okay but no metadata can be imported/synced. I have tried all below connection types but couldn’t get it work. Do you know why (for example to setup firewall or proxy) or have any advice? Thanks in advance. 

362
Christian Hauggaard
Community Manager
J
Contributor
jarleContributor
asked in RSD File Customization
rsd file definition for adding tables to Cdata QuickBooks Online data source

The Cdata data source for QuickBooks Online doesn’t have all the endpoints in the API available. For instance TaxPayments is missing. (https://developer.intuit.com/app/developer/qbo/docs/api/accounting/all-entities/taxpayment)It is possible to add rsd-files to the file folder in order to get additional tables when synchronizing data. However, there is no sample rsd-file available, and no obvious way to generate schema file. I have tried to copy a rsd file from a REST connector, but then I get the error message when trying to preview: “The operation ‘jsonproviderGet’ could not be found”

8911
Thomas Lind
Community Manager
E
Starter
EivindJStarter
asked in REST APIs
Rest API with text/plain response

Hello,I'm working with a REST API where the response is a valid JSON but has a Content-Type: text/plain. The response looks like this:[{"OrderId":"46D2A6BD-8B34-4F55-B816-B90017CDBA28","OrderNumber":131,"DeviceId":"POS41232","VendorId":1,"VendorName":"Test Facility","StoreId":114}]However, the log shows the following:2025-01-10T15:33:16.340+01:00    2    [1|Q-Id]    [HTTP|Res: 0] HTTP/1.1 200 OK, 1615 Bytes Transferred2025-01-10T15:33:16.340+01:00    2    [1|Q-Id]    [HTTP|Res: 0] Request completed in 676 ms.2025-01-10T15:33:16.344+01:00    3    [1|Q-Id]    [META|Schema: JSONValidation] https://pos.no/getsales is not a valid JSON resource.2025-01-10T15:33:16.345+01:00    3    [1|Q-Id]    [META|Schema: JSONValidation] Invalid JSON markup. Expected json, but instead found [text/plain; charset=utf-8]. To attempt to fix this, I set Accept: application/json in the request headers, but this results in a response wrapped in a string, like this:"[{\"OrderId\":\"46D2A6BD-8B34-4F55-B816-B90017CD

1054
E
Starter
B
Contributor
BennyContributor
asked in REST APIs
REST connector cashing folder contains a data_.raw and a data_.xml. The result is no data

Hello, I want to get metadate from my Azure datalake using their Blob API. I wasn't seeing any data in the Ingest storage so I turned on cashing to file, to try to see what's happening.  There are three files in my cashing folder: Data_.raw: The return of the call, i.e. my actual data. This look excellent, except that it's a .raw file. Contents: <?xml version="1.0" encoding="utf-8"?><EnumerationResults ServiceEndpoint="https://xxxx.blob.core.windows.net/" ContainerName="datalake"> <Prefix>my_prefix</Prefix> <Blobs> <Blob> .... </Blob> </Blobs> <NextMarker/></EnumerationResults>   Data_.xml: Basically the same as the Data_.raw, but with the content of Data_.raw as the data of a value-element. The data also contains the XML header (so now the document has two headers) and the brackets have been encoded (i.e. all the `<` are now `<`).  <?xml version="1.0" encoding="utf-8"?><Table_flattening_name

725
Thomas Lind
Community Manager
R
Participant
Remy Kamphuis | VictaParticipant
asked in RSD File Customization
RSD file referencing field from ParentTablePath

Hi all,I have an API that uses nested XML to deliver the data. I have used a relational model to be able to retrieve this data in separate tables. Based on key fields that are created I am able to join the tables back together. All works fine, however, I want to reference a (different) field from my parenttable in a nested table. Currently, the output adds a field _id in my parenttable PerformanceInfoRow to be able to reference the underlying data back to the specific period. However, this _id contains an integer. Daily I will get three rows of data and daily I will thus get back the _ids 1, 2 and 3. So, in the end this will not be a unique key when retrieving more days of data. Therefore, I want to specify the Period that also is available in the parenttable, which is unique since it will not only show the date but also whether it is morning, afternoon or evening. This will be unique, but unfortunately I am not able to add this field to the underlying tables. I have tried to adjust my

889
Christian Hauggaard
Community Manager
X
Contributor
Xiaoqing HuContributor
asked in General
Error loading csv from Azure Blob Storage or Azure File Share

Hi everyone, We are trying to load csv file from Azure Blob Storage or Azure File Share with the guidance according to the posts below. But we are still receiving error: “Exception has been thrown by the target of an invocation.”Connect to CSV data sources | CommunityLoad CSV files from Azure Blob Storage | CommunityKindly see the connection details below. Could you help give some advice? Thank you! For Azure Blob StorageFor Azure File Share 

603
X
Contributor
J
Contributor
jarleContributor
asked in RSD File Customization
Nested rsd file with paging not working

I have issue with getting details from forms based on a list of formsList of forms: https://api.goformz.com/v2/formzForm details: https://api.goformz.com/v2/formz/formIdBoth nested query and pagination works seperately, but I struggle to get it work with both of them. I have tried the solution in the linked case below, but I get stuck on the same place as the user in that case:The query table is running for approximately correct time (which indicates it is reading the correct amount of data), but no data is going into the SQL-table.The query is this simple: SELECT fields,formId FROM REST.Formz_DataPerFormWHERE Nested_Id IN (SELECT formId FROM REST.formz_WithDateFilter)Is it possible to get this working?  

10211
J
Contributor

Badge winners

  • Innovator
    oscarclevehas earned the badge Innovator
  • Certified Solutions Architect
    leo.noharethas earned the badge Certified Solutions Architect
  • Innovator
    Bernarddbhas earned the badge Innovator
  • Certified Solutions Architect
    JeroenStahas earned the badge Certified Solutions Architect
  • Ingest Expert
    nmohas earned the badge Ingest Expert
Show all badges
Terms and ConditionsCookie settings