Data Sources Q&A

Hi, is there anyone who managed to get the Freshdesk pagination working? I tried different ways but it is not working for me. Let me just describe what I did so far.trying with using Query Parameters and {TX_NextPage}, I tried using that since the freshdesk url is very easy to adjust with the page number, so I added this:My URL is:Pagination should look something like this https://[domain].freshdesk.com/api/v2/tickets?page=[number]So, I added in the connection settings first the pagination rule which looks like this:and I added the endpoint later for tickets.This didn’

Hi,I was able to connect with SAP Public and Private Cloud, SAP C4C (SAP CRM),  in the past using SAP Cloud for Customer (CDATA) connector which is no longer supported by TX. Please let me know on priority how we can connect to SAP Public and Private Cloud, C4C and other SAP Cloud Product using TDI.  Please let me know with new options available what connector I need to use and how I can connect above mentioned data sources with TDI. I have a demo with a prospect. Need help on priority. Also share the steps and example, if possible

Hi,We are currently experiencing a problem with using multiple BC  (NAV) Adapters at the same time. The two connectors are set up with individual app registrations as one is in the same Azure Tenant as where we are kicking off the execution, and one is in a different tenant all together. When I execute these tables one at a time or one source at a time, it runs smoothly with no issues. The issue is trying to run both sources at the same time. When I try that, it gives the following error:  The connectors are set up correctly as I am able to run them seperately. Does anyone have a fix or workaround for this issue? For the record: we are on Version 20.10.44.64 and we are using Business Units. 

Hi, Previously, we used SAP HANA (CDATA) connector to connect SAP HANA with TimeXtender. I understand from documentation that we can use Azure Data Factory - SAP Table and TimeXtender SAP Table Data Source for connecting with SAP HANA Data Sources.  My question is withADF- SAP Table, does customer need to have ADF Subscription/Licenses. Also if they want deployment target as SQL Server On Premise. How can we user the same, TimeXtender SAP Table Data Source - Can we use this without Theobald Connector, if yes, how to use this with SQL server On Premise.Let me know the steps and example at the earliest.  

I am using a Power BI endpoint (https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/get-refresh-history) where I need datasetIds to get the refreshes of that dataset. I am using the TimeXtender REST data provider, in which I loop over a list of dataset ids using a dynamic value. The problem is that in the output of the Get Refresh History endpoint the dataset Id is not included.Therefore, my question is: Is it possible to pass a dynamic value used in a call as an additional column next to the output of the call? I don't see any option for this in the portal. If I were to extract the data using Power BI, I would do the call for every row in a table containing the required dataset Ids and expand the resulting column. This way, the original table column containing the dataset Ids will always be related to the dataset refre

The TimeXtender REST Data Source has the ability to add an API endpoint with table flattening in multiple ways: either adding the endpoint once with multple tables or adding the same endpoint multiple times. I've done some tests to find out which is fastest.The test was done on an API with an unstructured JSON data source, with root nodes on multiple levels where the XSLT Table Builder can iterate over. This means I needed to add 4 flattened tables on the same endpoint, each with different root nodes. Version numbers were REST provider version 9.0, TDI 6935.1, with Ingest running on and Azure VM and storage on ADLS Gen 2.Two ways of setting up the same endpoint with four tablesMy hypothisis was that 1x endpoint with 4x tables would be quicker than 4x endpoints with easch 1x table, because TimeXtender woul

We are using the new 'Import Swagger/OpenAPI’ feature in the TX REST Data Source (absolutely loving that btw), but are encountering an error.  When importing the URL for a Weather API, we receive the following error message:Error: Exception Type: Microsoft.OpenApi.Readers.Exceptions.OpenApiUnsupportedSpecVersionException Message: OpenAPI specification version '3.1.0' is not supported. So far we've had no trouble importing Open API spec 3.0.0 documentation. Is there a compatibility issue with the latest 3.1.0 spec?

Hi,what is the best (performing) way to extract data from SAP datasphere?I read about an API connection (OData), but is this the ‘optimal’ way to do this ?https://community.sap.com/t5/technology-q-a/how-to-export-data-from-sap-datasphere-or-its-database-sap-hana-cloud-to/qaq-p/13708728https://help.sap.com/docs/SAP_DATASPHERE/43509d67b8b84e66a30851e832f66911/7a453609c8694b029493e7d87e0de60a.htmlBest Regards,Peter

Hi,I’m trying to use the transformation Set replace value in the Table Builder. Described in tutorial like this: I tried a simple SQL string function (LEFT(NodeName,5). It looks proper in the XSLT Output: The execution worked fine. No errors. But both columns PatientNameHash and PatientName produces the same result in the Ingest table. The full name.Anyone who knows how to format a transformation in Set replace value?Is the content of the template “string-replace-all” available for viewing?BRAnders

Hi all! This morning, I retrieved data with the REST API of MoreApp.com. The API is quite straightforward. I encountered some challenges that I'd like to share with you. If there’s anything incorrect in this description, please let me know so I can adjust it.PreparationI am using the TX REST connector version 7.1.0.0.You will also need an API key, which must be created by the administrator in the app.The data I need to retrieve is located at the base URL: https://api.moreapp.com/api/v1.0. The specific data I am fetching is "submissions," or filled-out surveys. The POST API used to fetch this data is structured as follows:https://api.moreapp.com/api/v1.0/customers/{customerId}/forms/{formId}/submissions/filter/{page}Customer is fixed. FormId needs to be looked up. Page is required for pagination.Aut

Hi,I need to connect to Snowflake as a data source.I have downloaded the latest odbc version for windows from https://www.snowflake.com/en/developers/downloads/odbc/ and installed the provider.From XPilot I get an answer how to configure the odbc data source, but I cant find the “Private Key” field in no 4. That field seem to be “missing” in the config dialog.  Step 3: Configure the ODBC Data Source with the Private KeyOpen the ODBC Data Source Administrator Application and go to the System DSN tab. Press "Add" and select SnowflakeDSIIDriver. Click Finish. In the Snowflake Configuration Dialog, provide a name for the data source. Enter the connection detail

Hi, I’m trying to add new data source provider but it looks like all of them dissapeared. Last week everithing works well. Licence is active, I using version 2.10.36.64. Any idea about the root cause?

Hello,I understand support for CData has been removed, see However, we cannot use existing drivers anymore either, as we don’t have the option anymore to add a CData Data Source via ODX.  If we click on Add Data Source, we only see some standard data sources, no CData drivers anymore.  If we click on Manage Data Source Providers, we do see the installed CData drivers. We use a lot of different Sharepoint connections to import certain data, and we cannot create a new Sharepoint connection now, without upgrading.  How can we add a CData Data Source now?  Upgrading of the client is currently not possible. This is a blocking issue!  How can we still add a CData data source?Thanks,Stij

HI,For the first time in my life, I have enjoyed working with a REST API 😁.It is actually a pleasure to use TimeXtender's new REST data source now.Swagger import, Dynamic values, Table builder etc.There will be more to be desired of course, but hats off to the developers who built it and to Thomas who have made tutorials that are comprehensive and easy to understand.Nice job! 🎉BRAndersP.S. It feels good to be undividedly positive once in a while too 😊

I cannot see it in the Data Source Providers:Can you give me a setup guide? 

Hello,With TimeXtender business unit on prem at an internal server, we were able to call an API via below settings, and load the data successfully.  However, when we set up the same data source on TimeXtender Portal with basically the same setting. The data source tested either timeout or with error ‘Exception has been thrown by the target of an invocation.’, or connection tested okay but no metadata can be imported/synced. I have tried all below connection types but couldn’t get it work. Do you know why (for example to setup firewall or proxy) or have any advice? Thanks in advance. 

The Cdata data source for QuickBooks Online doesn’t have all the endpoints in the API available. For instance TaxPayments is missing. (https://developer.intuit.com/app/developer/qbo/docs/api/accounting/all-entities/taxpayment)It is possible to add rsd-files to the file folder in order to get additional tables when synchronizing data. However, there is no sample rsd-file available, and no obvious way to generate schema file. I have tried to copy a rsd file from a REST connector, but then I get the error message when trying to preview: “The operation ‘jsonproviderGet’ could not be found”

Hello,I'm working with a REST API where the response is a valid JSON but has a Content-Type: text/plain. The response looks like this:[{"OrderId":"46D2A6BD-8B34-4F55-B816-B90017CDBA28","OrderNumber":131,"DeviceId":"POS41232","VendorId":1,"VendorName":"Test Facility","StoreId":114}]However, the log shows the following:2025-01-10T15:33:16.340+01:00    2    [1|Q-Id]    [HTTP|Res: 0] HTTP/1.1 200 OK, 1615 Bytes Transferred2025-01-10T15:33:16.340+01:00    2    [1|Q-Id]    [HTTP|Res: 0] Request completed in 676 ms.2025-01-10T15:33:16.344+01:00    3    [1|Q-Id]    [META|Schema: JSONValidation] https://pos.no/getsales is not a valid JSON resource.2025-01-10T15:33:16.345+01:00    3    [1|Q-Id]    [META|Schema: JSONValidation] Invalid JSON markup. Expected json, but instead found [text/plain; charset=utf-8]. To attempt to fix this, I set Accept: application/json in the request heade

Hello, I want to get metadate from my Azure datalake using their Blob API. I wasn't seeing any data in the Ingest storage so I turned on cashing to file, to try to see what's happening.  There are three files in my cashing folder: Data_.raw: The return of the call, i.e. my actual data. This look excellent, except that it's a .raw file. Contents: <?xml version="1.0" encoding="utf-8"?><EnumerationResults ServiceEndpoint="https://xxxx.blob.core.windows.net/" ContainerName="datalake"> <Prefix>my_prefix</Prefix> <Blobs> <Blob> .... </Blob> </Blobs> <NextMarker/></EnumerationResults>   Data_.xml: Basically the same as the Data_.raw, but with the content of Data_.raw as the data of a value-element. The data also contains the XML header (so now the docu

Hi all,I have an API that uses nested XML to deliver the data. I have used a relational model to be able to retrieve this data in separate tables. Based on key fields that are created I am able to join the tables back together. All works fine, however, I want to reference a (different) field from my parenttable in a nested table. Currently, the output adds a field _id in my parenttable PerformanceInfoRow to be able to reference the underlying data back to the specific period. However, this _id contains an integer. Daily I will get three rows of data and daily I will thus get back the _ids 1, 2 and 3. So, in the end this will not be a unique key when retrieving more days of data. Therefore, I want to specify the Period that also is available in the parenttable, which is unique since it will not only show the date but also whether it is morning, afternoon or evening. This will be unique, but unfortunately I am not able to add this fiel

Hi everyone, We are trying to load csv file from Azure Blob Storage or Azure File Share with the guidance according to the posts below. But we are still receiving error: “Exception has been thrown by the target of an invocation.”Connect to CSV data sources | CommunityLoad CSV files from Azure Blob Storage | CommunityKindly see the connection details below. Could you help give some advice? Thank you!

I have issue with getting details from forms based on a list of formsList of forms: https://api.goformz.com/v2/formzForm details: https://api.goformz.com/v2/formz/formIdBoth nested query and pagination works seperately, but I struggle to get it work with both of them. I have tried the solution in the linked case below, but I get stuck on the same place as the user in that case:The query table is running for approximately correct time (which indicates it is reading the correct amount of data), but no data is going into the SQL-table.The query is this simple: SELECT fields,formId FROM REST.Formz_DataPerForm

Dear Sir,I am trying to set up a CData Json datasource connection with TimeXtender.This is my connectionstring:Auth Scheme=OAuth;Data Model=Document;Initiate OAuth=REFRESH;OAuth Access Token URL=https://pilot.binnenbeter.nl/api/v2/login/venray;OAuth Grant Type=PASSWORD;OAuth Refresh Token URL=https://pilot.binnenbeter.nl/api/v2/login/venray;Row Scan Depth=100;User=api@venray.nlI am able to get the bearer Token with Postman with this:url: https://pilot.binnenbeter.nl/api/v2/login/venrayJSON Body:{  "id": 

I have two particular use cases where I would like the TX REST connector to be able to handle nothing being returned. In one case I've configured the portal to do a PUT request. PUT's generally don't return any body. In a second case, the API is just configured to do this sometimes. We get ID's from another endpoint that we are then supposed to use dynamically like: endpoint/{ID}. The problem is that the source system can have phantom ID's, meaning that ID=13 doesn't really point anywhere. endpoint/13 then returns just a completely empty body. In both cases the problem seems to be that the connector can't handle this. We get back:Failed to execute endpoint 'xxx':Unexpected character encountered while parsing value: }. Path 'TX_Autogenerated_Element', line 1, position 28.Going of the error message, it would seem that the connector is assuming a json was returned and automatically

Hi all,I’m still quite new to timextender so I appreciate all the help you guys give me.I have quite alot of different XML files containing alot of data. It’s product catalogs with porentially 40K products that contains different kind of parameters .. each product’s parameters varies from product to product .. som tell you the country of origin, som dont .. on some of the products there is information about delivery dates some and on some there aren’t.So all-in-all the different products and the different files varies a quite alot. The content of these files can change each day and some multiple times each day .. I would think that we all in all are talking about 600.000 different products.How would you approach this ?Is it possible for timextender to handle this or do I have to make some kind of XML-parser ?I guess I’m going to make a unique key there is based on the products no. and another paramet