Data Sources Q&A

I am using a Power BI endpoint (https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/get-refresh-history) where I need datasetIds to get the refreshes of that dataset. I am using the TimeXtender REST data provider, in which I loop over a list of dataset ids using a dynamic value. The problem is that in the output of the Get Refresh History endpoint the dataset Id is not included.Therefore, my question is: Is it possible to pass a dynamic value used in a call as an additional column next to the output of the call? I don't see any option for this in the portal. If I were to extract the data using Power BI, I would do the call for every row in a table containing the required dataset Ids and expand the resulting column. This way, the original table column containing the dataset Ids will always be related to the dataset refreshes. Can I do the same using TimeXtender?

The TimeXtender REST Data Source has the ability to add an API endpoint with table flattening in multiple ways: either adding the endpoint once with multple tables or adding the same endpoint multiple times. I've done some tests to find out which is fastest.The test was done on an API with an unstructured JSON data source, with root nodes on multiple levels where the XSLT Table Builder can iterate over. This means I needed to add 4 flattened tables on the same endpoint, each with different root nodes. Version numbers were REST provider version 9.0, TDI 6935.1, with Ingest running on and Azure VM and storage on ADLS Gen 2.Two ways of setting up the same endpoint with four tablesMy hypothisis was that 1x endpoint with 4x tables would be quicker than 4x endpoints with easch 1x table, because TimeXtender would call the API once and the multiple XSLT tansformations can happen on the same result data, rather than the API being called multiple times which would add unnecessary tansfer of data

We are using the new 'Import Swagger/OpenAPI’ feature in the TX REST Data Source (absolutely loving that btw), but are encountering an error.  When importing the URL for a Weather API, we receive the following error message:Error: Exception Type: Microsoft.OpenApi.Readers.Exceptions.OpenApiUnsupportedSpecVersionException Message: OpenAPI specification version '3.1.0' is not supported. So far we've had no trouble importing Open API spec 3.0.0 documentation. Is there a compatibility issue with the latest 3.1.0 spec?

Hi,what is the best (performing) way to extract data from SAP datasphere?I read about an API connection (OData), but is this the ‘optimal’ way to do this ?https://community.sap.com/t5/technology-q-a/how-to-export-data-from-sap-datasphere-or-its-database-sap-hana-cloud-to/qaq-p/13708728https://help.sap.com/docs/SAP_DATASPHERE/43509d67b8b84e66a30851e832f66911/7a453609c8694b029493e7d87e0de60a.htmlBest Regards,Peter

Hi,I’m trying to use the transformation Set replace value in the Table Builder. Described in tutorial like this: I tried a simple SQL string function (LEFT(NodeName,5). It looks proper in the XSLT Output: The execution worked fine. No errors. But both columns PatientNameHash and PatientName produces the same result in the Ingest table. The full name.Anyone who knows how to format a transformation in Set replace value?Is the content of the template “string-replace-all” available for viewing?BRAnders

Hi all! This morning, I retrieved data with the REST API of MoreApp.com. The API is quite straightforward. I encountered some challenges that I'd like to share with you. If there’s anything incorrect in this description, please let me know so I can adjust it.PreparationI am using the TX REST connector version 7.1.0.0.You will also need an API key, which must be created by the administrator in the app.The data I need to retrieve is located at the base URL: https://api.moreapp.com/api/v1.0. The specific data I am fetching is "submissions," or filled-out surveys. The POST API used to fetch this data is structured as follows:https://api.moreapp.com/api/v1.0/customers/{customerId}/forms/{formId}/submissions/filter/{page}Customer is fixed. FormId needs to be looked up. Page is required for pagination.Authentication is achieved by including the X-Api-Key in the header.Step 1 – Retrieve the correct FormIdsYou can do this via Postman or TimeXtender. It is a simple GET API:https://api.moreapp.co

Hi,I need to connect to Snowflake as a data source.I have downloaded the latest odbc version for windows from https://www.snowflake.com/en/developers/downloads/odbc/ and installed the provider.From XPilot I get an answer how to configure the odbc data source, but I cant find the “Private Key” field in no 4. That field seem to be “missing” in the config dialog.  Step 3: Configure the ODBC Data Source with the Private KeyOpen the ODBC Data Source Administrator Application and go to the System DSN tab. Press "Add" and select SnowflakeDSIIDriver. Click Finish. In the Snowflake Configuration Dialog, provide a name for the data source. Enter the connection details: User: The Snowflake user name. Private Key: The path to the rsa_key.pem file. Database, Schema, Warehouse: Specify the database, schema, and warehouse. Tracing: Set to 0. Test the connection to ensure it is successful. Press OK. Any suggestion on this? Where should I to put the filepath?regards,Bjørn A.

Hi, I’m trying to add new data source provider but it looks like all of them dissapeared. Last week everithing works well. Licence is active, I using version 2.10.36.64. Any idea about the root cause?

Hello,I understand support for CData has been removed, see However, we cannot use existing drivers anymore either, as we don’t have the option anymore to add a CData Data Source via ODX.  If we click on Add Data Source, we only see some standard data sources, no CData drivers anymore.  If we click on Manage Data Source Providers, we do see the installed CData drivers. We use a lot of different Sharepoint connections to import certain data, and we cannot create a new Sharepoint connection now, without upgrading.  How can we add a CData Data Source now?  Upgrading of the client is currently not possible. This is a blocking issue!  How can we still add a CData data source?Thanks,Stijn Hensen

HI,For the first time in my life, I have enjoyed working with a REST API 😁.It is actually a pleasure to use TimeXtender's new REST data source now.Swagger import, Dynamic values, Table builder etc.There will be more to be desired of course, but hats off to the developers who built it and to Thomas who have made tutorials that are comprehensive and easy to understand.Nice job! 🎉BRAndersP.S. It feels good to be undividedly positive once in a while too 😊

I cannot see it in the Data Source Providers:Can you give me a setup guide? 

Hello,With TimeXtender business unit on prem at an internal server, we were able to call an API via below settings, and load the data successfully.  However, when we set up the same data source on TimeXtender Portal with basically the same setting. The data source tested either timeout or with error ‘Exception has been thrown by the target of an invocation.’, or connection tested okay but no metadata can be imported/synced. I have tried all below connection types but couldn’t get it work. Do you know why (for example to setup firewall or proxy) or have any advice? Thanks in advance. 

The Cdata data source for QuickBooks Online doesn’t have all the endpoints in the API available. For instance TaxPayments is missing. (https://developer.intuit.com/app/developer/qbo/docs/api/accounting/all-entities/taxpayment)It is possible to add rsd-files to the file folder in order to get additional tables when synchronizing data. However, there is no sample rsd-file available, and no obvious way to generate schema file. I have tried to copy a rsd file from a REST connector, but then I get the error message when trying to preview: “The operation ‘jsonproviderGet’ could not be found”

Hello,I'm working with a REST API where the response is a valid JSON but has a Content-Type: text/plain. The response looks like this:[{"OrderId":"46D2A6BD-8B34-4F55-B816-B90017CDBA28","OrderNumber":131,"DeviceId":"POS41232","VendorId":1,"VendorName":"Test Facility","StoreId":114}]However, the log shows the following:2025-01-10T15:33:16.340+01:00    2    [1|Q-Id]    [HTTP|Res: 0] HTTP/1.1 200 OK, 1615 Bytes Transferred2025-01-10T15:33:16.340+01:00    2    [1|Q-Id]    [HTTP|Res: 0] Request completed in 676 ms.2025-01-10T15:33:16.344+01:00    3    [1|Q-Id]    [META|Schema: JSONValidation] https://pos.no/getsales is not a valid JSON resource.2025-01-10T15:33:16.345+01:00    3    [1|Q-Id]    [META|Schema: JSONValidation] Invalid JSON markup. Expected json, but instead found [text/plain; charset=utf-8]. To attempt to fix this, I set Accept: application/json in the request headers, but this results in a response wrapped in a string, like this:"[{\"OrderId\":\"46D2A6BD-8B34-4F55-B816-B90017CD

Hello, I want to get metadate from my Azure datalake using their Blob API. I wasn't seeing any data in the Ingest storage so I turned on cashing to file, to try to see what's happening.  There are three files in my cashing folder: Data_.raw: The return of the call, i.e. my actual data. This look excellent, except that it's a .raw file. Contents: <?xml version="1.0" encoding="utf-8"?><EnumerationResults ServiceEndpoint="https://xxxx.blob.core.windows.net/" ContainerName="datalake"> <Prefix>my_prefix</Prefix> <Blobs> <Blob> .... </Blob> </Blobs> <NextMarker/></EnumerationResults>   Data_.xml: Basically the same as the Data_.raw, but with the content of Data_.raw as the data of a value-element. The data also contains the XML header (so now the document has two headers) and the brackets have been encoded (i.e. all the `<` are now `<`).  <?xml version="1.0" encoding="utf-8"?><Table_flattening_name

Hi all,I have an API that uses nested XML to deliver the data. I have used a relational model to be able to retrieve this data in separate tables. Based on key fields that are created I am able to join the tables back together. All works fine, however, I want to reference a (different) field from my parenttable in a nested table. Currently, the output adds a field _id in my parenttable PerformanceInfoRow to be able to reference the underlying data back to the specific period. However, this _id contains an integer. Daily I will get three rows of data and daily I will thus get back the _ids 1, 2 and 3. So, in the end this will not be a unique key when retrieving more days of data. Therefore, I want to specify the Period that also is available in the parenttable, which is unique since it will not only show the date but also whether it is morning, afternoon or evening. This will be unique, but unfortunately I am not able to add this field to the underlying tables. I have tried to adjust my

Hi everyone, We are trying to load csv file from Azure Blob Storage or Azure File Share with the guidance according to the posts below. But we are still receiving error: “Exception has been thrown by the target of an invocation.”Connect to CSV data sources | CommunityLoad CSV files from Azure Blob Storage | CommunityKindly see the connection details below. Could you help give some advice? Thank you! For Azure Blob StorageFor Azure File Share 

I have issue with getting details from forms based on a list of formsList of forms: https://api.goformz.com/v2/formzForm details: https://api.goformz.com/v2/formz/formIdBoth nested query and pagination works seperately, but I struggle to get it work with both of them. I have tried the solution in the linked case below, but I get stuck on the same place as the user in that case:The query table is running for approximately correct time (which indicates it is reading the correct amount of data), but no data is going into the SQL-table.The query is this simple: SELECT fields,formId FROM REST.Formz_DataPerFormWHERE Nested_Id IN (SELECT formId FROM REST.formz_WithDateFilter)Is it possible to get this working?  

Dear Sir,I am trying to set up a CData Json datasource connection with TimeXtender.This is my connectionstring:Auth Scheme=OAuth;Data Model=Document;Initiate OAuth=REFRESH;OAuth Access Token URL=https://pilot.binnenbeter.nl/api/v2/login/venray;OAuth Grant Type=PASSWORD;OAuth Refresh Token URL=https://pilot.binnenbeter.nl/api/v2/login/venray;Row Scan Depth=100;User=api@venray.nlI am able to get the bearer Token with Postman with this:url: https://pilot.binnenbeter.nl/api/v2/login/venrayJSON Body:{  "id": "",  "language": "en",  "data": {    "resourceType": "AUTH",    "item": {          "loginName": api@venray.nl,           "password": "password",          "module": "API"    }  }This is the documentation I used for the connectionstring:PasswordFinally there also is an Password method. It is similar to the others, in that it requires an Access Token URL and an Refresh Token URL, the difference is that it uses an User and Password instead of client and secret. Notice that these fields are

I have two particular use cases where I would like the TX REST connector to be able to handle nothing being returned. In one case I've configured the portal to do a PUT request. PUT's generally don't return any body. In a second case, the API is just configured to do this sometimes. We get ID's from another endpoint that we are then supposed to use dynamically like: endpoint/{ID}. The problem is that the source system can have phantom ID's, meaning that ID=13 doesn't really point anywhere. endpoint/13 then returns just a completely empty body. In both cases the problem seems to be that the connector can't handle this. We get back:Failed to execute endpoint 'xxx':Unexpected character encountered while parsing value: }. Path 'TX_Autogenerated_Element', line 1, position 28.Going of the error message, it would seem that the connector is assuming a json was returned and automatically starts trying to convert is somehow.  I need to be able to handle these situations somehow, since I have no

Hi all,I’m still quite new to timextender so I appreciate all the help you guys give me.I have quite alot of different XML files containing alot of data. It’s product catalogs with porentially 40K products that contains different kind of parameters .. each product’s parameters varies from product to product .. som tell you the country of origin, som dont .. on some of the products there is information about delivery dates some and on some there aren’t.So all-in-all the different products and the different files varies a quite alot. The content of these files can change each day and some multiple times each day .. I would think that we all in all are talking about 600.000 different products.How would you approach this ?Is it possible for timextender to handle this or do I have to make some kind of XML-parser ?I guess I’m going to make a unique key there is based on the products no. and another parameter, but would you predefine the different parameters as a Field so I have to add a new

Hi, I am trying to connect with NetSuite ERP and created a data source. But when I am testing the connection getting following error. Please let me know how to correct, so I can establish the connection and also let me know if there are any pre-requisites for the same. Also if you can also share the Data Connection screen with information to be added, would be great. I am using NetSuite (CDATA) Connector for the same.Following is the error  Service request failed: Exception has been thrown by the target of an invocation. (System.Exception) Details: Service request failed: Exception has been thrown by the target of an invocation. (System.Exception)Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException   at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C](WcfServerSettings serverSettings, Action`2 action)   at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy) Service request failed: Exception has been thrown by the target of an invocatio

In version 20.10.39 you sneaked in a new features in the BC Adapter data source: 17627: Business Central adapter - Merge extension tables option for SQL Server provider Added option to merge a table and its extension tables together as one table. This feature could be very useful but I can’t find any documentation on how it works and if there are any limits or considerations that need to be taken into account.Initial testing suggest that it works for some tables but maybe not for tables in extension modules?

I have an API with the following documentation:• https://baseball.help.trumedianetworks.com/baseball/data-pro-api-docs According to the API documentation, a token must be generated and included as a parameter. This is done using a master token provided by the supplier. When testing in Postman, I receive a response in CSV format; however, the same does not work in TimeXtender. In Postman, the request automatically generates a header "cookie" containing an access token (through redirection). Is it possible to use a cookie container with a redirect option? In cases where a query is redirected to another URL and an authentication cookie obtained from the original URL needs to be set in the redirected request? If so, is this option available in TimeXtender's REST or RSD functionality?

I am trying to achieve something complex in the TX REST connector using table flattening.I have the following JSON response: [    {        "id": 1,        "submitted": "2024-06-26T12:11:42+02:00",        "answers": [            {                "question": {                    "id": 3,                    "label": "How do you evaluate this?",                    "type": "SINGLE"                },                "answer": 9            },            {                "question": {                    "id": 4,                    "label": "How do you rate the following elements?",                    "type": "MATRIX_SINGLE_CHOICE"                },                "answer": [                    {                        "ids": [                            55                        ],                        "labels": [                            "Drinks"                        ],                        "value": [                            "Good"                        ]                    },