Data Sources Q&A

Hello, I want to get metadate from my Azure datalake using their Blob API. I wasn't seeing any data in the Ingest storage so I turned on cashing to file, to try to see what's happening. There are three files in my cashing folder: Data_.raw: The return of the call, i.e. my actual data. This look excellent, except that it's a .raw file. Contents: <?xml version="1.0" encoding="utf-8"?><EnumerationResults ServiceEndpoint="https://xxxx.blob.core.windows.net/" ContainerName="datalake"> <Prefix>my_prefix</Prefix> <Blobs> <Blob> .... </Blob> </Blobs> <NextMarker/></EnumerationResults> Data_.xml: Basically the same as the Data_.raw, but with the content of Data_.raw as the data of a value-element. The data also contains the XML header (so now the document has two headers) and the brackets have been encoded (i.e. all the `<` are now `<`). <?xml version="1.0" encoding="utf-8"?><Table_flattening_name> <value> &lt;?xml version="1.0" encoding="utf-8"?&gt; &lt;EnumerationResults ServiceEndpoint="http

Hi all, I have an API that uses nested XML to deliver the data. I have used a relational model to be able to retrieve this data in separate tables. Based on key fields that are created I am able to join the tables back together. All works fine, however, I want to reference a (different) field from my parenttable in a nested table. Currently, the output adds a field _id in my parenttable PerformanceInfoRow to be able to reference the underlying data back to the specific period. However, this _id contains an integer. Daily I will get three rows of data and daily I will thus get back the _ids 1, 2 and 3. So, in the end this will not be a unique key when retrieving more days of data. Therefore, I want to specify the Period that also is available in the parenttable, which is unique since it will not only show the date but also whether it is morning, afternoon or evening. This will be unique, but unfortunately I am not able to add this field to the underlying tables. I have tried to adjust m

Hi everyone, We are trying to load csv file from Azure Blob Storage or Azure File Share with the guidance according to the posts below. But we are still receiving error: “Exception has been thrown by the target of an invocation.” Connect to CSV data sources | Community Load CSV files from Azure Blob Storage | Community Kindly see the connection details below. Could you help give some advice? Thank you! For Azure Blob Storage For Azure File Share

I have issue with getting details from forms based on a list of forms List of forms: https://api.goformz.com/v2/formz Form details: https://api.goformz.com/v2/formz/formId Both nested query and pagination works seperately, but I struggle to get it work with both of them. I have tried the solution in the linked case below, but I get stuck on the same place as the user in that case: The query table is running for approximately correct time (which indicates it is reading the correct amount of data), but no data is going into the SQL-table. The query is this simple: SELECT fields,formId FROM REST.Formz_DataPerFormWHERE Nested_Id IN (SELECT formId FROM REST.formz_WithDateFilter) Is it possible to get this working?

Dear Sir, I am trying to set up a CData Json datasource connection with TimeXtender. This is my connectionstring:Auth Scheme=OAuth;Data Model=Document;Initiate OAuth=REFRESH;OAuth Access Token URL=https://pilot.binnenbeter.nl/api/v2/login/venray;OAuth Grant Type=PASSWORD;OAuth Refresh Token URL=https://pilot.binnenbeter.nl/api/v2/login/venray;Row Scan Depth=100;User=api@venray.nl I am able to get the bearer Token with Postman with this: url: https://pilot.binnenbeter.nl/api/v2/login/venray JSON Body: { "id" : "" , "language" : "en" , "data" : { "resourceType" : "AUTH" , "item" : { "loginName" : api@venray.nl , "password" : "password" , "module" : "API" } } This is the documentation I used for the connectionstring: Password Finally there also is an Password method. It is similar to the others, in that it requires an Access Token URL and an Refresh Token URL, the difference is that it uses an User and Password instead of client and secret. Notice that these fields are in the "Authenticat

I have two particular use cases where I would like the TX REST connector to be able to handle nothing being returned. In one case I've configured the portal to do a PUT request. PUT's generally don't return any body. In a second case, the API is just configured to do this sometimes. We get ID's from another endpoint that we are then supposed to use dynamically like: endpoint/{ID}. The problem is that the source system can have phantom ID's, meaning that ID=13 doesn't really point anywhere. endpoint/13 then returns just a completely empty body. In both cases the problem seems to be that the connector can't handle this. We get back: Failed to execute endpoint 'xxx':Unexpected character encountered while parsing value: }. Path 'TX_Autogenerated_Element', line 1, position 28. Going of the error message, it would seem that the connector is assuming a json was returned and automatically starts trying to convert is somehow. I need to be able to handle these situations somehow, since I have no

Hi all, I’m still quite new to timextender so I appreciate all the help you guys give me. I have quite alot of different XML files containing alot of data. It’s product catalogs with porentially 40K products that contains different kind of parameters .. each product’s parameters varies from product to product .. som tell you the country of origin, som dont .. on some of the products there is information about delivery dates some and on some there aren’t. So all-in-all the different products and the different files varies a quite alot. The content of these files can change each day and some multiple times each day .. I would think that we all in all are talking about 600.000 different products. How would you approach this ? Is it possible for timextender to handle this or do I have to make some kind of XML-parser ? I guess I’m going to make a unique key there is based on the products no. and another parameter, but would you predefine the different parameters as a Field so I have to add

Hi, I am trying to connect with NetSuite ERP and created a data source. But when I am testing the connection getting following error. Please let me know how to correct, so I can establish the connection and also let me know if there are any pre-requisites for the same. Also if you can also share the Data Connection screen with information to be added, would be great. I am using NetSuite (CDATA) Connector for the same. Following is the error Service request failed: Exception has been thrown by the target of an invocation. (System.Exception) Details: Service request failed: Exception has been thrown by the target of an invocation. (System.Exception) Module: TimeXtender.ODX.Engine TimeXtender.ODX.Engine.ODXFaultException at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C](WcfServerSettings serverSettings, Action`2 action) at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy) Service request failed: Exception has been thrown by the target of an invocation.

In version 20.10.39 you sneaked in a new features in the BC Adapter data source: 17627: Business Central adapter - Merge extension tables option for SQL Server provider Added option to merge a table and its extension tables together as one table. This feature could be very useful but I can’t find any documentation on how it works and if there are any limits or considerations that need to be taken into account. Initial testing suggest that it works for some tables but maybe not for tables in extension modules?

I have an API with the following documentation: • https://baseball.help.trumedianetworks.com/baseball/data-pro-api-docs According to the API documentation, a token must be generated and included as a parameter. This is done using a master token provided by the supplier. When testing in Postman, I receive a response in CSV format; however, the same does not work in TimeXtender. In Postman, the request automatically generates a header "cookie" containing an access token (through redirection). Is it possible to use a cookie container with a redirect option? In cases where a query is redirected to another URL and an authentication cookie obtained from the original URL needs to be set in the redirected request? If so, is this option available in TimeXtender's REST or RSD functionality?

I am trying to achieve something complex in the TX REST connector using table flattening. I have the following JSON response: [ { "id": 1, "submitted": "2024-06-26T12:11:42+02:00", "answers": [ { "question": { "id": 3, "label": "How do you evaluate this?", "type": "SINGLE" }, "answer": 9 }, { "question": { "id": 4, "label": "How do you rate the following elements?", "type": "MATRIX_SINGLE_CHOICE" }, "answer": [ { "ids": [ 55 ], "labels": [ "Drinks" ], "value": [ "Good" ] }, { "ids": [ 56 ], "labels": [ "Food" ], "value": [ "Good" ] } ] } ] }] So my response has an answers array which contains both a question array and an answer that is sometimes a direct value and sometimes an array. How can I create a flattening that directly reads a parent node without expanding the child nodes (ids, lables,value)?

Hello, we would like to select the columns what are loaded from a data source to odx with a odbc connector. We tried it this way Click on datasource → Select Tables → Select Columns But there are not columns what we can select from: How is it possible to select columns for data sources using the odbc connector? Thank you and best regards, Julia

Hello, We have a REST API where we use both Dynamic Value and Pagination (replace URL). The issue is that the paging works fine but only considers the first Dynamic Value and skips the rest. The final result then returns all pages for the first dynamic value and no rows for the rest. Further we also use Table Flattening as well as the Exhaustive Metadata Scan Option. How can we make it loop through all dynamic values as well as keeping the paging option? API request: https://{base_url}/{company_url} Paging: Replace URL with {nextLink} type XPath Dynamic Value query: SELECT company_url FROM [MDW_Dev].[SysTransform].[Company_information]

I am using a REST API (CData source) to get source data. Since I need to include a CSR_NONCE value in the header (unique key value), the REST api is set up as a POST. Is it possible to specify that you want to do a POST rather than GET in a CData source?

Hello all, I am currently trying to retrieve all Google Reviews for multiple locations for one of my clients, who operates 35 locations. Some of these locations have over 50 reviews, and since Google Reviews uses pagination through a nextPageToken for more than 50 reviews, I need to handle this pagination effectively. The client is running TimeXtender version 20.10.52.64, and I am using the CData connector version 24.0.8999.0. I have reviewed the documentation on the TimeXtender support pages about nesting an API call and utilizing pagination. I am attempting to set up the Query Slicer to loop through the locations and retrieve all reviews per location, but I am encountering difficulties. Here’s what I have set up so far: I created two .rsd files: locations.rsd: Retrieves a list of all location IDs. This returns 35 locations, as expected. locationsReviews.rsd: Retrieves all reviews for a given location. This works correctly when I test it, returning 397 reviews for one location ID. (I'

A customer I am working with is trying to connect Topdesk to TimeXtender through an OData feed. A connection is made, but not all tables are available for ingestion. When the customer changes the connection url to connect to just 1 table, TimeXtender has no issues connecting to it and retrieving the data from that 1 table. To test if this there maybe was a setting in Topdesk that was missed we tried to connect from Power Query using the original url. This connection also worked perfectly, showing around 290 tables. How can we get TimeXtender to retreive the same amount of tables from Topdesk? Feed URL: https://<customer>.topdesk.net/services/reporting/v2/odata OAuth version: 2.0 Provider: Managed ADO.NET Provider version: 24.0.8963.0 OData version: AUTO Attached a screenshot of the output of a query to the datasource in TimeXtender ODX

I have a folder that contains several Excel files I want to combine into one table. However, the week and year that the individual files refer to are only contained in the file names, not in the files themselves. Therefore, I have no way of knowing the week and year that a row of data belongs to when I aggregate the files using the Excel data source. Is there a way to aggregate all Excel files in the folder while also keeping information about which file a record came from? Or is making a separate data source for each file the only solution to keep this information? By the way, the Excel files are stored on a server requiring username and password, so the TimeXtender Excel data source is (currently) not an option.

The below image is the documentation for my endpoint. I can't get this to work. When I configure this in the portal I get back a 415 error. Any general guidelines on how to configure this? Update 2024-07-22 The regular way: I’ve been doing some additional testing. Here's a more detailed description of my findings/problems. The API wants to receive a JSON body like so: { "grant_type": "authorization_code", "code": "abc***123" } I tried to add fill out the portal like this: This doesn't work and returns the 415 error. What should I fill out in stead? My cicumvention (doesn't suffice). I configure one endpoint (access_token) to be a POST request (the request that will give back my bearer token). I then configure a second endpoint (Products) and use a dynamic value based on access_token and use it in the header Authorization. See images below. A POST request that will return my bearer token. A GET request that uses the bearer token value returned by the previous endpoint. This method does

Hi, I have used the SAP Cloud for Customer Connector to connect SAP C4C and setted up following parameters Getting the error, Need your help on the same as I have a demo tomorrow ​ But I am getting Error as Service request failed: Exception has been thrown by the target of an invocation. (System.Exception) Details: Service request failed: Exception has been thrown by the target of an invocation. (System.Exception)Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C](WcfServerSettings serverSettings, Action`2 action) at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy) Service request failed: Exception has been thrown by the target of an invocation. (System.Exception)Module: timeXtenderTXModelInterface.ExceptionWrapperException at TimeXtender.DataManager.ConnectingThread.HandleError() at TimeXtender.DataManager.ConnectingThread.Execute(String title, Int32 progressSteps, List`1 actions

Hi, We have a Midmarket customer in India who want to use TimeXtender for Analytics Purpose, but not keen to invest in Theobald. What is the most effective and reliable way to connect to SAP to extract Data to TimeXtender. Also if you can share step-by-step guide with example.

Hi, We have a customer in India who is moving from SAP to some other ERP. They want to extract all the transactional data from SAP to Data Lake for future usage before discarding SAP. As it is one time activity, not interested in investing in Theobald. What is the best and most effective way to extract the Data to TX and then use with new ERP for Analytics Purpose.

Hi, I want to connect Microsoft Dynamics 365 Finance & Operation - Cloud to TimeXtender. Need to your help to know the prerequisites and also the steps to connect the same to TimeXtender.

Hello! I’m new to TimeXtender and I was trying to complete the training but I’m having issues connecting to the Adventure Works database via TimeXtender. I connect just fine via SQL Server Management Studio 20: But when I try to connect with the same credentials and configurations via TimeXtender I get the following error message: Can anyone help me figure out what the issue is? At the moment this is really impacting my training Thank you in advance for your help :)

Hi All, I am trying to connect a Business Central - Online Datasource and I completed all the Prerequisites as per the Training Documents, but when I am testing the connection on the Portal, it’s not giving me success and following is the error. Need your help Error opening connection to BC Cloud: System.ApplicationException: User must authenticate connection. at Jet.NavMetadataPlugin.ApiHelper.GetAccessToken(String filePath) at Jet.NavMetadataPlugin.ApiHelper.GenerateRequest(String url, String method) at Jet.NavMetadataPlugin.ApiHelper.<>c__DisplayClass29_0.<ApiGetResponse>b__0() at Jet.NavMetadataPlugin.ApiHelper.HandleThrottling(Func`1 action) at Jet.NavMetadataPlugin.ApiHelper.ApiGetResponse(Boolean needCompany, String apiName, Boolean& timedOut, String basUrl) at Jet.NavMetadataPlugin.BCCloudMetadata.GetTableViaStandardAPI(Boolean needCompany, String api) at Jet.NavMetadataPlugin.BCCloudMetadata.Initialize() at Jet.NavMetadataPlugin.BCCloudMetadataPlugin.Open(Boolean enableLogging

I am dealing with an API that let’s me query its database. With LIMIT and OFFSET I want to fetch all the rows dynamically using an RSD file. Here’s the json response: { "entities": [ { "Portfolio": { "id": "9999999999999999", "Name": "Test9" } }, { "Portfolio": { "id": "1111111111111111", "Name": "Test1" } } ], "paging": { "from": 2, "hasMore": true, "limit": 2 }} And here is my RSD file. I haven’t gotten it to work with pagination and I just get the error The attribute 'hasMore' does not exist. <api:script xmlns:api="http://apiscript.com/ns?v1" xmlns:xs="http://www.w3.org/2001/XMLSchema"> <!-- See Column Definitions to specify column behavior and use XPaths to extract column values from JSON. --> <api:info title="entities" desc="Generated schema file_" xmlns:other="http://apiscript_com/ns?v1"> /> <attr name="portfolio_id" xs:type="string" readonly="false" other:xPath="/json/entities/Portfolio/id" /> <attr name="portfolio_name" xs:type="string" readonly="false" other:xPath="/json/entit