To homepage To homepage

ODX

Ask questions about TimeXtender ODX Instances

  • 126 Topics
  • 668 Replies

126 Topics

A
Starter
aftabpStarter
asked in ODX

Data capture with multiple API-endpoints

Hi,Has anyone worked with API from Energinet?I need some help extracing data from Energinet. Energinet delivers data with multiple endpoints. It starts with https://www.energinet.net/api/unit which gives me this [ { "unit_id": "1234ABCDfolder", "name": "My Company", "links": { "info": { "verb": "GET", "href": "/api/unitinfo/1234ABCDfolder" }, "drilldown": { "verb": "GET", "href": "/api/unit/1234ABCDfolder" } }, "datasources": [] }]Now, i have to drill down to get some info: https://www.energinet.net/api/unit/1234ACDfolder[ { "unit_id": 1Afolder", "name": "Company1", "links": { "info": { "verb": "GET", "href": "/api/unitinfo/1Afolder" }, "drilldown": { "verb": "GET", "href": "/api/unit/1Afolder" } }, "dat

6
Thomas Lind
Community Manager
6 days ago
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in ODX

What rights are needed to be able to create roles in the ODX Server to define access

 I am trying to set up access to some tables in the ODX. when I try to add a role and search for an Azure AD user I get the error: Service request failed: Code: Authorization_RequestDenied ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException   at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, Func`3 func)   at TimeXtender.DataManager.AddODXSecurityRoleWizard_MemberSelectStep.<>c__DisplayClass11_0.<SearchClicked>b__0()   at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy)Service request failed: Code: Authorization_RequestDenied ...Module: timeXtenderTXModelInterface.ExceptionWrapperException   at TimeXtender.DataManager.ConnectingThread.HandleError()   at TimeXtender.DataManager.ConnectingThread.Execute(String title, Int32 progressSteps, List`1 actions)   at TimeXtender.DataManager.AddODXSecurityRoleWizard_MemberSelectStep.SearchClicked(Object sender, EventArgs e) This setup is a V

11
Christian Hauggaard
Community Manager
6 days ago
D
Explorer
dsvartzmanExplorer
asked in ODX

Error 503 (ODX)

hi, Lately were are getting alot of 503 exceptions.  Error message is typically: The task '983693' failed:System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Net.Http.HttpRequestException: Response status code does not indicate success: 503 (The server is busy.).   at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()   at Azure.Management.REST.RestWebRequestManager.<SendRequest>d__6.MoveNext()--- End of stack trace from previous location where exception was thrown ---   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)   at Azure.Management.REST.RestWebRequestManager.<SendRequest>d__5.MoveNext()--- End of stack trace from previous location where exception was thrown ---   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()   at System.Runtime.CompilerSe

1
D
Explorer
11 days ago
P
Contributor
pontus.berglundContributor
asked in ODX

OAuth with authorization prefix "Bearer "

Hi,I am trying to connect to a REST API that uses OAuth2 authentication.The API documentation is very clear on what to include in the authentication:  I have entered all this information in the REST CData provider and I can successfully use the provider’s “Authorize OAuth” button.However, when I try to test the connection, error “401 - Unauthorizated” is returned.In the API documentation, they state that the token needs a prefix “Bearer “.I suspect my error is caused by the REST CData provider sending the authorization header without the Bearer prefix, like so:Authorization: {ACCESS_TOKEN}Which the API of course does not accept. Is there any way to include a prefix to the token in the authorization header?

23
Thomas Lind
Community Manager
11 days ago
S
Contributor
sierd.zuiderveldContributor
asked in ODX

Error on table with 0 files and incremental offset rule

We have data sources where we apply dynamic incremental rules, so if column == “Name” then apply incremental load with 3 day offset. Now there exist some tables in the data source that are currently empty (in the actual source). They do have the incr column and therefore the offset rule. Now we noticed that the ODX transfer on these tables works fine.However when we execute a table with such a table in the mapping we obtain this error: System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.InvalidOperationException: Sequence contains no elements   at System.Linq.Enumerable.Max(IEnumerable`1 source)   at DataStorageEngine.DataLakeGen2.DataLakeGen2DiscoveryHubExecution.<ProvideDataTableForDiscoveryHubSQLTransferAsync>d__14.MoveNext()   --- End of inner exception stack trace ---   at System.Threading.Tasks.Task.WaitAll(Task[] tasks, Int32 millisecondsTimeout, CancellationToken cancellationToken)   at Dat

12
Christian Hauggaard
Community Manager
12 days ago
rvgfox
Contributor
rvgfoxContributor
asked in ODX

Azure Active Directory data source conector

Hi, can you provide me with detailed instructions on how to set it up?

3
Thomas Lind
Community Manager
13 days ago
K
Contributor
KajEmergoContributor
asked in ODX

Sharepoint data source 'Authorize OAuth' not working

When configuring the CData Microsoft Sharepoint (23.0.8669) provider for extracting a Sharepoint List, we encounter a problem with the button ‘Authorize OAuth’. We are configuring the data source in ODX Server 20.10.40 and TX version is also 20.10.40.The following settings are configured:According to the CData documentation AzureAD should be used as Auth Scheme to leverage OAuth to authenticate, we also use this exact same setting and the same app registration for another data source using the Excel Online provider for which all is ok.However, when using ‘Authorize OAuth’ with the Sharepoint provided, we get the following error:What could be causing this? Changing the file or location for OAuth does not matter at all, we have also tried other versions of the provider but they all give this error. Also, changing Initiate OAuth to ‘REFRESH’ does not have an effect.

3
Christian Hauggaard
Community Manager
16 days ago
K
Contributor
KajEmergoContributor
asked in ODX

Using open source API with download link

In order to retrieve meteorological data from The Netherlands, we want to use the Open Data API developed by the Dutch Meteorological Institute (KNMI). This website contains all relevant information on using the API.In summary, these are the steps that we want to undertake. Anyone can do this, because of the anonymous API key that is open to public:Locate the ‘Anonymous API key’, can be found on the KNMI documentation website Determine the dataset name, version and filename to establish the correct endpoint In this example we want to use the following endpoint: https://api.dataplatform.knmi.nl/open-data/v1/datasets/etmaalgegevensKNMIstations/versions/1/files/KIS___OPER_P___OBS_____L2.nc/url Execute the GET call (make sure to use Authorization header in combination with the anonymous API key The GET call returns a download URL pointing to the KNMI Amazone AWS storage which can be easily used in Postman to retrieve the data (in x-netcdf format)Would you like to try the above in Postman a

8
K
Contributor
17 days ago
S
Contributor
sierd.zuiderveldContributor
asked in ODX

Best Azure VM size for ODX

Our ODX is hosted on a separate VM in Azure. We followed the suggestion to use the size DS2_v2, but we encountered frequent “System Out of Memory exception was thrown” errors that caused the ODX to stop. We are planning to switch to E2_ads_v5, which has twice the memory, but I am curious if anyone else has faced this issue and has any advice.

3
M
Employee
17 days ago
S
Contributor
Søren SørensenContributor
asked in ODX

varchar(max) fields not coming through in ADLS Gen2

I have a table with a varchar(max) field (stored in Dedicated Pool, which is a data source). and it won’t come through to ADLS Gen2 (ODX, version 6284.1). I’m using the Azure Synapse provider.The longest field contains almost 4 million characters, but I’ve been unable to figure out whether this is a limitation in TX or Azure. Does anyone know?

5
Christian Hauggaard
Community Manager
27 days ago
K
Contributor
KajEmergoContributor
asked in ODX

Azure data storage table folder has invalid meta data

We are facing a problem with a ODX data lake storage table. The problems are appearing at two points in our Data Warehouse:The ODX transfer tasks gives the warning “Table folder X is used by another table with id Y” When using the ‘Preview’ option from TX interface in ODX storage we get the error “The azure data lake gen2 data storage table folder has invalid meta data. The ODX must transfer the table again”Using ‘Synchronize objects’ on ODX server does not do anything at all. Moreover, executing the table in DSA still works without errors and seems to contain new data. Also, in our Azure storage account we can see the transfer task adds new versions of the table every day (scheduled transfer task) even though it gives us the warning 1).By the way, the table ID that the error on ODX transfer task gives us does not correspond with the TableId that we can see in the _model.json file in the corresponding folder in our Azure storage account. Where should the table ID from the first error p

4
K
Contributor
1 month ago
L
Starter
lukas.gStarter
asked in ODX

Cannot find files in Excel Online (Sharepoint with Delegated Permission)

We use Sharepoint for multiple data sources. Connecting the Sharepoint Lists works fine and I have a OAuth for Excel Online running as well, but my data source throws an error: Cannot find file.  I need to handle multiple files according to this documentation:https://support.timextender.com/data%2Dsources%2D112/connect%2Dto%2Dexcel%2Dfiles%2Dwith%2Dexcel%2Donline%2D628 What’s the reason for this?  My App Permissions are set accordingly: My Setup looks like this:  

9
Christian Hauggaard
Community Manager
1 month ago
andrew.gebhard
Participant
andrew.gebhardParticipant
asked in ODX

Nested API Call with case / if statement in RSD file

Hi community, I am trying to work with the LinkedIn API to retrieve details about UGC posts (i.e. engagements, clicks, etc.). This information is not part of the LinkedIn Marketing Solutions CDATA connector, so I am using the CDATA provider for REST 2022. I first made a call to the posts API to ‘Find Posts by Account’: Posts API - LinkedIn | Microsoft Learn. After that I need to pass each Post ID into the Organizational Entity Share Statistics API to ‘Retrieve Statistics for Specific UGC Posts’: Organization Share Statistics - LinkedIn | Microsoft Learn. The problem I am facing is that the Posts API returns two types of posts (which cannot be filtered in the API): shares and UcgPosts. Each of those types of posts needs a different URL format in the ‘Organizational Share Statistics’ API. So, I need a way to only pass one type of post into the second API. UCG posts are posts where the ID starts with 'urn:li:ugcPost:'The file RSD 1.txt works, until the first ID from the Posts API is a Ucg

4
Christian Hauggaard
Community Manager
1 month ago
E
Contributor
ebayContributor
asked in ODX

multiple Excel files to one

HelloEvery day, I have a new Excel file in the Azure storage or OneDrive account. I use OneDrive to test phase. These file’s name change with a new day. How can I this multiple Excel files to one? Is there a option for Excel like aggregate files option in CSV?Best Regards

13
erik.van.mastrigt
TimeXtender Xpert
1 month ago
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in ODX

SAP Table Data Source in ODX Server v21 - table filtering doesn't work properly

I’m struggling with the TimeXtender SAP Table Data Source version 18 in ODX Server v6429.1. In our current setup we use Table Name filtering like this: Please see the wildcards used. How does this translate to ODX Server v21? I have these three rules: The latter does not seem to work. I tried many variations (and did a sync data source consecutively), but when I click Select Tables under a transfer task, it only comes up with the tables matchin an equal-rule. Tables that should match a like-rule never show up: Using equal and wildcards doesn’t work either Any advice on how I should filter tables properly?

3
bas.hopstaken
TimeXtender Xpert
1 month ago
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in ODX

ODX Server and unicode data source fields

Hi community,I have a MariaDB data source which I connect to using ODX Server (v 6346) and the CData/ADO.net connector for MariaDB v 23.0.8565.0.The source database is set to collation utf8mb4_general_ci. I noticed by copying from ODX Server to a Data Area that some special characters are slightly different than the source/ODX. I can fix this by manually changing the data type to nvarchar instead of varchar, but that is a lot of field editing.The Override Data Type function can help as well, but as we have a wide range of field lengths, this also means a lot of override rules.Is there a way to tell ODX Server that all varchar fields should be unicode/nvarchar by default (eg. based on the source database collation)?Example from ODX Server. These fields should all be nvarchar(xx) instead of varchar(xx): Implementing this idea would work for me as well :) In TX v20 Business Units, we had this option: 

6
erik.van.mastrigt
TimeXtender Xpert
1 month ago
anders.e.jonsson
Contributor
anders.e.jonssonContributor
asked in ODX

Error when creating ODX Notification on Critical Errors

Hi,We are unable to set up Notification on Critical Errors for the ODX Server. Both service and database for the ODX is on prem. The Exchange Server is deployed as a hybrid. TimeXtender version 6221.1This is the error message:  Setting up notification for the executions in the MDW’s and SSL’s is no problem. No authentication is required by the Exchange server.BRAnders

16
anders.e.jonsson
Contributor
1 month ago
Bernarddb
Contributor
BernarddbContributor
asked in ODX

Execution log warning column already exists

Hi all,For one of my current client's we are rectrieving a warning while syncing the odx. The task is completed and we can transfer the data. but the warning is a bit odd.We already tried to remove the folder from the data lake and try a full load. but this didn't fix the warning. Anyone any ideas?

9
Christian Hauggaard
Community Manager
1 month ago
rvgfox
Contributor
rvgfoxContributor
asked in ODX

Error in full load packages with the last version 6429.1

I’ve detected an error (sended to support) with the packages that use full load and if the incremental rule it’s defined with a datatime field.The error it’s in the ODX transfer and I’m using a SQL data source.Hope this help you.

8
Thomas Lind
Community Manager
1 month ago
ignacio
Contributor
ignacioContributor
asked in ODX

ODX task scheduke is not working

I am working on a project with 3 environments Dev, UAT, and Prod. I scheduled ODX transfer task to run every 15 minutes.But any scheduled tasks are not working, I have to run the transfer tasks manually  Regards 

15
ignacio
Contributor
1 month ago
P
Starter
Pieter-JanStarter
asked in ODX

ODX Read multiple json files from same directory

I’ve a location with multple different json files. Can i use one connector to this directory and transfer each json file, or need i to make one connector for each file? For csv files i can use one connector, for json it doesn’t seem to work this way...

4
Thomas Lind
Community Manager
1 month ago
S
Contributor
sierd.zuiderveldContributor
posted in ODX

For "Add New Table" or the "Add New Table with Field Selection" option, the fields are either randomly arranged or aligned with the source database.

We have observed an inconsistency in the field order when adding a new table from the ODX to the DSA. Depending on whether we use the "Add New Table" or the "Add New Table with Field Selection" option, the fields are either randomly arranged or aligned with the source database.When we use “Add New Table” we notice that all fields are somewhat randomly arranged. When we use “Add New Table with Field Selection” and then check all the boxes the order is exactly as in the source database (as expected).  How come that there is a difference? Is this on purpose? Thanks (TimeXtender 6346.1)

0
S
Contributor
1 month ago
I
Visitor
Ikemike
asked in ODX

Documentation to connect Hubspot

Hey.This is maybe obvious - but I’m struggling to find the proper documentation, hoping someone can point me. We have TimeXtender version (20.10.42.64) on a remote server at the company I’m with, and I'm new in a data analyst role. We have the need to connect a new data source, Hubspot, to TimeXtender.  Is there only general documentation to connect new data sources or is there specific documentation related to Hubspot?     

1
Christian Hauggaard
Community Manager
1 month ago
P
Contributor
pontus.berglundContributor
asked in ODX

Parse CSV in JSON object

Hi,I have a JSON data source that looks something like this{ "company": { "companyId": 1, "name": "AdventureWorks", "description": "" }, "hierarchies": [ { "depths": [ { "depth": 0, "name": null }, { "depth": 1, "name": "Company" } ], "allKeys": "1|-1|10" } ], "slicer": null, "userToGroup": "Username,GroupId\nJohn,G1\nSarah,G1\nPeter,G1\nKate,G1", "groupToKey": "GroupId,Key\nG1,10\nG1,101\nG1,102\nG1,103\nG1,104"}And I am only really interested in the last two objects, userToGroup and groupToKey, which both are in a CSV format. Is it possible to use something like xPath to navigate to these two objects and then parse them as CSVs? I have an RSD file that gives me userToGroup:<api:script xmlns:api="http://apiscript.com/ns?v1" xmlns:xs="http://www.w3.org/2001/XMLS

3
P
Contributor
1 month ago
wouter.goslinga
TimeXtender Xpert
wouter.goslingaTimeXtender Xpert
asked in ODX

Connect Progress database via ODBC

I am connecting to an Openedge Progress database via ODBC drivers. After finding out the password needs to be set in the registry, I am able to connect to the source (test connection from the Data Source properties is succesful).My sync task however fails because the datasource is not querying the correct metadata tables. In Progress, metadata for tables, columns and views is stored in the tables SYSTABLES, SYSVIEWS and SYSCOLUMNS. In the advanced settings of the datasource I am able to point out the correct column names, but not the correct tables (see screenshot below).Does anyone know how to point the datasource to the correct metadata tables?  

5
Thomas Lind
Community Manager
2 months ago

Badge winners

Show all badges
Terms and ConditionsCookie settings