Ask questions about Ingest Instances in TimeXtender Data Integration
Recently active
I have a table with a varchar(max) field (stored in Dedicated Pool, which is a data source). and it won’t come through to ADLS Gen2 (ODX, version 6284.1). I’m using the Azure Synapse provider.The longest field contains almost 4 million characters, but I’ve been unable to figure out whether this is a limitation in TX or Azure. Does anyone know?
We use Sharepoint for multiple data sources. Connecting the Sharepoint Lists works fine and I have a OAuth for Excel Online running as well, but my data source throws an error: Cannot find file. I need to handle multiple files according to this documentation:https://support.timextender.com/data%2Dsources%2D112/connect%2Dto%2Dexcel%2Dfiles%2Dwith%2Dexcel%2Donline%2D628 What’s the reason for this? My App Permissions are set accordingly: My Setup looks like this:
Hi community, I am trying to work with the LinkedIn API to retrieve details about UGC posts (i.e. engagements, clicks, etc.). This information is not part of the LinkedIn Marketing Solutions CDATA connector, so I am using the CDATA provider for REST 2022. I first made a call to the posts API to ‘Find Posts by Account’: Posts API - LinkedIn | Microsoft Learn. After that I need to pass each Post ID into the Organizational Entity Share Statistics API to ‘Retrieve Statistics for Specific UGC Posts’: Organization Share Statistics - LinkedIn | Microsoft Learn. The problem I am facing is that the Posts API returns two types of posts (which cannot be filtered in the API): shares and UcgPosts. Each of those types of posts needs a different URL format in the ‘Organizational Share Statistics’ API. So, I need a way to only pass one type of post into the second API. UCG posts are posts where the ID starts with 'urn:li:ugcPost:'The file RSD 1.txt works, until the first ID from the Posts API is a Ucg
I’m struggling with the TimeXtender SAP Table Data Source version 18 in ODX Server v6429.1. In our current setup we use Table Name filtering like this: Please see the wildcards used. How does this translate to ODX Server v21? I have these three rules: The latter does not seem to work. I tried many variations (and did a sync data source consecutively), but when I click Select Tables under a transfer task, it only comes up with the tables matchin an equal-rule. Tables that should match a like-rule never show up: Using equal and wildcards doesn’t work either Any advice on how I should filter tables properly?
Hi community,I have a MariaDB data source which I connect to using ODX Server (v 6346) and the CData/ADO.net connector for MariaDB v 23.0.8565.0.The source database is set to collation utf8mb4_general_ci. I noticed by copying from ODX Server to a Data Area that some special characters are slightly different than the source/ODX. I can fix this by manually changing the data type to nvarchar instead of varchar, but that is a lot of field editing.The Override Data Type function can help as well, but as we have a wide range of field lengths, this also means a lot of override rules.Is there a way to tell ODX Server that all varchar fields should be unicode/nvarchar by default (eg. based on the source database collation)?Example from ODX Server. These fields should all be nvarchar(xx) instead of varchar(xx): Implementing this idea would work for me as well :) In TX v20 Business Units, we had this option:
Hi,We are unable to set up Notification on Critical Errors for the ODX Server. Both service and database for the ODX is on prem. The Exchange Server is deployed as a hybrid. TimeXtender version 6221.1This is the error message: Setting up notification for the executions in the MDW’s and SSL’s is no problem. No authentication is required by the Exchange server.BRAnders
Hi all,For one of my current client's we are rectrieving a warning while syncing the odx. The task is completed and we can transfer the data. but the warning is a bit odd.We already tried to remove the folder from the data lake and try a full load. but this didn't fix the warning. Anyone any ideas?
I’ve detected an error (sended to support) with the packages that use full load and if the incremental rule it’s defined with a datatime field.The error it’s in the ODX transfer and I’m using a SQL data source.Hope this help you.
I am working on a project with 3 environments Dev, UAT, and Prod. I scheduled ODX transfer task to run every 15 minutes.But any scheduled tasks are not working, I have to run the transfer tasks manually Regards
I’ve a location with multple different json files. Can i use one connector to this directory and transfer each json file, or need i to make one connector for each file? For csv files i can use one connector, for json it doesn’t seem to work this way...
Hey.This is maybe obvious - but I’m struggling to find the proper documentation, hoping someone can point me. We have TimeXtender version (20.10.42.64) on a remote server at the company I’m with, and I'm new in a data analyst role. We have the need to connect a new data source, Hubspot, to TimeXtender. Is there only general documentation to connect new data sources or is there specific documentation related to Hubspot?
Hi,I have a JSON data source that looks something like this{ "company": { "companyId": 1, "name": "AdventureWorks", "description": "" }, "hierarchies": [ { "depths": [ { "depth": 0, "name": null }, { "depth": 1, "name": "Company" } ], "allKeys": "1|-1|10" } ], "slicer": null, "userToGroup": "Username,GroupId\nJohn,G1\nSarah,G1\nPeter,G1\nKate,G1", "groupToKey": "GroupId,Key\nG1,10\nG1,101\nG1,102\nG1,103\nG1,104"}And I am only really interested in the last two objects, userToGroup and groupToKey, which both are in a CSV format. Is it possible to use something like xPath to navigate to these two objects and then parse them as CSVs? I have an RSD file that gives me userToGroup:<api:script xmlns:api="http://apiscript.com/ns?v1" xmlns:xs="http://www.w3.org/2001/XMLS
I am connecting to an Openedge Progress database via ODBC drivers. After finding out the password needs to be set in the registry, I am able to connect to the source (test connection from the Data Source properties is succesful).My sync task however fails because the datasource is not querying the correct metadata tables. In Progress, metadata for tables, columns and views is stored in the tables SYSTABLES, SYSVIEWS and SYSCOLUMNS. In the advanced settings of the datasource I am able to point out the correct column names, but not the correct tables (see screenshot below).Does anyone know how to point the datasource to the correct metadata tables?
What does “Remove Unused Objects” do? I cannot find documentation about it. Thx!
Hello, To my understanding TimeXtender determines the data type of a column based on first x amount of rows, depending on your setup in the portal. The fields in my source come in as (dd.mm.yyy) for example: "05.03.2021”. I use a Storage Account with a CSV connection. I would expect that TimeXtender creates a "date” date type out of this. However, is seems that if a field character starts with a '0’, it skips it. In the ODX it shows an Integer value '5032023’.ODX: Depending if a character starts with a '0’ the fields (dates) show up like: It counts for all date fields and costs me a lot of time to create a work around each time. I tried to override the datatype in my data source but without succes. Help would be much appreciated.
At one of my clients we are using the ODX and they set it up that for every different type of load they added the data source multiple times. So for the normal full loads there is 1 source . For the incremental loads of the same source there is a different source.In the data source selection the include only the tables they need for the full load. and they do the same for the incremental. But from time to time task wil not execute without showing up in the execution log without an error. I have the feeling that because the includes je indirectly exclude the other tables and if they are running at the same time this cancels each other out. In the windows logs you can see that the package then is skipped but it's no where to be found in TX.Does anyone have an explenation about this and/or an idea how we can fix this?My idea was that maybe putting everything in 1 source and then create 2 different transfer task instead of 2 different sources would fix this problem. Would love to hear from
Why does the app registration for the ODX need owner permissions on the resource? I would think that read/write permissions would be sufficient. Why does TimeXtender need the “extra” rights?
The ODX server stopped (per 25/8) synchronizing it's job status with the portal.Restarting the ODX Server does not solve the issue. Any tips?
Hi team! I am contacting you because I am trying to transfer data from MariaDB to ODX and I received the following errorfailed with error:System.FormatException: The DateTime represented by the string is not supported in calendar Any suggestion to solve it? Regards Ignacio
New fields from source are not showing in the Data Movement pane.New fields are added to the source database, the new fields and data are in the ODX, I can see the new fields in the parquet files, but the fields are not showing in the Data Movement pane.I have tried to run the function in ODX “Synchronize Object”I have tried to run the “Synchronize” task in the odxI’m Running Timextender Version 6346.1
Hi All, Is it possible to use an SAP Theobald Extractor with incremental load and that just for 1 table ( or more, but not all the tables? We tried is on one table and we got an error message saying we needed to change all the tables into incremental load.Kind regards, Eric
Dear all,I'm trying to set up a completely new ODX Server. I've installed the ODX server and made all the required configuration. When th ODX Server needs to connect to its instance i'm getting this error:I've checked all the firewall settings and I've done all the checks in this document: Configure your Firewall | Community (timextender.com). Furthermore we've added the timeXtender.exe and the OdxServerConfig.exe to the whitelist of the Windows defender firewall.The weird thing is that aswel TimeXtender as the ODX Server config can find the instance, but still we're getting this error. Does anyone know what I'm doing wrong? Error occurred while determining instance version or during performing aut. upgrade:A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: TCP Provider, error
We are running an environment on two servers. One DEV and one PRD server. The instances are copied from the DEV to PRD server, both ODX and MDW. Apparently the jobs are also copied. After refreshing the list I'm adding jobs to run the production ODX. As we can see below I can choose between both the DEV and PRD ODX's : However. If I select the ODX Just Brands Production / JB NAV / Full Load NAV. It jumps back to ODX Just Brands / JB NAV / Full Load NAV, running the DEV ODX. Why is this?
Our machine runs in UTC+2.00, whilst our Azure databases (by default) run on UTC time. Now when we schedule an ODX Transfer task, the interface let's us schedule these tasks in UTC time. The Execution logs of a transfer task are also in UTC time. However, schedules for execution packages are in local time, UTC 2.00, and therefore there logs are also in UTC 2.00. I guess my question is, why is this the case? Both the ODX & Execution service are services on the same machine with UTC 2.00. Both the ODX as well as the MDW and the project repo are azure db's in UTC. Why would one use the machine time and the other the azure db timezone? And is there a way to make them the same other than resetting the machine time to UTC? Version 20.10.37
TX: 6284.1Is there a reason why Lineage generated from the Data Source Explorer in the ODX Server includes the downstream stuff in a DWH instance whereas generating Lineage from a field in a Data Area in the DWH instance does not show the ODX part of the lineage?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.