Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications
Recently active
Hello,Is there any posibility to know how much data was loaded through the data warehouse during a scheduled execution package? Either through TX repository, logs or through system files in the azure database?Let’s say my customer has a databasewith 500gb worth of data, but we load only certain tables (some full, some incremental) and would like to know how much data we push every scheduled load.Thank you,Victor
When designing a model, in TX we have to options:Deploy. It deploy all the model to the server without data Execute. Reads the data from the DW and fills the model in the server.After we have the model in the server, we can use external tools like Tabular Editor or Power Bi in the service to add custom measures that it’s not possible in TX, for example calculation groups (see video from @fwagner :Until here, all ok. The problem appears wen you Execute the model again from TX that deletes all the external changes.In think that it’s an issue.
Hi,I am running a legacy version of TimeXtender (version 20.10.40.64), where we have an Excel Online connection set up using CData ADO.NET Provider for Microsoft Excel Online 2022 (22.0.8389.0) as data source.This data source is configured to authenticate via Azure ‘client flow’, see picture. The app registration in Azure has the following permissions: The data source works properly most of the time. It is able to list the worksheets it finds on the SharePoint site, and can fetch data. However, scheduled execution packages sometimes fails with the following error message:[500] Could not execute the specified command: Error while listing workbooks for drive: [generalException] General exception while processing. Details: Error while listing workbooks for drive: [generalException] General exception while processing. Module: System.Data.CData.ExcelOnline fx220l.yg at fx220l.IIu.m(Boolean ) at fx220l.IIu.X(tbp`1 , Boolean ) at fx220l.IIu.YI(LoL )
I have a table with a varchar(max) field (stored in Dedicated Pool, which is a data source). and it won’t come through to ADLS Gen2 (ODX, version 6284.1). I’m using the Azure Synapse provider.The longest field contains almost 4 million characters, but I’ve been unable to figure out whether this is a limitation in TX or Azure. Does anyone know?
Hi!I beg your pardon for this somewhat lengthy post, but I try to be thorough to avoid confusion. :)I have a problem with updating an SCD.We are moving an old adress history table from another system into a SCD in TX. It has gone well so far since the old system made one insert per person per day regardless of whether there was an update or not, which has made us go from about 108M rows to about 275k rows with actual changes. So far so good. :)The problem now is that have a hard time to get this moved table to update correctly from a new source. The setup looks like this at the moment: The MDW table KIR_Persons is the correct and prepared historical data from the old system where I have fixed the From- and To-dates along with the “Is Current” flag. The “break date” for the data from the old system is 2023-10-16 which is when I made the final export.The new source for the address data is the DSA table KI0VAA0POPULATIONPERSON_QT which is the result of a query table. I’m using the DSA vie
HiIn one of my projects, I created a model by transferring the table I received from DSA to MDW using view. When I wanted to create the relation diagram of this model, I saw that it could not establish a connection with the view and DSA table. How do I ensure the connection of all tables at the end of the project? There is no problem with Data Linage.Best Regards
Hello to the community 😀 Currently I started the TimeXtender Training. I am at the point where I have to create the instances. Adding the ODX or SSL instance was no problem. But adding the MDW instance didn’t work out for me. The problem is that i can’t select any storage in the “Server storage type” field. It just says “No items found”. (While adding the ODX instance it preselects “Azure Data Lake” and I can just switch to SQL database”, but while adding the MDW instance it doesn’t give me these options) Does this problem occur to anyone else? Do I maybe have to change any configuration before the “add data warehouse step”? Thank you in advance. Kind regards,Tobias
When we create a custom measure:TX qualifies the measure with the table name and this it’s not a good practice. It it’s the oposite that I comented in: FYI: @fwagner
We use Sharepoint for multiple data sources. Connecting the Sharepoint Lists works fine and I have a OAuth for Excel Online running as well, but my data source throws an error: Cannot find file. I need to handle multiple files according to this documentation:https://support.timextender.com/data%2Dsources%2D112/connect%2Dto%2Dexcel%2Dfiles%2Dwith%2Dexcel%2Donline%2D628 What’s the reason for this? My App Permissions are set accordingly: My Setup looks like this:
Hi,In my DSA layer I succesfully added a mapping set for which the include rule has identifed two tables. All of the columns in my DSA table have been renamed so none of them align with the original names in the ODX. As a result, the mapping set tells me all of the columns are missing: This specific table was first added to the DSA for a single ODX table, then the columns got renamed and at a later moment I wanted to replace the mapping to a mapping set. Should the mapping set be able to cope with this? In essence, it would be just like doing it manually and using the ‘smart synchronize’ option. But the mapping set does not seem to work like that.Best regards,Kaj
Hello community, Is it possible to do RegEx with TimeXtender? Or use Python code somewhere in TX that supports the library re? Our business case:- We have a database with text reviews of varying lengths, where personal information is sometimes available. We want to read the database in and anonimise the values which contain personally identifiable information. For example: "oh no, ZuzaGlog doesn't know how TimeXtender works” and we want to make it "oh no, XXXXXX doesn't know how TimeXtender works”. We currently do it in Python with the library re, and a list of possible personally identifiable information. We search through the strings with reviews using the keywords from the list, and replace hits with XXXXXX. Now we want to build this solution in TimeXtender. In what way would this be possible?
Our client has a question about a historical table in TimeXtender. They would like to know if they can make a onetime update from SSMS to populate historical records. More details on the scenario below.Scenario:Table in question is in MDW An ID merge has been done to collapse users that have created multiple accounts into on true account. Logic is done in DSA and flows to MDW. The new merged id was inserted as a new field in the MDW table, the old id was renamed. New merged id field is null for historical records where old id is populated. This makes historical queries fail.Question: Can they run a one time stored procedure in SSMS to fill in the historical records to the new merged id field? What are the potential drawbacks of this solution?
Hi community, I am trying to work with the LinkedIn API to retrieve details about UGC posts (i.e. engagements, clicks, etc.). This information is not part of the LinkedIn Marketing Solutions CDATA connector, so I am using the CDATA provider for REST 2022. I first made a call to the posts API to ‘Find Posts by Account’: Posts API - LinkedIn | Microsoft Learn. After that I need to pass each Post ID into the Organizational Entity Share Statistics API to ‘Retrieve Statistics for Specific UGC Posts’: Organization Share Statistics - LinkedIn | Microsoft Learn. The problem I am facing is that the Posts API returns two types of posts (which cannot be filtered in the API): shares and UcgPosts. Each of those types of posts needs a different URL format in the ‘Organizational Share Statistics’ API. So, I need a way to only pass one type of post into the second API. UCG posts are posts where the ID starts with 'urn:li:ugcPost:'The file RSD 1.txt works, until the first ID from the Posts API is a Ucg
I’m testing out the new version of TimeXtender. I’ve downloaded the newest version of SQL Server that was suggested in the training material. I’ve created ODX and MDW instance, when I try to deploy a table in the MDW instance I get the following error: Not supported in current SQL version Version:Microsoft SQL Server 2022 (RTM) - 16.0.1000.6 (X64) Oct 8 2022 05:58:25 Copyright (C) 2022 Microsoft Corporation Developer Edition (64-bit) on Windows 10 Enterprise 10.0 <X64> (Build 22621: ) (Hypervisor)
I’m struggling with the TimeXtender SAP Table Data Source version 18 in ODX Server v6429.1. In our current setup we use Table Name filtering like this: Please see the wildcards used. How does this translate to ODX Server v21? I have these three rules: The latter does not seem to work. I tried many variations (and did a sync data source consecutively), but when I click Select Tables under a transfer task, it only comes up with the tables matchin an equal-rule. Tables that should match a like-rule never show up: Using equal and wildcards doesn’t work either Any advice on how I should filter tables properly?
In the release notes for 6429.1 it says that conditional lookup fields are available “in preview” for deployments in Snowflake. What does this mean?
Hi community,I have a MariaDB data source which I connect to using ODX Server (v 6346) and the CData/ADO.net connector for MariaDB v 23.0.8565.0.The source database is set to collation utf8mb4_general_ci. I noticed by copying from ODX Server to a Data Area that some special characters are slightly different than the source/ODX. I can fix this by manually changing the data type to nvarchar instead of varchar, but that is a lot of field editing.The Override Data Type function can help as well, but as we have a wide range of field lengths, this also means a lot of override rules.Is there a way to tell ODX Server that all varchar fields should be unicode/nvarchar by default (eg. based on the source database collation)?Example from ODX Server. These fields should all be nvarchar(xx) instead of varchar(xx): Implementing this idea would work for me as well :) In TX v20 Business Units, we had this option:
Hi,I want to use mapping set to map several ODX tables with the same table structure to a single DW table.The problem is that I also want to create additional “custom fields” in the DW table, and since these fields do not exist in any of the ODX tables, the mapping set excludes all the ODX tables and I am left with an empty DW table. Is there a work around to this? or am I perhaps doing something wrong?This is my DW table: The bolded fields with descriptions do not have mappings to them, they instead have custom transformations.I have used “convert to mapping set” to get the mapping set, and then adjusted it so both tables match the mapping set rules.As seen below, both tables are then excluded since neither have the custom fields. Is it necessary that all fields have at least one mapping to them?
Hi,We are unable to set up Notification on Critical Errors for the ODX Server. Both service and database for the ODX is on prem. The Exchange Server is deployed as a hybrid. TimeXtender version 6221.1This is the error message: Setting up notification for the executions in the MDW’s and SSL’s is no problem. No authentication is required by the Exchange server.BRAnders
Hi all,For one of my current client's we are rectrieving a warning while syncing the odx. The task is completed and we can transfer the data. but the warning is a bit odd.We already tried to remove the folder from the data lake and try a full load. but this didn't fix the warning. Anyone any ideas?
I’ve detected an error (sended to support) with the packages that use full load and if the incremental rule it’s defined with a datatime field.The error it’s in the ODX transfer and I’m using a SQL data source.Hope this help you.
I am working on a project with 3 environments Dev, UAT, and Prod. I scheduled ODX transfer task to run every 15 minutes.But any scheduled tasks are not working, I have to run the transfer tasks manually Regards
I’ve two tables, A and B, and I want a full outter join to obtain a table C like in the image:In T-SQL it would be:SELECT COALESCE(A.Id, B.Id) AS Id ,A.ValueA AS ValueA ,B.ValueB AS ValueBFROM TableA AS A FULL OUTTER JOIN TableB AS BON A.Id=B.Id Is it the only way to use a custom view?
Hey, Usually when an execution package fails to start it is due to another already running, then in the event viewer we get a message like this: Here, we see that the issue is due to another package. Now I have noticed that we occasionally also get messages like this one: Difference being that it does not show which ‘other’ package is causing this issue. Is this a common occurrence?
Hello,We just upgraded our sandbox to release 6429.We created environments, and Copied from Dev to Test without problems in the portal. Both MDW and SSL. SSL was mapped to the correct MDW.But after we copied from Test to Prod this error came when we tried to deploye Data Area DSA in MDW Prod. Error details in attached text file.BRAnders
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.