Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications
Recently active
HelloI need the creation date and time (createdAt) of a CSV file within the MDW table as a column. How can I access this information?Best Regards
In order to retrieve meteorological data from The Netherlands, we want to use the Open Data API developed by the Dutch Meteorological Institute (KNMI). This website contains all relevant information on using the API.In summary, these are the steps that we want to undertake. Anyone can do this, because of the anonymous API key that is open to public:Locate the ‘Anonymous API key’, can be found on the KNMI documentation website Determine the dataset name, version and filename to establish the correct endpoint In this example we want to use the following endpoint: https://api.dataplatform.knmi.nl/open-data/v1/datasets/etmaalgegevensKNMIstations/versions/1/files/KIS___OPER_P___OBS_____L2.nc/url Execute the GET call (make sure to use Authorization header in combination with the anonymous API key The GET call returns a download URL pointing to the KNMI Amazone AWS storage which can be easily used in Postman to retrieve the data (in x-netcdf format)Would you like to try the above in Postman a
Our ODX is hosted on a separate VM in Azure. We followed the suggestion to use the size DS2_v2, but we encountered frequent “System Out of Memory exception was thrown” errors that caused the ODX to stop. We are planning to switch to E2_ads_v5, which has twice the memory, but I am curious if anyone else has faced this issue and has any advice.
Dear Support,My customer is having some troubles with executing a tabular semantic model. This customer has three semantic models, Finance, Sales and Logistics. Finance and Sales are running fine, but Logistics sometimes give the error "The stream does not have an active operation!”.I solve this issue by doing a Full process on the model in SQL Management Studio. But what I want to know is what causes this error? As I said Finance and Sales are running fine, but Logistics gives this error now and then.See the file in the attachment for the error. TimeXtender version: 6346.1
We have created several jobs on our ODX and several jobs on our DataWarehouse. The ODX jobs are running correctly based on schedule, but the Datawarehouse jobs never run since there is a schedule.We've also deployed and saved our project, so that should not be the problem.
Hello,Is there any posibility to know how much data was loaded through the data warehouse during a scheduled execution package? Either through TX repository, logs or through system files in the azure database?Let’s say my customer has a databasewith 500gb worth of data, but we load only certain tables (some full, some incremental) and would like to know how much data we push every scheduled load.Thank you,Victor
When designing a model, in TX we have to options:Deploy. It deploy all the model to the server without data Execute. Reads the data from the DW and fills the model in the server.After we have the model in the server, we can use external tools like Tabular Editor or Power Bi in the service to add custom measures that it’s not possible in TX, for example calculation groups (see video from @fwagner :Until here, all ok. The problem appears wen you Execute the model again from TX that deletes all the external changes.In think that it’s an issue.
Hi,I am running a legacy version of TimeXtender (version 20.10.40.64), where we have an Excel Online connection set up using CData ADO.NET Provider for Microsoft Excel Online 2022 (22.0.8389.0) as data source.This data source is configured to authenticate via Azure ‘client flow’, see picture. The app registration in Azure has the following permissions: The data source works properly most of the time. It is able to list the worksheets it finds on the SharePoint site, and can fetch data. However, scheduled execution packages sometimes fails with the following error message:[500] Could not execute the specified command: Error while listing workbooks for drive: [generalException] General exception while processing. Details: Error while listing workbooks for drive: [generalException] General exception while processing. Module: System.Data.CData.ExcelOnline fx220l.yg at fx220l.IIu.m(Boolean ) at fx220l.IIu.X(tbp`1 , Boolean ) at fx220l.IIu.YI(LoL )
I have a table with a varchar(max) field (stored in Dedicated Pool, which is a data source). and it won’t come through to ADLS Gen2 (ODX, version 6284.1). I’m using the Azure Synapse provider.The longest field contains almost 4 million characters, but I’ve been unable to figure out whether this is a limitation in TX or Azure. Does anyone know?
Hi!I beg your pardon for this somewhat lengthy post, but I try to be thorough to avoid confusion. :)I have a problem with updating an SCD.We are moving an old adress history table from another system into a SCD in TX. It has gone well so far since the old system made one insert per person per day regardless of whether there was an update or not, which has made us go from about 108M rows to about 275k rows with actual changes. So far so good. :)The problem now is that have a hard time to get this moved table to update correctly from a new source. The setup looks like this at the moment: The MDW table KIR_Persons is the correct and prepared historical data from the old system where I have fixed the From- and To-dates along with the “Is Current” flag. The “break date” for the data from the old system is 2023-10-16 which is when I made the final export.The new source for the address data is the DSA table KI0VAA0POPULATIONPERSON_QT which is the result of a query table. I’m using the DSA vie
HiIn one of my projects, I created a model by transferring the table I received from DSA to MDW using view. When I wanted to create the relation diagram of this model, I saw that it could not establish a connection with the view and DSA table. How do I ensure the connection of all tables at the end of the project? There is no problem with Data Linage.Best Regards
Hello to the community 😀 Currently I started the TimeXtender Training. I am at the point where I have to create the instances. Adding the ODX or SSL instance was no problem. But adding the MDW instance didn’t work out for me. The problem is that i can’t select any storage in the “Server storage type” field. It just says “No items found”. (While adding the ODX instance it preselects “Azure Data Lake” and I can just switch to SQL database”, but while adding the MDW instance it doesn’t give me these options) Does this problem occur to anyone else? Do I maybe have to change any configuration before the “add data warehouse step”? Thank you in advance. Kind regards,Tobias
When we create a custom measure:TX qualifies the measure with the table name and this it’s not a good practice. It it’s the oposite that I comented in: FYI: @fwagner
We use Sharepoint for multiple data sources. Connecting the Sharepoint Lists works fine and I have a OAuth for Excel Online running as well, but my data source throws an error: Cannot find file. I need to handle multiple files according to this documentation:https://support.timextender.com/data%2Dsources%2D112/connect%2Dto%2Dexcel%2Dfiles%2Dwith%2Dexcel%2Donline%2D628 What’s the reason for this? My App Permissions are set accordingly: My Setup looks like this:
Hi,In my DSA layer I succesfully added a mapping set for which the include rule has identifed two tables. All of the columns in my DSA table have been renamed so none of them align with the original names in the ODX. As a result, the mapping set tells me all of the columns are missing: This specific table was first added to the DSA for a single ODX table, then the columns got renamed and at a later moment I wanted to replace the mapping to a mapping set. Should the mapping set be able to cope with this? In essence, it would be just like doing it manually and using the ‘smart synchronize’ option. But the mapping set does not seem to work like that.Best regards,Kaj
Hello community, Is it possible to do RegEx with TimeXtender? Or use Python code somewhere in TX that supports the library re? Our business case:- We have a database with text reviews of varying lengths, where personal information is sometimes available. We want to read the database in and anonimise the values which contain personally identifiable information. For example: "oh no, ZuzaGlog doesn't know how TimeXtender works” and we want to make it "oh no, XXXXXX doesn't know how TimeXtender works”. We currently do it in Python with the library re, and a list of possible personally identifiable information. We search through the strings with reviews using the keywords from the list, and replace hits with XXXXXX. Now we want to build this solution in TimeXtender. In what way would this be possible?
Our client has a question about a historical table in TimeXtender. They would like to know if they can make a onetime update from SSMS to populate historical records. More details on the scenario below.Scenario:Table in question is in MDW An ID merge has been done to collapse users that have created multiple accounts into on true account. Logic is done in DSA and flows to MDW. The new merged id was inserted as a new field in the MDW table, the old id was renamed. New merged id field is null for historical records where old id is populated. This makes historical queries fail.Question: Can they run a one time stored procedure in SSMS to fill in the historical records to the new merged id field? What are the potential drawbacks of this solution?
Hi community, I am trying to work with the LinkedIn API to retrieve details about UGC posts (i.e. engagements, clicks, etc.). This information is not part of the LinkedIn Marketing Solutions CDATA connector, so I am using the CDATA provider for REST 2022. I first made a call to the posts API to ‘Find Posts by Account’: Posts API - LinkedIn | Microsoft Learn. After that I need to pass each Post ID into the Organizational Entity Share Statistics API to ‘Retrieve Statistics for Specific UGC Posts’: Organization Share Statistics - LinkedIn | Microsoft Learn. The problem I am facing is that the Posts API returns two types of posts (which cannot be filtered in the API): shares and UcgPosts. Each of those types of posts needs a different URL format in the ‘Organizational Share Statistics’ API. So, I need a way to only pass one type of post into the second API. UCG posts are posts where the ID starts with 'urn:li:ugcPost:'The file RSD 1.txt works, until the first ID from the Posts API is a Ucg
I’m testing out the new version of TimeXtender. I’ve downloaded the newest version of SQL Server that was suggested in the training material. I’ve created ODX and MDW instance, when I try to deploy a table in the MDW instance I get the following error: Not supported in current SQL version Version:Microsoft SQL Server 2022 (RTM) - 16.0.1000.6 (X64) Oct 8 2022 05:58:25 Copyright (C) 2022 Microsoft Corporation Developer Edition (64-bit) on Windows 10 Enterprise 10.0 <X64> (Build 22621: ) (Hypervisor)
I’m struggling with the TimeXtender SAP Table Data Source version 18 in ODX Server v6429.1. In our current setup we use Table Name filtering like this: Please see the wildcards used. How does this translate to ODX Server v21? I have these three rules: The latter does not seem to work. I tried many variations (and did a sync data source consecutively), but when I click Select Tables under a transfer task, it only comes up with the tables matchin an equal-rule. Tables that should match a like-rule never show up: Using equal and wildcards doesn’t work either Any advice on how I should filter tables properly?
In the release notes for 6429.1 it says that conditional lookup fields are available “in preview” for deployments in Snowflake. What does this mean?
Hi community,I have a MariaDB data source which I connect to using ODX Server (v 6346) and the CData/ADO.net connector for MariaDB v 23.0.8565.0.The source database is set to collation utf8mb4_general_ci. I noticed by copying from ODX Server to a Data Area that some special characters are slightly different than the source/ODX. I can fix this by manually changing the data type to nvarchar instead of varchar, but that is a lot of field editing.The Override Data Type function can help as well, but as we have a wide range of field lengths, this also means a lot of override rules.Is there a way to tell ODX Server that all varchar fields should be unicode/nvarchar by default (eg. based on the source database collation)?Example from ODX Server. These fields should all be nvarchar(xx) instead of varchar(xx): Implementing this idea would work for me as well :) In TX v20 Business Units, we had this option:
Hi,I want to use mapping set to map several ODX tables with the same table structure to a single DW table.The problem is that I also want to create additional “custom fields” in the DW table, and since these fields do not exist in any of the ODX tables, the mapping set excludes all the ODX tables and I am left with an empty DW table. Is there a work around to this? or am I perhaps doing something wrong?This is my DW table: The bolded fields with descriptions do not have mappings to them, they instead have custom transformations.I have used “convert to mapping set” to get the mapping set, and then adjusted it so both tables match the mapping set rules.As seen below, both tables are then excluded since neither have the custom fields. Is it necessary that all fields have at least one mapping to them?
Hi,We are unable to set up Notification on Critical Errors for the ODX Server. Both service and database for the ODX is on prem. The Exchange Server is deployed as a hybrid. TimeXtender version 6221.1This is the error message: Setting up notification for the executions in the MDW’s and SSL’s is no problem. No authentication is required by the Exchange server.BRAnders
Hi all,For one of my current client's we are rectrieving a warning while syncing the odx. The task is completed and we can transfer the data. but the warning is a bit odd.We already tried to remove the folder from the data lake and try a full load. but this didn't fix the warning. Anyone any ideas?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.