Prepare

Greetings,I have an odd error and trying to eliminate where this issue is coming from.I have a server running SQL server 2016 and TX is running on top of that. The version of TX I am running is 20.10.15.64 in Server 1.The errors I am getting are attached. TX is running ok in Server 1 which is DB server.There is Analysis Server 2 which seems to be an issue and is creating the errors above.The attached error is coming from PowerBI Report Server interface. We are using Microsoft PowerBI tool for our reports. I have increased memory allocation in Server 1 where TX is running and issue seems to still be there.Our products are all 64bit version.Any Idea or view of what could be causing this.  

Hi, Is it possible to add object security rules on a _R table from within TimeXtender?  Thx! 

I would like to share with you this diagram that shows the architecture of our data platform with TX.Perhaps it will be another recomended architectures and I would like to know it and start a discussion about this topic.  

When I remove a MDW-table from the project it remains available in the MDW-database.How do I completely remove the table so I can start over (create a new table using the old name)

We are implementing a data warehouse with data from Dynamics 365 F&O and I’m thinking that we will have money data from UK in pounds and from Spain in euros and we will need currency conversion (based on time) to resolve this situation.Some body has considered this situation?How must it be implemented? 

If i try to add a dataselection rule my tables stay empty.Tried allready the selection rule on the table and with an without ‘ ‘ If i do the same in the query tool it looks good. Is it a bug?Using version 6143.1

After manually executing a package, where do I find a log that shows the # of rows processed per table?  I'm trying to verify my incremental loads are working properly

The following article describes several types of data masking: https://legacysupport.timextender.com/hc/en-us/articles/5463363539101-Dynamic-Data-Masking .Does TimeXtender allow custom data masking as well? The example table shown at the top of this article is exactly what I am trying to accomplish. However, the article doesn't describe this type of masking, does it?  

I have a transaction table in odx with the following fields (simplified)Key,Value, transactiondate Example100, V100, 2023-01-01100, V100A,2023-01-31 09100, V100B,2023-01-31 10 Each day there are multiple transactions added , of course with  another transaction date.Note in the example I  have only shown the date part (not hours, minutes, seconds) What I need is a table with the latest update in DSAI created the same table. Set primary key to KEY and added an incremental selection rule on transactiondate . Added history settings to update the Value and transaction date based on the keyWhere it goes wrong is if we get in one day multiple transactions 100, V100A,2023-01-31 09100, V100B,2023-01-31 10I traced down the cleansing procedure and Tx detects that there are twice the same key. So far so good.Next it puts the ID of  the latest transcation into <table>_L  and only processes the ID’s that ar not in <table>_LThe result is that I get  100, V100A,2023-01-31 09 which is incor

Dear Community,I like to build my data estates with supernatural keys but in lager datasets the data cleansing starts to take very, very long. Do you happen to have the same issues? Is there a way to make the supernatural keys load faster? Even with incremental loading it begins to be super slow:I've ran a test on 435,397 records. This is on a Azure SQL with 10 vCores1. is a full load on the table with 7 supernatural keys.2. is a full load on the same table without the supernatural keys.1 has data cleansing of 1 second. 2 has a data cleansing of 104 seconds!Second I've done a test on the same tables but now incremental loads:1. incremental load with 7 supernatural keys2. incremental load without supernatural keys1 has a data cleansing time 1,6 seconds and 2 a data cleansing of a whopping 129 seconds!I'm not so sure I want to keep using the supernatural keys. What do you guys do? Take care= Daniel

Hi, I have a list that maps product_codes to product_ID's.What I would like to create is a Key Store that, when fed a product_code from the list, produces the same product_ID and when fed a new code (so not in list) produces a supernatural_key as usual. Is it possible to force the keystore to create the ID's as shown above? 

The setup phases are confusing, can anyone explain where exactly they run? The Pre script runs previously to insert the records in the valid table, it’s correct in my case, but the post script that must be run after the records inset, doesn’t run.My script it’s: 

Does anyone know whether or not the rules you put in the over ride data types area are applied sequentially like they would be in a SQL case statement (i.e. once a field evaluates to TRUE it ignores the subsequent logic)?

I would like to run a job only if the number of records in the raw table it’s diferent of the number of records in the valid table wit a condition.How can I do it?

Data in the context of GDPR or sensitive to stock markets require attention in the datawarehouse with regard to securing the data, in some cases this also to the people developing the datawarehouse. We have been looking into several options, and now plan to do a proof of concept on transparent data encryption.   Anybody experience with securing sensitive data in the datawarehouse, either with this setting or in other ways?

Hello!!Please help to figuer out this error "The given value of type String from the data source cannot be converted to type nvarchar of the specified target column" while pulling data from source to stage.Anyone Who Can Help!!!

The autoindexes doesn’t created in the physical table 

Did anyone notice that these functions do not seem to work directly on a field? I always have to create a new one to use trim function on the original filed. Am I missing something?I would like to avoid the repetitive process of manually creating additional fields when I have a table which needs TRIM.

Hi.I have a question for you all:I have a table for example link thisfiled_name:FormatProduct_id: IntegerDelivery_metod: varchar(50)Inventory_id: IntegerInventory_Entries: JSONInventory_entries can contain one or several entries in JSON format like this:[{"SKU":"A","Price":"100"},{"SKU":"B","Price":""00"}]Instead off one line with the json entries nested into one single field i would like to Normalize the tabel into several lines, one for each SKU.Any ideas?

Hi, with this snippet:  I get an error in deploy: The sippet it’s correct as you can see in: 

Hi,Our customer uses the new TimeXtender version with ODX (Azure Datalake). MDW (Azure SQL Database) and also uses the NAV connector. We experience issues when adding data selection rules in MDW layer on existing tables.  System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: {  "errorCode": "ActionFailed",  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",  "failureType": "UserError",  "target": "TIMEXTENDER COPY DATA LOOP",  "details": ""}   --- End of inner exception stack trace ---   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String p

When you add tables to a DWH data area (from an Azure Data Lake backed ODX) and subsequently perform a Deploy & Execute, data is loaded normally as expected. In this example I am adding AW2014's Person.Person and Sales.SalesPerson tables. I subsequently want to add a field where I add a transformation to generate the full name for a person (Firstname + ' ’ + Lastname). When I add this field with the transformation and perform a Deploy & Execute, the field is not populated.The reason for this is probably the same reason under: https://legacysupport.timextender.com/hc/en-us/requests/25792 I would expect changes to ETL to trigger a full reload without needing to either change the Table Settings > Data Extraction > Full Load or perform a cumbersome full reload through D&E > Review tasks.Given that this issue seems generic and not only limited to Historiy tables, it is probably a good idea to solve this generally as well.

When using the Data Profile function on the Person.Person table in the AdventureWorks2014 database I see strange results for the highest and lowest occurence in the LastName field: Diaz is the highest and Billstrom is the lowest. In reality Abbas is the lowest when sorting by LastName ASC where count(*) == 1 I am not entirely sure that 'Highest occurence’ is clear to everyone that is not a natvie speaker: you could also assume this should be the highest sorted value.

Hi all,  I need to create an Identity column, How could I create it in TX? Thanks Ignacio

Hi, Let's assume I am importing from CSV file. The Data is very dirty and somehow I have stings in my int filed "ID" so the filed is interpreted as NVARCHAR(MAX). If I change data type of the field (right click > Edit Field) from string back to integer I receive a runtime error during the execution. What I was expecting was to see was corresponding entries in the _M and _L tables. Is this not part of data cleansing after all? We have this problem all over and could not find a better solution than to build custom views with TRY_CAST etc. where we lose lineage etc. What is the best way to clean up such data (keep valid rows, write errors/warnings on invalid rows)? We are talking 100+ tables so I'm looking for a highly scalable solution here not a one time work around. Thanks and BR, Tobias