Prepare

v20.10.36.64Hi,I have a project that is loading data from the ledger table into the staging database with approx, 5m records.When manually executing the load, the ADO.NET transfer is taking 5-6 minutes, but the cleansing rules can take hours, to the point I have to terminate the load.Is there any troubleshooting I can perform on the cleansing steps? I know I have taken the easy option on joins where the data types differ, and wonder if that is now compounding the issue?Any tips or pointers greatly appreciated.Thanks,Richard

Hi,I would like to do a “range lookup”. Because I can't solve it using a conditional lookup, I used a custom field transformation. My code looks like this:CASE    WHEN substring([SBIcode_cleansed], 1, 1) like '[^0-9]' THEN                    (SELECT [kvk_groep_omschrijving]                     FROM  [dsa].[SBIcode_groepering]                             where [SBIcode] = [SBIcode_cleansed]                   ) --'test1'   ELSE                   (SELECT [kvk_groep_omschrijving]                     FROM  [dsa].[SBIcode_groepering]                            where substring([SBIcode_cleansed], 1, 2) >= [min_sbi_code]                              and substring([SBIcode_cleansed], 1, 2) <= [max_sbi_code]                   )--'test2'   END It seems that a subquery is not possible because I get an error message that more than one value is retrieved using the subquery but that is no

If you add a new field with the deploy only option, to an existing table with data, there are two diferent behaviors, depending if the table has incremental rule defined or not.This is controled by this setting: By default it’s cleared for “normal” tables and setted to incremental tables.I think the behavior should always be the same or at least get a warning message

I’ve detected that if you have the same table in DSA and MDW. let say DSA.Invoices and MDW.Invoices for example, and you define partition for that, both tables share the same partition schemas and partition functions in the SQL Server database.It’s a problem when you try to add or remove field from whatever table.

I discovered that when using the replace transformation with the CharType that you are required to know or look up the int value of the character you want to replace and use that as the parameter.This does not seem to be documented anywhere or be useful in any way I can think of. I assume REPLACE('abc’, char(65), 'b’) is functionally equivalent to REPLACE('abc’, 'a’, 'b’). In a Case Insensitive collation there is no difference between the two anyhow.There is also no COLLATION or binary type support, which are things that you can do with REPLACE() that might actually be useful in certain rare cases. 

I’ve a query table created to my D365 F&O data source like you can see in this screenshot: The query returns data as you can see in the query tool (it would be nice to be able to run it in the “Manage Query Tables” window too): But, If try to Synchronize ODX Objects: I get an error and there is not the table if I try to remap it:  And when I deploy and execute

Greetings,I have an odd error and trying to eliminate where this issue is coming from.I have a server running SQL server 2016 and TX is running on top of that. The version of TX I am running is 20.10.15.64 in Server 1.The errors I am getting are attached. TX is running ok in Server 1 which is DB server.There is Analysis Server 2 which seems to be an issue and is creating the errors above.The attached error is coming from PowerBI Report Server interface. We are using Microsoft PowerBI tool for our reports. I have increased memory allocation in Server 1 where TX is running and issue seems to still be there.Our products are all 64bit version.Any Idea or view of what could be causing this.  

Hi, Is it possible to add object security rules on a _R table from within TimeXtender?  Thx! 

I would like to share with you this diagram that shows the architecture of our data platform with TX.Perhaps it will be another recomended architectures and I would like to know it and start a discussion about this topic.  

When I remove a MDW-table from the project it remains available in the MDW-database.How do I completely remove the table so I can start over (create a new table using the old name)

We are implementing a data warehouse with data from Dynamics 365 F&O and I’m thinking that we will have money data from UK in pounds and from Spain in euros and we will need currency conversion (based on time) to resolve this situation.Some body has considered this situation?How must it be implemented? 

If i try to add a dataselection rule my tables stay empty.Tried allready the selection rule on the table and with an without ‘ ‘ If i do the same in the query tool it looks good. Is it a bug?Using version 6143.1

After manually executing a package, where do I find a log that shows the # of rows processed per table?  I'm trying to verify my incremental loads are working properly

The following article describes several types of data masking: https://legacysupport.timextender.com/hc/en-us/articles/5463363539101-Dynamic-Data-Masking .Does TimeXtender allow custom data masking as well? The example table shown at the top of this article is exactly what I am trying to accomplish. However, the article doesn't describe this type of masking, does it?  

I have a transaction table in odx with the following fields (simplified)Key,Value, transactiondate Example100, V100, 2023-01-01100, V100A,2023-01-31 09100, V100B,2023-01-31 10 Each day there are multiple transactions added , of course with  another transaction date.Note in the example I  have only shown the date part (not hours, minutes, seconds) What I need is a table with the latest update in DSAI created the same table. Set primary key to KEY and added an incremental selection rule on transactiondate . Added history settings to update the Value and transaction date based on the keyWhere it goes wrong is if we get in one day multiple transactions 100, V100A,2023-01-31 09100, V100B,2023-01-31 10I traced down the cleansing procedure and Tx detects that there are twice the same key. So far so good.Next it puts the ID of  the latest transcation into <table>_L  and only process

Dear Community,I like to build my data estates with supernatural keys but in lager datasets the data cleansing starts to take very, very long. Do you happen to have the same issues? Is there a way to make the supernatural keys load faster? Even with incremental loading it begins to be super slow:I've ran a test on 435,397 records. This is on a Azure SQL with 10 vCores1. is a full load on the table with 7 supernatural keys.2. is a full load on the same table without the supernatural keys.1 has data cleansing of 1 second. 2 has a data cleansing of 104 seconds!Second I've done a test on the same tables but now incremental loads:1. incremental load with 7 supernatural keys2. incremental load without supernatural keys1 has a data cleansing time 1,6 seconds and 2 a data cleansing

Hi, I have a list that maps product_codes to product_ID's.What I would like to create is a Key Store that, when fed a product_code from the list, produces the same product_ID and when fed a new code (so not in list) produces a supernatural_key as usual. Is it possible to force the keystore to create the ID's as shown above? 

The setup phases are confusing, can anyone explain where exactly they run? The Pre script runs previously to insert the records in the valid table, it’s correct in my case, but the post script that must be run after the records inset, doesn’t run.My script it’s: 

Does anyone know whether or not the rules you put in the over ride data types area are applied sequentially like they would be in a SQL case statement (i.e. once a field evaluates to TRUE it ignores the subsequent logic)?

I would like to run a job only if the number of records in the raw table it’s diferent of the number of records in the valid table wit a condition.How can I do it?

Data in the context of GDPR or sensitive to stock markets require attention in the datawarehouse with regard to securing the data, in some cases this also to the people developing the datawarehouse. We have been looking into several options, and now plan to do a proof of concept on transparent data encryption.   Anybody experience with securing sensitive data in the datawarehouse, either with this setting or in other ways?

Hello!!Please help to figuer out this error "The given value of type String from the data source cannot be converted to type nvarchar of the specified target column" while pulling data from source to stage.Anyone Who Can Help!!!

The autoindexes doesn’t created in the physical table 

Did anyone notice that these functions do not seem to work directly on a field? I always have to create a new one to use trim function on the original filed. Am I missing something?I would like to avoid the repetitive process of manually creating additional fields when I have a table which needs TRIM.

Hi.I have a question for you all:I have a table for example link thisfiled_name:FormatProduct_id: IntegerDelivery_metod: varchar(50)Inventory_id: IntegerInventory_Entries: JSONInventory_entries can contain one or several entries in JSON format like this:[{"SKU":"A","Price":"100"},{"SKU":"B","Price":""00"}]Instead off one line with the json entries nested into one single field i would like to Normalize the tabel into several lines, one for each SKU.Any ideas?