Skip to main content
Solved

Obfuscating data


We are using Business unit to land our data in the DW. We have a few columns where we need to obfuscate some of the data.

At what point should a script action be placed to update the field in the raw table prior to the data being moved into the valid table, so our script does not need to include an update to the field in both the raw and valid table. 

the script uses UPDATE table SET column

Best answer by rory.smith

In a non-incremental table you should be able to use either Execute Post ADO.Net transfer or Pre-Data cleansing rules. I am not sure what the exact difference between the two is, it may be that the first is pre-Transformation View and the other is post.

If you have an incremental table you probably also need to do something for the full load scenario because that happens in the Deploy phase partially.

View original
Did this topic help you find an answer to your question?

2 replies

rory.smith
TimeXtender Xpert
Forum|alt.badge.img+7
  • TimeXtender Xpert
  • 649 replies
  • Answer
  • March 23, 2023

In a non-incremental table you should be able to use either Execute Post ADO.Net transfer or Pre-Data cleansing rules. I am not sure what the exact difference between the two is, it may be that the first is pre-Transformation View and the other is post.

If you have an incremental table you probably also need to do something for the full load scenario because that happens in the Deploy phase partially.


Christian Hauggaard
Community Manager
Forum|alt.badge.img+5

Hi @malkn did Rory’s answer help resolve the issue? If so please help us by marking the best answer. If you have any follow up questions please let us know


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings