Obfuscating data

  • 23 March 2023
  • 2 replies

We are using Business unit to land our data in the DW. We have a few columns where we need to obfuscate some of the data.

At what point should a script action be placed to update the field in the raw table prior to the data being moved into the valid table, so our script does not need to include an update to the field in both the raw and valid table. 

the script uses UPDATE table SET column


Best answer by rory.smith 23 March 2023, 13:08

View original

2 replies

Userlevel 6
Badge +7

In a non-incremental table you should be able to use either Execute Post ADO.Net transfer or Pre-Data cleansing rules. I am not sure what the exact difference between the two is, it may be that the first is pre-Transformation View and the other is post.

If you have an incremental table you probably also need to do something for the full load scenario because that happens in the Deploy phase partially.

Userlevel 6
Badge +5

Hi @malkn did Rory’s answer help resolve the issue? If so please help us by marking the best answer. If you have any follow up questions please let us know