Skip to main content
Solved

Soft deletes with incremental load in the ODX

  • January 31, 2025
  • 3 replies
  • 33 views

Hi

I have an incremental table with soft deletes enabled in my extract layer (data area). Additionally, I have set up an incremental rule for the SQL data source in the ODX. I was wondering if an hard delete occurs in the SQL data base, will the ODX still be able to detect this such that the incremental table in the data area can mark the record as TombStone?

Best answer by Thomas Lind

Hi ​@annfoss 

Soft or hard deletes can only be detected if it has been set on the data source in the ODX / Ingest instance.

When deletes are turned on on the data source it will create an extra table or folder ending in _PK. This contains all primary key variations there is in the source. This is then compared to what is in the valid table and then it will remove or set the check in the data area table.

View original
Did this topic help you find an answer to your question?

Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • January 31, 2025

Hi ​@annfoss 

Soft or hard deletes can only be detected if it has been set on the data source in the ODX / Ingest instance.

When deletes are turned on on the data source it will create an extra table or folder ending in _PK. This contains all primary key variations there is in the source. This is then compared to what is in the valid table and then it will remove or set the check in the data area table.


  • Participant
  • January 31, 2025

Thank you, ​@Thomas Lind! So when I have enabled the “handle soft deletes” and also have enabled the “Handle primary key deletes” under additional actions in the ODX the TombStone-field will work as expected? 


Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • January 31, 2025

Hi ​@annfoss 

Yes, when you have done that it will add a true false value to the added tombstone field.


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings