Hello,
My Azure SQL ERP source does not have a lastmodified datetimestamp on the tables. We’re investigating the options to enable change data capture (CDC) or change tracking (CT) on the biggest tables.
How would I proceed with further setting this up with TimeXtender? I can't find any related manuals, blogs or sources for this.
Thanks in advance!
+5Hi
As far as I know, CDC or CT is not supported. Do you have a creationdate or another date field available in your data?
Maybe you could use that field and subtract a certain number of days from it to make sure you capture all the changes. It’s not the most ideal solution, but at least you would have some sort of incremental load.
+5Hi
Depending on the data source type, you have some options.
You can do as suggested and add a subtraction on a date field.
Otherwise your option is to make a generated field in a managed query that contains a higher number or similar whenever a row is changed.
You will then need to make a managed query for each table you need this sort of incremental load on.
You can add this as an idea as well.
We actually used to have something like CDC in TX.
It was deprecated though. It wasn’t faster than running a full load, so you could achieve the same by using history tables (SCD).
So if we are to add something like this it will need to be faster than running a full load with a history table.
You did mention that it was a Azure SQL, so it isn’t available, but the REST provider also supports it.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
