Follow

Is source based incremental load possible on separate date and time fields?

All fields within a single incremental selection rule (a single line in the user interface) uses the AND operator.

With this in mind a scenario like this is not supported. We have two separate fields

[Created Date]

[Created Time]

The incremental selection rule translates this into the following SQL WHERE clause:

WHERE [Created Date] > [Las Max Value For Date] AND [Created Time] > [Last Max Value For Time]

Alternate implementation

  1. Create a single incremental selection rule based only on the date field
  2. Add a subtraction of 1 day for the date field

This will be translated into the following SQL WHERE clause:

WHERE [Created Date] > [Las Max Value For Date Minus 1 day]

Effectively this will give you one days overlapping data, which would then be handled by the incremental insert handling on the destination side. There will be no redundant data as a result of this overlap.

Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.