Skip to main content

Hi,
I'm using the TimeXtender CSV Data Source provider and was wondering if it's possible to combine this provider with either incremental load settings or history settings. 

I’ve tried enabling incremental load—both in the ODX and by setting the table as incremental in the first data area—but I receive the error: "The provider does not support incremental load."

Interestingly, I don't get the same error when I set the table as a history table instead, but when I try to execute the table, the result is empty.

I'm wondering if this could be due to incorrect natural key configuration from my side, or if the CSV provider simply doesn't support historical loading.

Any clarification would be appreciated. Thank you! 

 

Hey,

I already posted an Idea regarding this topic.

The new CSV Connectors unfortunately don’t handle Incremental Loading by design!

 


Hi ​@philippus.asefaw 

Nice, thank you! I will upvote this idea. 


How about history settings, does the CSV connector support history tables? 


Hi ​@annfoss 

History tables exist in a Prepare instance Data Area so yes it is supported.

If you can control a folder so it only contains the newest file you can use history settings in the table in the Data Area to avoid losing the rows that was in the previous files.

This is also the method used for REST data sources when they need to only add the new rows.


Reply