Skip to main content
To homepage To homepage
Solved

CSV Connector Compatibility with Incremental or History Settings?

A
Participant

Hi,
I'm using the TimeXtender CSV Data Source provider and was wondering if it's possible to combine this provider with either incremental load settings or history settings. 

I’ve tried enabling incremental load—both in the ODX and by setting the table as incremental in the first data area—but I receive the error: "The provider does not support incremental load."

Interestingly, I don't get the same error when I set the table as a history table instead, but when I try to execute the table, the result is empty.

I'm wondering if this could be due to incorrect natural key configuration from my side, or if the CSV provider simply doesn't support historical loading.

Any clarification would be appreciated. Thank you! 

 

Best answer by Thomas Lind

Hi ​@annfoss 

History tables exist in a Prepare instance Data Area so yes it is supported.

If you can control a folder so it only contains the newest file you can use history settings in the table in the Data Area to avoid losing the rows that was in the previous files.

This is also the method used for REST data sources when they need to only add the new rows.

View original
Did this topic help you find an answer to your question?

4 replies

P
Starter
Forum|alt.badge.img

Hey,

I already posted an Idea regarding this topic.

The new CSV Connectors unfortunately don’t handle Incremental Loading by design!

 

A
Participant
  • annfoss
  • Author
  • Participant
  • 18 replies
  • April 4, 2025

Hi ​@philippus.asefaw 

Nice, thank you! I will upvote this idea. 

P
1 person likes this
  • P
    philippus.asefaw
A
Participant
  • annfoss
  • Author
  • Participant
  • 18 replies
  • April 7, 2025

How about history settings, does the CSV connector support history tables? 

Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Thomas Lind
  • Community Manager
  • 1070 replies
  • Answer
  • April 7, 2025

Hi ​@annfoss 

History tables exist in a Prepare instance Data Area so yes it is supported.

If you can control a folder so it only contains the newest file you can use history settings in the table in the Data Area to avoid losing the rows that was in the previous files.

This is also the method used for REST data sources when they need to only add the new rows.

A
1 person likes this
  • A
    annfoss

Reply


Most helpful members this week

Terms and ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings