I'd like to suggest an enhancement for Timextender connectors (CSV, Excel, JSON, XML): the ability to load data incrementally. In my current setup, I receive new text files daily, and adding a new data area significantly prolongs the loading process.
Since CData had it’s own way of incrementally loading text files I think it would be a great opportunity to bring a more efficient handling to the Timextender Connectors.
SUBMITTED
Add Incremental Load Option to CSV, Excel, JSON, and XML
+1
Agreed, this is essential for loading data from many individual files. Being able to load only new files, based off of the file's CreatedDateTime/LastModifiedDateTime (ideally combining it with a PK field) would make this much more valuable.
Please consider adding this as a feature!
+5I am not sure CData could do proper incremental load based on new files. The only one it worked for was Excel as it only could connect to one file at a time.
It would pull all the data into memory and then apply a rule onto that, it wasn’t exactly a good method.
+8Hi,
it should be fairly easy to use file and folder metadata to determine new files to load. Incrementally loading inside files will not give performance benefits for regular filetypes. It should be possible for parquet files though as those are stored to enable such scenarios.
It typically isn't possbile to change the whole folder structure or move files around to do this outside of TimeXtender, so having these kind of options in the TX native connectors for file-based sources would be a huge benefit.
+5Update — partially delivered. Incremental load is now available for JSON and XML files (and Parquet) as of the May 13, 2026 data source provider release. Incremental load for CSV and Excel is in active development, targeted for end of June 2026, and we'll update this idea when it lands.
Release notes: https://support.timextender.com/product-updates/data-source-providers-r-2026-05-13-3945
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
