Skip to main content
Solved

Load automatic process CVS Files


ignacio
Contributor
Forum|alt.badge.img+1

Hi community, 

 

I have to design the following issue, every day, I have a new CVS file in the Azure storage account. These file’s name change with a new day, for example

FormaExtract.net_new_commission_2023-03-01.csv

FormaExtract.net_new_commission_2023-03-02.csv

FormaExtract.net_new_commission_2023-03-03.csv

How I could create an automatic process to load a new file to the table in DSA? Now I will do it manually 

adding every day a new file an process the data.

ODX 

DSA

 

Another requirement is to create a new column SourceMainTable in the DSA table with the file’s name. 

Regards

Ignacio

Best answer by bas.hopstaken

Hi @ignacio ,

 

You can use the aggregate files option if you are using the CData CSV connector. If you use this connector, combined with the aggregate files option. A column is added that contains the source file name as well. 

It is explaned in this article:

https://support.timextender.com/data-sources-112/connect-to-csv-data-sources-732#Aggregate+multiple+files+into+one

 

View original
Did this topic help you find an answer to your question?

bas.hopstaken
TimeXtender Xpert
Forum|alt.badge.img+4

Hi @ignacio ,

 

You can use the aggregate files option if you are using the CData CSV connector. If you use this connector, combined with the aggregate files option. A column is added that contains the source file name as well. 

It is explaned in this article:

https://support.timextender.com/data-sources-112/connect-to-csv-data-sources-732#Aggregate+multiple+files+into+one

 


ignacio
Contributor
Forum|alt.badge.img+1
  • Contributor
  • March 23, 2023

Thanks, Bas! I Could design the solution!! 😁


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings