Skip to main content

Hi community, 

 

I have to design the following issue, every day, I have a new CVS file in the Azure storage account. These file’s name change with a new day, for example

FormaExtract.net_new_commission_2023-03-01.csv

FormaExtract.net_new_commission_2023-03-02.csv

FormaExtract.net_new_commission_2023-03-03.csv

How I could create an automatic process to load a new file to the table in DSA? Now I will do it manually 

adding every day a new file an process the data.

ODX 

DSA

 

Another requirement is to create a new column SourceMainTable in the DSA table with the file’s name. 

Regards

Ignacio

Hi @ignacio ,

 

You can use the aggregate files option if you are using the CData CSV connector. If you use this connector, combined with the aggregate files option. A column is added that contains the source file name as well. 

It is explaned in this article:

 


Thanks, Bas! I Could design the solution!! 😁


Reply