Solved

Load automatic process CVS Files

  • 22 March 2023
  • 2 replies
  • 65 views

Badge

Hi community, 

 

I have to design the following issue, every day, I have a new CVS file in the Azure storage account. These file’s name change with a new day, for example

FormaExtract.net_new_commission_2023-03-01.csv

FormaExtract.net_new_commission_2023-03-02.csv

FormaExtract.net_new_commission_2023-03-03.csv

How I could create an automatic process to load a new file to the table in DSA? Now I will do it manually 

adding every day a new file an process the data.

ODX 

DSA

 

Another requirement is to create a new column SourceMainTable in the DSA table with the file’s name. 

Regards

Ignacio

icon

Best answer by bas.hopstaken 22 March 2023, 19:28

View original

2 replies

Userlevel 3
Badge +4

Hi @ignacio ,

 

You can use the aggregate files option if you are using the CData CSV connector. If you use this connector, combined with the aggregate files option. A column is added that contains the source file name as well. 

It is explaned in this article:

 

Badge

Thanks, Bas! I Could design the solution!! 😁

Reply