Solved

What will happen in the ODX Server - Datalake when we reach the 10.000th incremental load ?

  • 7 June 2023
  • 3 replies
  • 67 views

Badge +2

Hi,

we have a customer running incremental loads multiple times a day in the ODX Server (using Data Lake Gen2).  We’re reaching the 10.000th incremental run.
I’m wondering how the ODX server will handle that 10.000th increment (since the naming of the parquet files allows a number up to 9999).

BR.

Peter

icon

Best answer by Christian Hauggaard 8 June 2023, 11:19

View original

3 replies

Userlevel 6
Badge +5

Hi @peter.jensen 

I have tested now and the files will have the following naming after 9999 e.g. DATA_10000

I tested this by updating the batch number in the _model.json file (downloading, and uploading again with overwrite) and setting the batch number to 9999 and then running the incremental transfer task.

 

Badge +2

Hi Christian,
thanks for your answer.
Did you also test the load to DSA ?  Does that also work fine ?

Best regards,

Peter

Userlevel 6
Badge +5

@peter.jensen yes I have also tested the load to the DSA, and it works as expected

Reply