Skip to main content
Solved

What will happen in the ODX Server - Datalake when we reach the 10.000th incremental load ?


peter.jensen
TimeXtender Xpert
Forum|alt.badge.img+2

Hi,

we have a customer running incremental loads multiple times a day in the ODX Server (using Data Lake Gen2).  We’re reaching the 10.000th incremental run.
I’m wondering how the ODX server will handle that 10.000th increment (since the naming of the parquet files allows a number up to 9999).

BR.

Peter

Best answer by Christian Hauggaard

Hi @peter.jensen 

I have tested now and the files will have the following naming after 9999 e.g. DATA_10000

I tested this by updating the batch number in the _model.json file (downloading, and uploading again with overwrite) and setting the batch number to 9999 and then running the incremental transfer task.

 

View original
Did this topic help you find an answer to your question?

3 replies

Christian Hauggaard
Community Manager
Forum|alt.badge.img+5

Hi @peter.jensen 

I have tested now and the files will have the following naming after 9999 e.g. DATA_10000

I tested this by updating the batch number in the _model.json file (downloading, and uploading again with overwrite) and setting the batch number to 9999 and then running the incremental transfer task.

 


peter.jensen
TimeXtender Xpert
Forum|alt.badge.img+2
  • Author
  • TimeXtender Xpert
  • 46 replies
  • June 26, 2023

Hi Christian,
thanks for your answer.
Did you also test the load to DSA ?  Does that also work fine ?

Best regards,

Peter


Christian Hauggaard
Community Manager
Forum|alt.badge.img+5

@peter.jensen yes I have also tested the load to the DSA, and it works as expected


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings