Skip to main content
Question

Full Load Transfer vs. On-Demand Execution

  • March 14, 2025
  • 1 reply
  • 21 views

Hey there,

We used to have the On-Demand setting enabled for one of our data sources. With this setting turned on, the package that executes the corresponding tables would take roughly one hour to complete.

Recently, we switched to a Full Load Transfer Task, followed by an Execute Tables package. However, now the transfer/ingestion process takes almost 2.5 hours (and then another 20 minutes to execute the tables).

We thoroughly checked to ensure that the tables included in the Full Load are the same as those processed with On-Demand, and they are.

In the logs I can see a lot of these messages (every 5 minutes), so I am wondering how much time the full transfer is idly waiting. 

 

1 reply

Christian Hauggaard
Community Manager
Forum|alt.badge.img+5

@Mvest can you please confirm if you were you running incremental load before you switched to full load?


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings