Skip to main content

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?

 

 

https://youtu.be/Jfm8R1-qLuI


Hi Satish,


1. Have you run Synchronize task after configuring "Filter Rows"?


2. If you just apply "Filter Rows" and remove "incremental load" on this table (for testing), does it work as expected?


I was able to follow the video and setup some steps. I see its a volume problem on my end ...Still trying to figure out the same. You an close this for now ...Thanks


Dear Satish,

Maybe the Query Tables can offer some assistance. It might be easy to create different Queries and store the data in increments and then consolidate the data again in the Data warehouse. 


Reply