Skip to main content

Hi,

We have only source in which we are using a rest source and incrementally loading the data in the odx. The api cannot handle a date range that is too big. When we trying to preview the data in the odx, we see the data that we need. However, when we run the odx transfer task, with syncing it does not give all the updates in the table like it should. I saw that there were some fixes with the previous versions with incremental loading. We upgraded today to 6536.1. Also we upgraded the rest data source to the newest version. However, because the preview is fine, I don't think the problem is the source connector. 

Hi @spenning 

Can you please show the incremental load rules that have been setup? Also please show the output that results from the transfer task and how this differs from the desired output (i.e. the output from preview)?


Hi @Christian Hauggaard , 

I replied in this thread with my problem 

 

In the end the problem was not with the incremental load itself, but how incremental loading works. So I think it has nothing to do with the 6536.1 release. So the problem statement of this article is not really accurate anymore, I can still describe the “problem” that I also described in the article here again. Or maybe create a seperate article. Whichever you prefer @Christian Hauggaard.
 


Reply