TimeXtender Version 20.10.35.64
I'm integrating 6 SQL databases/sources from the same ERP at the moment and want to set up incremental loading on my data source & DSA. I followed the basic steps but it seems like refreshing the incremental DSA tables takes way longer than a full load.
The ODX datasources incremental LOAD tasks from all 6 data sources finish under 60 seconds, but the DSA load for e.g. AP_Products table now takes almost 15 minutes, for ± 40.000 rows, against 3 minutes for a full load.
![](https://uploads-eu-west-1.insided.com/timextender-en/attachment/a9b8cc45-785d-402c-88da-6965ab9844d0.png)
My Last modified DateTime column is ‘Date_Captured’ and is applied on the tables below. For all the 4 tables the PK's are set up.
![](https://uploads-eu-west-1.insided.com/timextender-en/attachment/f53477be-0287-4043-b656-583b4ae76673.png)
![](https://uploads-eu-west-1.insided.com/timextender-en/attachment/fcbdafa0-0088-4713-aa56-94cb9ce93d8b.png)
In the DSA I included column ‘Source’ in every table, which represents DW_SourceCode, to the PK of the tables to have an unique identifier per row.
![](https://uploads-eu-west-1.insided.com/timextender-en/attachment/538c8a96-dc26-44e6-8568-0e49168acb2e.png)
However, it looks like I'm doing something wrong or i’m missing a step, since it takes forever to refresh these DSA tables now
Best answer by daniel
View original