Skip to main content
SUBMITTED

Optimize ADF transfers from ADLS to SQL DB by dropping raw indexes before transfer

Related products:TimeXtender Data Integration
  • July 18, 2023
  • 0 replies
  • 25 views

rory.smith
TimeXtender Xpert
Forum|alt.badge.img+8

When executing a table in a DWH instance that will copy data from Azure Data Lake Storage through Azure Data Factory it would be more optimal to drop any indexes on the raw table before bulk transfer.

If you look at a running pipeline, ADF will also give you this tip.

I think this should always be applied; I don't think there is a situation where inserting into a raw table with indexes active is required. Same goes for non-ADF transfers I would expect.