Skip to main content
SUBMITTED

Changing default settings for ADF pipelines

  • May 23, 2024
  • 1 reply
  • 52 views

rogier.helmus
Problem Solver
Forum|alt.badge.img+1

Hello all,

When TimeXtender Data Integration deploys the extraction of a data source via Ingest instance or deploys the extraction of a table in a prepare instance from the data lake, a pipeline with a Copy Table activity is created. The Copy Table activity is configured with the following default settings:

The settings are shown when you check the progress of a running pipeline:

 

Can we increase the performance by overriding the default settings set by TDI?

  • Maximum DIU’s: we can set a value from 2 to 32
  • Degree of copy parallelism: we can set a value from 1 to 32

Curious to hear if there are any developers that have experimented with these settings. I’m planning to do some testing for myself as well.

1 reply

Christian Hauggaard
Community Manager
Forum|alt.badge.img+5

Hi @rogier.helmus 

Changing these ADF settings is not currently supported. I have converted this to a product idea