Error: "Error while copying content to a stream" for SQL data source transfer task

Symptoms:

Error during transfer task while ingesting data from a SQL server data source to an Ingest instance with Azure Data Lake storage. The error message typically includes:

Cause:

The issue is likely related to concurrency settings and resource limitations.

Resolution:

1. Increase Timeout Settings:

• Increase the timeouts for the Data Lake Ingest Instance in the TDI portal.

• Ensure the timeout is set to a value that accommodates the data transfer size.

2. Reduce Concurrent Execution Threads:

• Lower the number of concurrent execution threads to e.g. 2.

• This can be done in the Ingest Instance data source advanced settings.

3. Monitor and Adjust Resource Allocation:

• If reducing the threads resolves the issue, consider scaling up the VM running the Ingest Instance Server to handle more concurrent tasks.

• Monitor the performance and adjust CPU and memory allocation as needed.

Reference Ticket:

34258

Reference Links:

• Troubleshooting concurrency issues in Ingest Instance data sources