We’re facing issues with CData REST API connector when requesting an API for a large dataset. TX sends the request, but seems to never receive a response. The execution fails when it hits the timeout limit (currently set to 3600 seconds).
In the logs (verbosity 4) I see that nothing happens between the time that the request was sent and the moment of timeout.
I put the same URI, headers and parameters in Azure Data Factory. After 9 minutes it receives a response of 204MB and 176K rows. In Postman, I received a response after 8 minutes.
While I agree that it might be better to somehow make smaller API request. In fact, when I limit the date range to only this year, TX gets a response in about a minute. However, I still expect TX/CData to finish the request when the dataset is larger and it takes more time before the response is generated by the server.
Due to NDAs I cannot post logs, RSDs or credentials here, but I’ll send some additional files via email.
Tx version 20.10.39
CData REST API version 22.0.8423.0
Best answer by Thomas LindView original