Question

HTTP 404 error on incremental load with update & delete detection

  • 17 February 2023
  • 8 replies
  • 67 views

Badge

I am using ODX version 6143.1. When loading a table from a source system, incremental load on a datetime column (with an offset of 7 days) works fine. But when I set up the incremental load rule with Detect deletes and Detect updates selected, the first incremental load (which is the initial load) runs successful, but a second load (which should be the increment) gives me a 404 HTTP error:

Response status code does not indicate success: 404 (The specified path does not exist.).

 

Edit: problem only arises when setting the Delete detection option. When I remove this checkbox, the 404 error disappears (so the Detect primary key updates option does work correct).


8 replies

Userlevel 3
Badge +5

Hi Wouter

What is the specific Oracle provider you use? It may relate to what provider type it is.

Badge

Hi Thomas, I'm using the OracleClient Data Provider; ODX storage is ADLS gen2

Userlevel 2
Badge +3

Can you use an Oracle SQL Profiler tool to review what query statements were sent to the source for HTTP 404 error ?

Also, there is a new option for the ADO and OLEDB data sources called "Date and time syntax'

Options are: Default, ANSI, and ODBC.
For Oracle, you will need to set it to ANSI to get the date-time formatting to work.

Badge

@Syed Yousuf not sure how to use an SQL Profiler tool. I have already set the datetime syntax to ANSI (already asked this in a different topic and this was answered by you). Before setting it to ANSI the incremental load did not work at all. After setting it to ANSI, the incremental load does work correctly, but not when checking the delete detection box.

Given the fact that the error is an HTTP error I think the problem lies more on the ODX storage side, because HTTP is of course not used to connect to Oracle, but it is used to connect to the adls gen2 storage container. 

Userlevel 2
Badge +3

Hi Wouter

You may use an Oracle query Profiler tool to review what query statements were sent to the source which led to HTTP 404 error in ODX processing.  Also examine the folders in ADLS storage.

For additional troubleshooting, you may open a ticket with our support team.

Userlevel 4
Badge +5

Hi @wouter.goslinga did you manage to resolve the error? Would you like to setup a screenshare to investigate further?

Badge

Hi @Christian Hauggaard , no it is not solved yet, setting up a screenshare would be a good idea, i'll send you a DM.

Userlevel 4
Badge +5

Hi @wouter.goslinga thanks for the call. What was the outcome of the test with the TimeXtender Oracle data source? Did you experience the same issue there, or was it only for the OracleClient Data Provider data source?

 

Reply