Solved

Error during filtering ODX Azure Data Factory-DSA

  • 11 January 2023
  • 1 reply
  • 96 views

Badge

Hi,

Our customer uses the new TimeXtender version with ODX (Azure Datalake). MDW (Azure SQL Database) and also uses the NAV connector. We experience issues when adding data selection rules in MDW layer on existing tables. 

 

System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}
   --- End of inner exception stack trace ---
   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)
   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String pipelineName)
   at ODXConnectorEngine.ConnectorEngine.<>c__DisplayClass5_0.<ExecuteTable>b__0(DiscoveryHubSQLExecutionMethod transferMethod)
   at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.RunDiscoveryHubTransferMethod(Action`1 action)
   at ODXConnectorEngine.ConnectorEngine.ExecuteTable(IDataStorageEngine storageEngine, DiscoveryHubSQLDefaultExecutionModel transferModel, ODXEndpoint storageEndpoint, DataSourceModel dataSourceModel, TableModel tableModel)
   at ExecutionEngine.Action.OutboundDefaultTransferAction.Execute()
   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()
   at System.Threading.Tasks.Task.Execute()
   --- End of inner exception stack trace ---
---> (Inner Exception #0) System.AggregateException: Pipeline execution failed ---> System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}
   --- End of inner exception stack trace ---
   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)
   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String pipelineName)
   at ODXConnectorEngine.ConnectorEngine.<>c__DisplayClass5_0.<ExecuteTable>b__0(DiscoveryHubSQLExecutionMethod transferMethod)
   at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.RunDiscoveryHubTransferMethod(Action`1 action)
   at ODXConnectorEngine.ConnectorEngine.ExecuteTable(IDataStorageEngine storageEngine, DiscoveryHubSQLDefaultExecutionModel transferModel, ODXEndpoint storageEndpoint, DataSourceModel dataSourceModel, TableModel tableModel)
   at ExecutionEngine.Action.OutboundDefaultTransferAction.Execute()
   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()
   at System.Threading.Tasks.Task.Execute()
---> (Inner Exception #0) System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}<---

---> (Inner Exception #1) System.Exception: {
  "errorCode": "BadRequest",
  "message": "The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA",
  "details": ""
}<---
<---

Details:

System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: { ...
Module: timeXtender
System.Exception
   at TimeXtender.DataManager.StepTransferExecute.DoDataWarehouse(IStepSetup stepSetup, List`1 mergeODXTransferInfromation, VariableResolveObject dynamicResolveObject)
   at TimeXtender.DataManager.StepTransferExecute.DoAbstractStep(IStepSetup stepSetup)
 

icon

Best answer by JTreadwell 12 January 2023, 03:28

View original

1 reply

Userlevel 3
Badge +5

Hi @Michel van Drunen, It appears from the error you are also using Azure Data Factory for transfer, correct? Can you tell us a bit more about the selection rule? A screenshot would be helpful. 

You can also take a look into the Data Factory Pipeline run where you might find more details on the error. 

Reply