Skip to main content
Solved

Error during filtering ODX Azure Data Factory-DSA

  • January 11, 2023
  • 1 reply
  • 124 views

Forum|alt.badge.img

Hi,

Our customer uses the new TimeXtender version with ODX (Azure Datalake). MDW (Azure SQL Database) and also uses the NAV connector. We experience issues when adding data selection rules in MDW layer on existing tables. 

 

System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}
   --- End of inner exception stack trace ---
   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)
   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String pipelineName)
   at ODXConnectorEngine.ConnectorEngine.<>c__DisplayClass5_0.<ExecuteTable>b__0(DiscoveryHubSQLExecutionMethod transferMethod)
   at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.RunDiscoveryHubTransferMethod(Action`1 action)
   at ODXConnectorEngine.ConnectorEngine.ExecuteTable(IDataStorageEngine storageEngine, DiscoveryHubSQLDefaultExecutionModel transferModel, ODXEndpoint storageEndpoint, DataSourceModel dataSourceModel, TableModel tableModel)
   at ExecutionEngine.Action.OutboundDefaultTransferAction.Execute()
   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()
   at System.Threading.Tasks.Task.Execute()
   --- End of inner exception stack trace ---
---> (Inner Exception #0) System.AggregateException: Pipeline execution failed ---> System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}
   --- End of inner exception stack trace ---
   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)
   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String pipelineName)
   at ODXConnectorEngine.ConnectorEngine.<>c__DisplayClass5_0.<ExecuteTable>b__0(DiscoveryHubSQLExecutionMethod transferMethod)
   at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.RunDiscoveryHubTransferMethod(Action`1 action)
   at ODXConnectorEngine.ConnectorEngine.ExecuteTable(IDataStorageEngine storageEngine, DiscoveryHubSQLDefaultExecutionModel transferModel, ODXEndpoint storageEndpoint, DataSourceModel dataSourceModel, TableModel tableModel)
   at ExecutionEngine.Action.OutboundDefaultTransferAction.Execute()
   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()
   at System.Threading.Tasks.Task.Execute()
---> (Inner Exception #0) System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}<---

---> (Inner Exception #1) System.Exception: {
  "errorCode": "BadRequest",
  "message": "The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA",
  "details": ""
}<---
<---

Details:

System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: { ...
Module: timeXtender
System.Exception
   at TimeXtender.DataManager.StepTransferExecute.DoDataWarehouse(IStepSetup stepSetup, List`1 mergeODXTransferInfromation, VariableResolveObject dynamicResolveObject)
   at TimeXtender.DataManager.StepTransferExecute.DoAbstractStep(IStepSetup stepSetup)
 

Best answer by JTreadwell

Hi @Michel van Drunen, It appears from the error you are also using Azure Data Factory for transfer, correct? Can you tell us a bit more about the selection rule? A screenshot would be helpful. 

You can also take a look into the Data Factory Pipeline run where you might find more details on the error. 

View original
Did this topic help you find an answer to your question?

1 reply

JTreadwell
Employee
Forum|alt.badge.img+5
  • Employee
  • 179 replies
  • Answer
  • January 12, 2023

Hi @Michel van Drunen, It appears from the error you are also using Azure Data Factory for transfer, correct? Can you tell us a bit more about the selection rule? A screenshot would be helpful. 

You can also take a look into the Data Factory Pipeline run where you might find more details on the error. 


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings