Skip to main content

Hi,

Our customer uses the new TimeXtender version with ODX (Azure Datalake). MDW (Azure SQL Database) and also uses the NAV connector. We experience issues when adding data selection rules in MDW layer on existing tables. 

 

System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}
   --- End of inner exception stack trace ---
   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)
   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String pipelineName)
   at ODXConnectorEngine.ConnectorEngine.<>c__DisplayClass5_0.<ExecuteTable>b__0(DiscoveryHubSQLExecutionMethod transferMethod)
   at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.RunDiscoveryHubTransferMethod(Action`1 action)
   at ODXConnectorEngine.ConnectorEngine.ExecuteTable(IDataStorageEngine storageEngine, DiscoveryHubSQLDefaultExecutionModel transferModel, ODXEndpoint storageEndpoint, DataSourceModel dataSourceModel, TableModel tableModel)
   at ExecutionEngine.Action.OutboundDefaultTransferAction.Execute()
   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()
   at System.Threading.Tasks.Task.Execute()
   --- End of inner exception stack trace ---
---> (Inner Exception #0) System.AggregateException: Pipeline execution failed ---> System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}
   --- End of inner exception stack trace ---
   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)
   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String pipelineName)
   at ODXConnectorEngine.ConnectorEngine.<>c__DisplayClass5_0.<ExecuteTable>b__0(DiscoveryHubSQLExecutionMethod transferMethod)
   at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.RunDiscoveryHubTransferMethod(Action`1 action)
   at ODXConnectorEngine.ConnectorEngine.ExecuteTable(IDataStorageEngine storageEngine, DiscoveryHubSQLDefaultExecutionModel transferModel, ODXEndpoint storageEndpoint, DataSourceModel dataSourceModel, TableModel tableModel)
   at ExecutionEngine.Action.OutboundDefaultTransferAction.Execute()
   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()
   at System.Threading.Tasks.Task.Execute()
---> (Inner Exception #0) System.Exception: {
  "errorCode": "ActionFailed",
  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA LOOP",
  "details": ""
}<---

---> (Inner Exception #1) System.Exception: {
  "errorCode": "BadRequest",
  "message": "The request failed with status code '\"BadRequest\"'.",
  "failureType": "UserError",
  "target": "TIMEXTENDER COPY DATA",
  "details": ""
}<---
<---

Details:

System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: { ...
Module: timeXtender
System.Exception
   at TimeXtender.DataManager.StepTransferExecute.DoDataWarehouse(IStepSetup stepSetup, List`1 mergeODXTransferInfromation, VariableResolveObject dynamicResolveObject)
   at TimeXtender.DataManager.StepTransferExecute.DoAbstractStep(IStepSetup stepSetup)
 

Hi @Michel van Drunen, It appears from the error you are also using Azure Data Factory for transfer, correct? Can you tell us a bit more about the selection rule? A screenshot would be helpful. 

You can also take a look into the Data Factory Pipeline run where you might find more details on the error. 


Reply