Configure End-to-End Orchestration and Monitoring

Generating End-to-End Tasks

You can refer to Generate End-To-End Tasks and Execution Packages for more detailed instructions on this process. A high-level overview of the steps involved is as follows: 

1. Open the desired Deliver instance that this orchestration will populate and create an execution package. Ensure that the Semantic model within the Deliver instance is added to the "Include Steps". 
2. Right-click on the execution package and select "Generate End-To-End Tasks and Packages" from the context menu.
   ​

   Note: If any changes are made to the semantic model, you can update the auto-generated objects by repeating this step.

   •  
3. This will auto-generate a perspective, an execution package in the relevant Prepare instances, and transfer tasks in the relevant Ingest instances and data sources.
   ​

Configuring On-Demand Ingestion (Optional)

The On-Demand Ingestion is a quick and easy way to ensure the data is always refreshed from the source when the Prepare instances are executed.

The high-level steps for using the On-Demand Data option is as follows: 

1. Identify the data sources that are used to populate the model. 
   • You can do this be examining the data lineage of the desired semantic model or
   • See which data sources have an auto-generated task. 
2. Right-click on the Data source and click "Edit Data Source"
3. Click on "Advanced Settings" for the data source and check the box for Enable data on demand
   ​

    

• This option allows the data source to transfer data into Ingest instance storage before the Prepare instance ingests the data.

Configure TimeXtender Orchestration

Refer to Getting Started with TimeXtender Orchestration and Scheduling TDI Execution Packages in TimeXtender Orchestration for more detailed instructions on this process. The high-level steps are as follows: 

Add the Data Provider

1. Generate an API Key in the "Security and Permissions" of the TimeXtender Portal. 
2. In the TimeXtender Orchestration Desktop, add a new Data Provider with "Demo Customer" as your system and "TimeXtender SaaS" as the data source type.
3. Paste the API key generated in the previous step and test the connection.

Create a Package

1. Add your TimeXtender Data Integration execution packages in TimeXtender Orchestration by right clicking "Packages" > "New" > "TimeXtender Prepare".
2. Select the execution package
3. Repeat this process for all the execution packages you wish to orchestrate

Add Multiple Packages to a Process

1. Right-click on "Processes" > New > Process
2. Click the button to Add Steps
3. Drag & Drop Packages from the right-side pane
4. Save your Process

Create a Process Map

1. Rick-click "Process Map" >"New" > Process Map.
2. In the right-side pane find the "Process" property, and link the process map to the process you just created.                              
3. Click "Background" to design the process map
4. Click "Items" & drag & drop your packages from the right-side pane, onto your map to display them.
   ​

    

Add a Schedule

1. Select a Predefined Schedule Group, or create a new one. 
2. Drag and drop your desired process.
3. Configure your schedule.​
4. Be sure to save & deploy your changes.