Azure Databricks Package in TimeXtender Orchestration

In this article you will learn about the Azure Databricks package type, how to create one in TimeXtender Data Orchestration and run it. 

The Azure Databricks package type allows users to run jobs that they have defined in Databricks workspaces within Azure. The package type uses the Azure Connection Data Provider type and authenticates through Azure. 
 

Create data provider 

1. Open up TimeXtender Data Orchestration. 
2. Right-click Data Providers, select New -> Data Provider. 
3. Select a name for your Data Provider. 
4. Fill in a description for your Data Provider. 
5. Select the Systems in which your Data Provider should run. 
6. Under Datasource Type, select Azure Connection. 
7. Fill in the Tenant-Id, App-Id and the Client Secret. 
8. Click Save. 

Create Azure Databricks package 

1. Right-click Packages, select New -> Databricks. 
2. Select a name for the Azure Databricks package. 
3. Select the recently created Data Provider. 
4. Select the appropriate Subscription. 
5. Select the appropriate Resource Group. 
6. Select the appropriate Databricks Workspace. 
7. Select the Databricks Job you wish the package to run. 
8. If the job requires parameters to be input before it is run you can enter them in the grid below the Jobs dropdown. 
9. Click Save, and the package is ready to be run.