This article is part of a series on How to Configure Your Server for Discovery Hub
Before connecting to the Azure Data Lake Storage for ODX in Discovery Hub, we need to create the necessary resources in Azure portal.
1. Add Data Lake Store
In Azure portal, create a Data Lake Storage account that will be used to host ODX database.
2. Add Data Lake Analytics
In Azure portal, create a Data Lake Analytics account and associate the analytics service to the previously created Data Lake Store.
3. Register application
Under Azure Active Directory, register a new application to access data lake services.
When creating the application registration, you need to set Application Type to Web app / API then use Data Lake Store URL as sign-on URL.
Under Required permissions, you need to add API called Azure Data Lake and assign “Have full access to the Azure Data Lake service” permission.
Under Keys, you need to create a new customer key. Note that this key is encrypted after save so the application key needs to be documented somewhere safe.
4. Assign application role
After the application registration is created, you need to go back to the previously created Data Lake Store and Data Lake Analytics resources. Under Access control (IAM), make the application created in previous step an owner of both resources.
You must be an OWNER of the resource to add an app as an owner.
After the configuration is completed in Azure portal, we can start to create an ODX Azure Data Lake Storage in Discovery Hub.
Name: Create a name for you Azure Data Lake Storage.
Account name: Use the name of your Data Lake Store. Note that the input only needs the name of the resource instead of the entire URL.
Folder name: Create a folder name. This folder doesn’t have to be created in Data Lake Store in advance. The root folder is always “Operational data eXchange” and this folder name will be under that.
Analytics account name: Use the name of your Data Lake Analytics. Note that the input only needs the name of the resource instead of the entire URL.
Tenant ID: This is the [Directory ID] found under properties of Azure Active Directory.
Application ID: Use the application you registered previously. The ID can be found easily under the registered app.
Application Key: Use the key you created under the application.
Analytics Units: You pay for Analytics Units (AU) time used on your Azure subscription. Adding more AUs can increase performance on Incremental Load.
With the information provided above, you should be able to create Azure Data Lake Storage successfully in Discovery Hub.