Fabric Lakehouse ODX storage

  • 2 April 2024
  • 0 replies
  • 161 views
Fabric Lakehouse ODX storage
Userlevel 6
Badge +5

Use Microsoft Fabric Lakehouse as ODX storage, and ingest data sources into Microsoft Fabric OneLake Delta Paquet format.

Prerequisites

  1. Create an App Registration in the Azure Portal - It is recommended to use a dedicated app registration to ensure this account is the only one with access to the client credentials 
  2. Add a user that does not require multi-factor authentication (i.e. a non-MFA account) as Owner of the App Registration, in order to allow for unattended re-authentication
  3. Add a platform and select Mobile and desktop application and enter https://localhost as the custom redirect URI and click Configure and then Save

    This will result in the following Redirect URIs being added automatically
  4. Navigate to Authentication settings for the App Registration. Set Allow public client flows to Yes 
  5. Create a workspace, or navigate to an existing workspace, in the Fabric portal and select Manage access. Grant the App Registration and the non-MFA account Member access to the Fabric workspace

Configure ODX instance for Fabric Lakehouse Storage

  1. Add a new ODX instance and select the storage type Microsoft Fabric Storage
  2. Enter the workspace name for the existing Fabric workspace
  3. Provide a name for the Lakehouse

    Note: You can connect to an existing Lakehouse that has been created directly in the Fabric Portal, or you can choose to create the Lakehouse within TimeXtender Desktop.

     
  4. Enter the user name and password for the non-MFA user that was setup as an owner in the App Registration
  5. Enter the Tenant id for the tenant associated with Fabric
  6. Enter the Application id for the App Registration
  7. Enter the Application Key (i.e. the client secret value) associated with the App Registration

Create the Fabric Lakehouse ODX Storage

  1. Open the TimeXtender desktop application and open the ODX instance
  2. Right-click on the ODX in the Solution Explorer tab and press Authenticate. Accept the permissions it wants to add
  3. If you haven't created the Lakehouse already, you can do it now by right-clicking on the ODX in the Solution Explorer and selecting Edit Instance, and then Create Storage 

Limitations

Fabric Lakehouse ODX storage does not currently support:

  • TimeXtender SAP Table data source
  • ODX Storage Management tasks
  • ODX Security Roles
  • Transfer to Data Warehouse instance with Snowflake storage
  • ADF Transfer to Data Warehouse instance

 


0 replies

Be the first to reply!

Reply