Skip to main content

Use Microsoft Fabric Lakehouse as Ingest Instance storage, and ingest data sources into Microsoft Fabric OneLake Delta Paquet format.

Prerequisites

  1. Create an App Registration in the Azure Portal - It is recommended to use a dedicated app registration to ensure this account is the only one with access to the client credentials 
  2. Add a user that does not require multi-factor authentication (i.e. a non-MFA account) as Owner of the App Registration, in order to allow for unattended re-authentication
  3. Add a platform and select Mobile and desktop application and enter https://localhost as the custom redirect URI and click Configure and then Save

    This will result in the following Redirect URIs being added automatically
  4. Navigate to Authentication settings for the App Registration. Set Allow public client flows to Yes 
  5. In Fabric/Power BI Admin Portal, enable “allow service principals to use Power BI APIs” as described here, in order to grant the app registration access to the Fabric workspace.
  6. Create a workspace, or navigate to an existing workspace, in the Fabric portal and select Manage access. Grant the App Registration and the non-MFA account Member access to the Fabric workspace

Configure Ingest Instance for Fabric Lakehouse Storage

  1. Add a new Ingest instance and select the storage type Microsoft Fabric Storage
  2. Enter the workspace name for the existing Fabric workspace
  3. Provide a name for the Lakehouse

    Note: You can connect to an existing Lakehouse that has been created directly in the Fabric Portal, or you can choose to create the Lakehouse within TimeXtender Data Integration (TDI).

     
  4. Enter the user name and password for the non-MFA user that was setup as an owner in the App Registration

     

  5. Enter the Tenant id for the tenant associated with Fabric
  6. Enter the Application id for the App Registration
  7. Enter the Application Key (i.e. the client secret value) associated with the App Registration

Create the Fabric Lakehouse Ingest Instance Storage

  1. Open the TimeXtender Data Integration (TDI) application and open the Ingest instance
  2. Right-click on the Ingest Instance in the Solution Explorer tab and press Authenticate. Accept the permissions it wants to add
  3. If you haven't created the Lakehouse already, you can do it now by right-clicking on the Ingest Instance in the Solution Explorer and selecting Edit Instance, and then Create Storage 

Limitations

Fabric Lakehouse Ingest Instance storage does not currently support:

  • TimeXtender SAP Table data source
  • Ingest Storage Management tasks
  • Ingest Security Roles
  • Transfer to Prepare instance with Snowflake storage
  • ADF Transfer to Prepare instance

 

Be the first to reply!

Reply