Use Microsoft Fabric Lakehouse as ODX storage, and ingest data sources into Microsoft Fabric OneLake Delta Paquet format.
Prerequisites
- Create an App Registration in the Azure Portal - It is recommended to use a dedicated app registration to ensure this account is the only one with access to the client credentials
- Add a user that does not require multi-factor authentication (i.e. a non-MFA account) as Owner of the App Registration, in order to allow for unattended re-authentication
- Add a platform and select Mobile and desktop application and enter https://localhost as the custom redirect URI and click Configure and then Save
This will result in the following Redirect URIs being added automatically - Navigate to Authentication settings for the App Registration. Set Allow public client flows to Yes
- Create a workspace, or navigate to an existing workspace, in the Fabric portal and select Manage access. Grant the App Registration and the non-MFA account Member access to the Fabric workspace
Configure ODX instance for Fabric Lakehouse Storage
- Add a new ODX instance and select the storage type Microsoft Fabric Storage
- Enter the workspace name for the existing Fabric workspace
- Provide a name for the Lakehouse
Note: You can connect to an existing Lakehouse that has been created directly in the Fabric Portal, or you can choose to create the Lakehouse within TimeXtender Desktop.
- Enter the user name and password for the non-MFA user that was setup as an owner in the App Registration
- Enter the Tenant id for the tenant associated with Fabric
- Enter the Application id for the App Registration
- Enter the Application Key (i.e. the client secret value) associated with the App Registration
Create the Fabric Lakehouse ODX Storage
- Open the TimeXtender desktop application and open the ODX instance
- Right-click on the ODX in the Solution Explorer tab and press Authenticate. Accept the permissions it wants to add
- If you haven't created the Lakehouse already, you can do it now by right-clicking on the ODX in the Solution Explorer and selecting Edit Instance, and then Create Storage
Limitations
Fabric Lakehouse ODX storage does not currently support:
- TimeXtender SAP Table data source
- ODX Storage Management tasks
- ODX Security Roles
- Transfer to Data Warehouse instance with Snowflake storage
- ADF Transfer to Data Warehouse instance