We are planning to use Export to Azure Data Lake feature in D365 F&O
My question it’s:
How can connect to the Data Lake from TX?
Or, we can connect to Synapse Analytics?
How can we make the data source setup in TX?
Best answer by JTreadwellView original
We currently do not not support ingesting common data models (CSV file with a separate JSON configuration file) such as that data lake exports from Dynamics 365. Please feel free to add an idea in the ideas section for this.
As a workaround please try using the following data source
In this moment of TX will be better to use the Synapse Analytics data source.
Do you have some guidelines to configure it?
I know we were working on just that, I mean a data source that could connect to a F&O that was exported to a data lake. I do not know the current status of that though.
What I suppose you really want is a specific F&O data source outside CData that can connect to the online version of F&O, the OnPrem SQL based one and the Data Lake exported version.
@Thomas Lind until it will be possible to connect directly to the Data Lake used by the export to data lake D365 F&O feature, I think that I can use TX to connect to Synapse Analytics that it will be used over the data lake to show tha data in a SQL serverless configuration.
I need a guideline to configure a serverless Synapse analytics connection.
Other customers/partners did this, I think, perhaps some of those can add a explanation of what they did.
To leverage the ADLS dump from D365 you would need to use CDMUtil to create views in Azure Synapse that load the data from ADLS and include the structure metadata to define fields etc. You can then set the Synapse views as a Data Source in ODX Server,
@rory.smith What type of Data source Synapse or SQL server must I configurate in TX?
If it’s SQL I know how do it, but not if it’s Synapse...
It should be Synapse, but there are quite a lot of fiddly bits. I expect you could also set up Synapse to push the view results to somewhere else, though at some performance cost.
I have not personally implemented D365 F&O using CDMUtil, but some of our customers do. I do not know what connector they use to connect to Synapse Serverless.
As far as I know connecting to Synapse Serverless using SQL connectors works as long as you do not take Synonyms across. For the 20.10.x release using BU you need to filter them out, I think it may work in the new release or with ODX Server automatically.
It is possible previews do not entirely work either, that was the case the last time I tried, but normal synchronize and transfer does work.
With PBI I can see it directly, but I don't know how to configure the data source:
The current best-practice method for ingesting D365 Data Lake export into TimeXtender is this:
If you would like to connect directly to files in an Azure Datalake:
@JTreadwell this answer it’s all I need.