Skip to main content
Solved

Best Azure VM size for ODX


sierd.zuiderveld
Contributor
Forum|alt.badge.img+1

Our ODX is hosted on a separate VM in Azure. We followed the suggestion to use the size DS2_v2, but we encountered frequent “System Out of Memory exception was thrown” errors that caused the ODX to stop. 

We are planning to switch to E2_ads_v5, which has twice the memory, but I am curious if anyone else has faced this issue and has any advice.

Best answer by bas.hopstaken

Hi @sierd.zuiderveld ,

Are you using Azure Data Lake storage? 

If so, you can use the ‘Limit memory usage when copying data to the data warehouse’  option, see  article. 

https://support.timextender.com/configure%2Dresources%2D126/use%2Dazure%2Ddata%2Dlake%2Dstorage%2Dfor%2Dyour%2Dodx%2Dinstance%2D800

Another option can be to use Azure Data Factory for copying data from Azure Data Lake to the Data Warehouse layer.

View original
Did this topic help you find an answer to your question?

3 replies

bas.hopstaken
TimeXtender Xpert
Forum|alt.badge.img+4
  • TimeXtender Xpert
  • 90 replies
  • Answer
  • October 31, 2023

Hi @sierd.zuiderveld ,

Are you using Azure Data Lake storage? 

If so, you can use the ‘Limit memory usage when copying data to the data warehouse’  option, see  article. 

https://support.timextender.com/configure%2Dresources%2D126/use%2Dazure%2Ddata%2Dlake%2Dstorage%2Dfor%2Dyour%2Dodx%2Dinstance%2D800

Another option can be to use Azure Data Factory for copying data from Azure Data Lake to the Data Warehouse layer.


sierd.zuiderveld
Contributor
Forum|alt.badge.img+1

Thanks @bas.hopstaken , that is very helpful. I had missed that feature


  • Starter
  • 1 reply
  • November 23, 2023

Hi @sierd.zuiderveld 

You can also create a monitor metric within Azure VM to see if your VM maxes out on CPU and RAM. 

See below,

 

 

Pin any of the metrics to a dashboard so you can track if you need to upgrade the VM size or anything else.

 

 


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings