Solved

Best Azure VM size for ODX

  • 31 October 2023
  • 3 replies
  • 87 views

Userlevel 3
Badge +1

Our ODX is hosted on a separate VM in Azure. We followed the suggestion to use the size DS2_v2, but we encountered frequent “System Out of Memory exception was thrown” errors that caused the ODX to stop. 

We are planning to switch to E2_ads_v5, which has twice the memory, but I am curious if anyone else has faced this issue and has any advice.

icon

Best answer by bas.hopstaken 31 October 2023, 09:34

View original

3 replies

Userlevel 3
Badge +4

Hi @sierd.zuiderveld ,

Are you using Azure Data Lake storage? 

If so, you can use the ‘Limit memory usage when copying data to the data warehouse’  option, see  article. 

https://support.timextender.com/configure%2Dresources%2D126/use%2Dazure%2Ddata%2Dlake%2Dstorage%2Dfor%2Dyour%2Dodx%2Dinstance%2D800

Another option can be to use Azure Data Factory for copying data from Azure Data Lake to the Data Warehouse layer.

Userlevel 3
Badge +1

Thanks @bas.hopstaken , that is very helpful. I had missed that feature

Hi @sierd.zuiderveld 

You can also create a monitor metric within Azure VM to see if your VM maxes out on CPU and RAM. 

See below,

 

 

Pin any of the metrics to a dashboard so you can track if you need to upgrade the VM size or anything else.

 

 

Reply