1. What is the maximum amount of virtual memory allocated for each map task before YARN will kill its Container?
Your cluster’s mapred-start.xml includes the following parameters
點選(此處)折疊或打開
<name>mapreduce.map.memory.mb</name>
<value>4096</value>
<name>mapreduce.reduce.memory.mb</name>
<value>8192</value>
And any cluster’s yarn-site.xml includes the following parameters
<name>yarn.nodemanager.vmen-pmen-ration</name>
<value>2.1</value>
What is the maximum amount of virtual memory allocated for each map task before YARN will kill its Container?
A. 4 GB B. 17.2 GB C. 8.9GB D. 8.2 GB E. 24.6 GB
問題:
每個map任務,在運作時,虛拟記憶體能夠配置設定到多大時,就會被Yarn資料總管kill掉?
解析:
參數yarn.nodemanager.vmen-pmen-ration :
是指每機關的實體記憶體總量對應的虛拟記憶體量,預設是2.1,表示每使用1MB的實體記憶體,最多可以使用2.1MB的虛拟記憶體總量。
是以map memory 目前設定是4096Mb,那麼vm的最大配置設定為(4096Mb*2.1)/1024Mb=8.4G,那麼接近答案的是D.