标签:
CLUSTERED BY 将数据分组以进入不同的bucket中 INTO num_buckets BUCKETS]With the following options:
Option | Description |
-c CORES | The number of cores on each host. |
-m MEMORY | The amount of memory on each host in GB. |
-d DISKS | The number of disks on each host. |
-k HBASE | "True" if HBase is installed, "False" if not. |
Note: You can also use the -h
or --help
option to display a Help message that describes the options.
Running the following command:
[root@jason3 scripts]# python yarn-utils.py -c 24 -m 64 -d 12 -k False
Using cores=24 memory=64GB disks=12 hbase=False
Profile: cores=24 memory=57344MB reserved=8GB usableMem=56GB disks=12
Num Container=22
Container Ram=2560MB
Used Ram=55GB
Unused Ram=8GB
yarn.scheduler.minimum-allocation-mb=2560
yarn.scheduler.maximum-allocation-mb=56320
yarn.nodemanager.resource.memory-mb=56320
mapreduce.map.memory.mb=2560
mapreduce.map.java.opts=-Xmx2048m
mapreduce.reduce.memory.mb=2560
mapreduce.reduce.java.opts=-Xmx2048m
yarn.app.mapreduce.am.resource.mb=2560
yarn.app.mapreduce.am.command-opts=-Xmx2048m
mapreduce.task.io.sort.mb=1024
[root@jason3 scripts]#
标签:
原文地址:http://www.cnblogs.com/zwCHAN/p/4494053.html