标签:benchmarking
su - hdfs
PI Estimator Testing:
time hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100
TeraGen/TeraSort/TeraValidate Testing:
1. time hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teragen 10485760000 /user/hduser/input # 10,485,760,000=1000GB=1TB
2. time hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar terasort /user/hduser/input /user/hduser/output
3. time hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teravalidate /user/hduser/output /user/hduser/validate
TestDFSIO Testing:
Usage:
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar TestDFSIO -read | -write | -clean [-nrFiles N] [-fileSize MB]
1. time hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar TestDFSIO -write -nrFiles 10 -fileSize 1
2. time hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar TestDFSIO -read -nrFiles 10 -fileSize 1
3. time hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar TestDFSIO -clean
TestDFSIO, nnbench, mrbench
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar
TeraGen/TeraSort/TeraValidate , PI Estimator
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
本文出自 “Ilovecat(个人笔记)” 博客,请务必保留此出处http://hj192837.blog.51cto.com/655995/1568673
标签:benchmarking
原文地址:http://hj192837.blog.51cto.com/655995/1568673