hadoop环境装配之单机模式

hadoop环境安装之单机模式

?

1.下载hadoop安装包?? wget http://apache.etoak.com//hadoop/common/hadoop-0.20.203.0/hadoop-0.20.203.0rc1.tar.gz?2.解压?? tar zxvf? hadoop-0.20.203.0rc1.tar.gz?3.设置环境变量?? 将解压出来的hadoop目录export到环境变量中?4.在hadoop环境变量中设置JAVA_HOME?? vi hadoop-env.sh中写入??? export JAVA_HOME=/home/ymkyve/ytool/jdk1.6.0_24?5.安装ssh 及设置自动登录?? $ sudo apt-get install ssh

? CLASS=org.apache.hadoop.util.RunJar
? HADOOP_OPTS="$HADOOP_OPTS $HADOOP_CLIENT_OPTS"
? HADOOP_OPTS="$HADOOP_OPTS -Xdebug -Xrunjdwp:transport=dt_socket,address=8787,server=y,suspend=y"加上这段?input/test.txt

aababdc

执行go.sh脚本即可? rm -rf output
hadoop jar hadoop-test.jar input output
查看output的结果#vi part-r-00000

a       1aa      1b       2c       1d       1

?

查看更多 下一篇