YARN/MRv2环境搭建
搭建环境:
1)hadoop版本:0.23.1
2)Linux版本:Linux version 2.6.18-164.el5
3)操作系统:Red Hat Enterprise Linux Server release 5.4
拓扑结构:
总共四台机器(A、B、C、D)
namenode:A、B
datanode:A、B、C、D
ResourceManager:B
NodeManager:A、B、C、D
步骤:
1、下载hadoop0.23.1源代码和JAR包
wget http://labs.renren.com/apache-mirror//hadoop/core/hadoop-0.23.1/hadoop-0.23.1-src.tar.gz
wget http://labs.renren.com/apache-mirror//hadoop/core/hadoop-0.23.1/hadoop-0.23.1.tar.gz
2、安装
tar -xvzf hadoop-0.23.0.tar.gz
3、安装相关工具
1)java
略
2)protobuf
???hdfs-site.xml
?
???
???