64位的CentOS上編譯 Hadoop 2.2.0

[b]編譯需要安裝的軟體：[/b]

1.yum install  svn
2.yum install  autoconfautomake libtool cmake
3.yum install  ncurses-devel
4.yum install  openssl-devel
5.yum install  gcc*
6.wget http://mirror.esocc.com/apache/maven/maven-3/3.1.4/binaries/apache-maven-3.1.4-bin.tar.gz
7.wget https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz
$ tar zxf protobuf-2.5.0.tar.gz
           

[b]1. 下載下傳Hadoop 2.2.0 源碼包，并解壓[/b]

$ wget http://mirrors.hust.edu.cn/apache/hadoop/common/hadoop-2.2.0/hadoop-2.2.0-src.tar.gz
$ tar zxf hadoop-2.2.0-src.tar.gz
           

[b]2. 安裝下面的軟體[/b]

$ sudo yum install cmake lzo-devel  zlib-devel  gcc autoconf automake libtool   ncurses-devel openssl-deve glibc-headers gcc-c++
           

[b]3. 安裝Maven[/b]

$ wget http://mirror.esocc.com/apache/maven/maven-3/3.1.4/binaries/apache-maven-3.1.4-bin.tar.gz
$  tar zxf apache-maven-3.1.4-bin.tar.gz -C /opt
$  vi ~/.bashrc
export MAVEN_HOME=/opt/apache-maven-3.1.4
export PATH=$PATH:$MAVEN_HOME/bin
           

[b]4. 安裝protobuf[/b]

[color=red]編譯Hadoop 2.2.0，需要protobuf的編譯器protoc。一定需要protobuf 2.5.0以上，yum裡的是2.3，下載下傳源碼，編譯安裝。[/color]

$ wget https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz
$ tar zxf protobuf-2.5.0.tar.gz
$ cd protobuf-2.5.0
$ ./configure
$ make
$ make install
           

[b]5. 給Hadoop源碼打一個patch[/b]

cd /opt/program/hadoop-2.2.0-src
 wget https://issues.apache.org/jira/secure/attachment/12614482/HADOOP-10110.patch; patch -p0 < HADOOP-10110.patch 
           

#讓設定生效

[color=red][b]source ~/.bashrc[/b][/color]

[b]6. 編譯 Hadoop[/b]

cd hadoop-2.2.0-src
mvn package -DskipTests -Pdist,native -Dtar
           

[b]7. 替換掉32位的native庫[/b]

用 hadoop-2.2.0-src/hadoop-dist/target/hadoop-2.2.0/lib/native 替換掉 hadoop-2.2.0/lib/native

rm -rf ~/local/opt/hadoop-2.2.0/lib/native
cp ./hadoop-dist/target/hadoop-2.2.0/lib/native ~/local/opt/hadoop-2.2.0/lib/