天天看點

[Hadoop] 源碼編譯Hadoop 2.7.2

1. 基礎環境  ubuntu 14.04 desktop amd64

2. 安裝JDK 【  https://yunpan.cn/c6IF2W9m6zcX6(提取碼:5b73)】

tar zxvf jdk-7u45-linux-x64.tar.gz -C /opt/
   export JAVA_HOME=/opt/jdk1.7.0_45
   export PATH=.:${JAVA_HOME}/bin:$PATH
   export CLASSPATH=.:${JAVA_HOME}/lib:${JAVA_HOME}/lib/tools.jar:${JAVA_HOME}/lib/dt.jar
           

3. 安裝Maven

sudo apt-get install maven
           

4. 安裝依賴項

sudo apt-get install openssh-server g++ autoconf automake libtool cmake zlib1g-dev pkg-config libssl-dev protobuf-compiler
           

5. 安裝Findbugs 【 https://yunpan.cn/c6IFXDmWjrjfZ (提取碼:e65a)】

tar zxvf findbugs-2.0.2.tar.gz -C /opt/
   export FINDBUGS_HOME=/opt/findbugs-2.0.2
   export PATH=${FINDBUGS_HOME}/bin:$PATH
           

6. 編譯Hadoop 【 https://yunpan.cn/c6IF92pST2Gpv(提取碼:7490)】

tar zxvf hadoop-2.7.2-src.tar.gz -C /opt/
   cd /opt/hadoop-2.7.2-src
   mvn clean package -Pdist,native -DskipTests -Dtar
           

7. 附上編譯結果

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop Main ................................ SUCCESS [2.753s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [1.780s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [4.879s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.312s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [2.557s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [3.923s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [3.919s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [3.543s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [5.408s]
[INFO] Apache Hadoop Common .............................. SUCCESS [1:41.870s]
[INFO] Apache Hadoop NFS ................................. SUCCESS [6.649s]
[INFO] Apache Hadoop KMS ................................. SUCCESS [20.495s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.176s]
[INFO] Apache Hadoop HDFS ................................ SUCCESS [3:04.340s]
[INFO] Apache Hadoop HttpFS .............................. SUCCESS [28.428s]
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SUCCESS [11.204s]
[INFO] Apache Hadoop HDFS-NFS ............................ SUCCESS [5.755s]
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.083s]
[INFO] hadoop-yarn ....................................... SUCCESS [0.117s]
[INFO] hadoop-yarn-api ................................... SUCCESS [1:45.932s]
[INFO] hadoop-yarn-common ................................ SUCCESS [26.531s]
[INFO] hadoop-yarn-server ................................ SUCCESS [0.120s]
[INFO] hadoop-yarn-server-common ......................... SUCCESS [9.188s]
[INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [15.709s]
[INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [2.975s]
[INFO] hadoop-yarn-server-applicationhistoryservice ...... SUCCESS [7.332s]
[INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [22.566s]
[INFO] hadoop-yarn-server-tests .......................... SUCCESS [4.300s]
[INFO] hadoop-yarn-client ................................ SUCCESS [6.066s]
[INFO] hadoop-yarn-server-sharedcachemanager ............. SUCCESS [3.027s]
[INFO] hadoop-yarn-applications .......................... SUCCESS [0.051s]
[INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [2.495s]
[INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SUCCESS [2.289s]
[INFO] hadoop-yarn-site .................................. SUCCESS [0.165s]
[INFO] hadoop-yarn-registry .............................. SUCCESS [5.230s]
[INFO] hadoop-yarn-project ............................... SUCCESS [6.793s]
[INFO] hadoop-mapreduce-client ........................... SUCCESS [0.154s]
[INFO] hadoop-mapreduce-client-core ...................... SUCCESS [22.416s]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [15.831s]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [4.009s]
[INFO] hadoop-mapreduce-client-app ....................... SUCCESS [8.764s]
[INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [5.129s]
[INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [6.914s]
[INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [1.949s]
[INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [4.417s]
[INFO] hadoop-mapreduce .................................. SUCCESS [3.567s]
[INFO] Apache Hadoop MapReduce Streaming ................. SUCCESS [4.547s]
[INFO] Apache Hadoop Distributed Copy .................... SUCCESS [10.425s]
[INFO] Apache Hadoop Archives ............................ SUCCESS [2.511s]
[INFO] Apache Hadoop Rumen ............................... SUCCESS [4.712s]
[INFO] Apache Hadoop Gridmix ............................. SUCCESS [3.683s]
[INFO] Apache Hadoop Data Join ........................... SUCCESS [2.490s]
[INFO] Apache Hadoop Ant Tasks ........................... SUCCESS [1.972s]
[INFO] Apache Hadoop Extras .............................. SUCCESS [2.443s]
[INFO] Apache Hadoop Pipes ............................... SUCCESS [2.310s]
[INFO] Apache Hadoop OpenStack support ................... SUCCESS [4.838s]
[INFO] Apache Hadoop Amazon Web Services support ......... SUCCESS [7.856s]
[INFO] Apache Hadoop Azure support ....................... SUCCESS [4.448s]
[INFO] Apache Hadoop Client .............................. SUCCESS [8.159s]
[INFO] Apache Hadoop Mini-Cluster ........................ SUCCESS [0.841s]
[INFO] Apache Hadoop Scheduler Load Simulator ............ SUCCESS [4.840s]
[INFO] Apache Hadoop Tools Dist .......................... SUCCESS [12.786s]
[INFO] Apache Hadoop Tools ............................... SUCCESS [1.110s]
[INFO] Apache Hadoop Distribution ........................ SUCCESS [58.381s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 13:44.015s
[INFO] Finished at: Sat Aug 13 12:02:39 CST 2016
[INFO] Final Memory: 127M/1133M
[INFO] ------------------------------------------------------------------------
[email protected]:~$ 
           

繼續閱讀