CDH5.16.1 安装 Spark2

https://docs.cloudera.com/documentation/index.html
http://archive.cloudera.com/spark2/parcels/2.4.0.cloudera2/
           

下载包裹
[[email protected] cdh5.16.1]# mkdir spark2-parcels
[[email protected] spark2-parcels]# wget http://archive.cloudera.com/spark2/parcels/2.4.0.cloudera2/SPARK2-2.4.0.cloudera2-1.cdh5.13.3.p0.1041012-el7.parcel
[[email protected] spark2-parcels]# wget http://archive.cloudera.com/spark2/parcels/2.4.0.cloudera2/SPARK2-2.4.0.cloudera2-1.cdh5.13.3.p0.1041012-el7.parcel.sha1
[[email protected] spark2-parcels]# wget http://archive.cloudera.com/spark2/parcels/2.4.0.cloudera2/manifest.json
[[email protected] spark2-parcels]# wget http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.4.0.cloudera2.jar

[[email protected] spark2-parcels]# mv SPARK2-2.4.0.cloudera2-1.cdh5.13.3.p0.1041012-el7.parcel.sha1 SPARK2-2.4.0.cloudera2-1.cdh5.13.3.p0.1041012-el7.parcel.sha
           

[[email protected] ~]# mkdir /opt/cloudera/csd
[[email protected] ~]# cd /opt/cloudera/csd/
[[email protected] csd]# cp /root/cdh5.16.1/spark2-parcels/SPARK2_ON_YARN-2.4.0.cloudera2.jar ./
[[email protected] csd]# chown cloudera-scm:cloudera-scm SPARK2_ON_YARN-2.4.0.cloudera2.jar 
[[email protected] csd]# chmod 644 SPARK2_ON_YARN-2.4.0.cloudera2.jar 
[[email protected] csd]# /opt/cloudera-manager/cm-5.16.1/etc/init.d/cloudera-scm-server restart
           

[[email protected] csd]# cd /var/www/html/
[[email protected] html]# cp -r /root/cdh5.16.1/spark2-parcels/ ./
http://hadoop001/spark2-parcels/
           

[[email protected] csd]# cd /var/www/html/

[[email protected] html]# cp -r /root/cdh5.16.1/spark2-parcels/ ./

http://hadoop001/spark2-parcels/