天天看點

zeppelin,hadoop,spark 運作失敗解決

運作zeppelin 0.6.×時遇到問題:(0.7.*不需要下面的步驟的)

1. java.lang.NoSuchMethodError: org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/

solution:

cd zeppelin-0.6.2-bin-all/lib

rm hadoop-annotations-×××.jar

rm hadoop-auth-×××.jar

rm hadoop-common-×××.jar

cp spark/jars/hadoop-annotations-×××.jar ./

cp spark/jars/hadoop-auth-×××.jar ./

cp spark/jars/hadoop-common-×××.jar ./

重新開機zeppelin 又出現下面問題:

2. Spark Error: Could not initialize class org.apache.spark.rdd.RDDOperationScope

solution:

cd zeppelin-0.6.2-bin-all/lib

rm jackson-annotations-×××.jar

rm jackson-core-×××.jar

rm jackson-databind-×××.jar

cp spark/jars/jackson-databind-×××.jar ./

cp spark/jars/jackson-core-×××.jar ./

cp spark/jars/jackson-annotations-×××.jar ./

再重新開機zeppelin 解決問題,删完拷完後一定要重新開機zeppelin

-----------------------------------------------------------------------------------------------------------------------------------------

zeppelin 加上使用者名密碼登入功能,需要修改配置

conf/shiro.ini [urls] 改成如下所示

[urls]

#/api/version = anon

/api/interpreter/** = authc, roles[admin]

/api/configurations/** = authc, roles[admin]

/api/credential/** = authc, roles[admin]

#/** = anon

/** = authc

在[users] 下添加使用者名和密碼和roles,roles 沒啥用

在conf/zeppelin-site.xml

修改下面這項:

<property>

<name>zeppelin.anonymous.allowed</name>

<value>false</value>

<description>Anonymous user allowed by default</description>

</property>

修改完配置就得重新開機才能生效

繼續閱讀