hive - Zeppelin 0.7.2 version does not support spark 2.2.0 -


how downgrade spark version? other solutions? have connect hive tables spark using spark session. spark version not supported zeppelin.

here 2 reasons.

[1] zeppelin 0.7.2 marked spark 2.2+ unsupported version.

https://github.com/apache/zeppelin/blob/v0.7.2/spark/src/main/java/org/apache/zeppelin/spark/sparkversion.java#l40

public static final sparkversion unsupported_future_version = spark_2_2_0; 

[2] if change const , build again, might fail run zeppelin 0.7.2 spark 2.2

spark dropped support java 7 , zeppelin 0.7.2 built jdk 7. need rebuild jdk 8.

one work around can use is, specifying java_home in spark interpreter (for 2.2) commented here

that works because spark interpreter (for 2.2) requires java 8 , zeppelin doesn't need it.

in short

  1. modify here , rebuild if want spark 2.2 on zeppelin branch-0.7
  2. and use jdk 8 spark interpreter.

Comments

Popular posts from this blog

ubuntu - PHP script to find files of certain extensions in a directory, returns populated array when run in browser, but empty array when run from terminal -

php - How can i create a user dashboard -

javascript - How to detect toggling of the fullscreen-toolbar in jQuery Mobile? -