pyspark.sql.utils.IllegalArgumentException: u”Error while instantiating ‘org.apache.spark.sql.hive.HiveSessionState’:”

If you encounter this error after launching the pyspark prompt, this solution might work for you.

Change the permissions of the /tmp/hive directory as follows.

sudo chmod -R 777 /tmp/hive

Launch pyspark. If pyspark is added to your path, you can do

pyspark

or

./bin/pyspark

from the spark directory.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s