pyspark.sql.utils.IllegalArgumentException: u”Error while instantiating ‘org.apache.spark.sql.hive.HiveSessionState’:”

If you encounter this error after launching the pyspark prompt, this solution might work for you.

Change the permissions of the /tmp/hive directory as follows.

sudo chmod -R 777 /tmp/hive

Launch pyspark. If pyspark is added to your path, you can do




from the spark directory.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s