invest Don't forget to set SPARK_HOME and JAVA_HOME. You can also set PYSPARK_PYTHON if needed. The last version of Spark requires Java 8!