2. Install Apache Spark 2.4.3 Python in Windows - PySpark

Описание

1. HADOOP_HOME = C:\spark-2.4.3-bin-hadoop2.7\hadoop
2. JAVA_HOME = C:\Program Files\Java\jdk1.8.0_151
3. SCALA_HOME = C:\spark-2.4.3-bin-hadoop2.7\scala\bin
4. SPARK_HOME = C:\spark-2.4.3-bin-hadoop2.7\spark-2.4.3-bin-hadoop2.7\bin
5. PYSPARK_PYTHON = C:\Users\[user]\Anaconda3\envs\python.exe
6. PYSPARK_DRIVER_PYTHON= C:\Users\[user]\Anaconda3\envs\Scripts\jupyter.exe
7. PYSPARK_DRIVER_PYTHON_OPTS=notebook
8. Add C:\spark-2.4.3-bin-hadoop2.7\spark-2.4.3-bin-hadoop2.7\bin to Path.