Skip to main content
se añadieron 186 caracteres en el cuerpo
Origen Enlace

He instalado Spark ultima version al igual que Java, realizado todos los ajustes en windows 11 con winutils y variables de entorno, directorio tmp, etc ejecuto en el terminal(cmd), siguiendo todo el proceso segun el tutorial del que dispongo, voy a la terminal cmd del pc e intento arrancar pyspark y me salta el error de abajo,abajo segun intuyo tiene que ver con la SparkSession., SparkContext

C:\spark>pysparkMicrosoft Windows [Versión 10.0.22631.4169] (c) Microsoft Corporation. Todos los derechos reservados.

C:\Windows\System32>cd..

C:\Windows>cd..

C:\>cd spark

C:\spark>pyspark

Python 3.12.26 (tags/v3.12.26:6abddd9a4a2d2b, FebSep 6 2024, 2120:2611:3623) [MSC v.19371940 64 bit (AMD64)] on win32 Type "help", "copyright", "credits" or "license" for more information. Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/21 1323 21:3813:5159 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where where applicable 24/09/21 1323 21:3813:5259 WARN SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor). This may may indicate an error, since only one SparkContext should be running in this JVM (see SPARK-2243). The other SparkContext was created created at:

He instalado Spark ultima version al igual que Java, realizado todos los ajustes en windows 11 con winutils y variables de entorno, directorio tmp, etc ejecuto en el terminal(cmd), siguiendo todo el proceso segun el tutorial del que dispongo, voy a la terminal cmd del pc e intento arrancar pyspark y me salta el error de abajo, segun intuyo tiene que ver con la SparkSession.

C:\spark>pyspark

Python 3.12.2 (tags/v3.12.2:6abddd9, Feb 6 2024, 21:26:36) [MSC v.1937 64 bit (AMD64)] on win32 Type "help", "copyright", "credits" or "license" for more information. Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/21 13:38:51 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/09/21 13:38:52 WARN SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor). This may indicate an error, since only one SparkContext should be running in this JVM (see SPARK-2243). The other SparkContext was created at:

He instalado Spark ultima version al igual que Java, realizado todos los ajustes en windows 11 con winutils y variables de entorno, directorio tmp, etc ejecuto en el terminal(cmd), siguiendo todo el proceso segun el tutorial del que dispongo, voy a la terminal cmd del pc e intento arrancar pyspark y me salta el error de abajo segun intuyo tiene que ver con la SparkSession, SparkContext

Microsoft Windows [Versión 10.0.22631.4169] (c) Microsoft Corporation. Todos los derechos reservados.

C:\Windows\System32>cd..

C:\Windows>cd..

C:\>cd spark

C:\spark>pyspark

Python 3.12.6 (tags/v3.12.6:a4a2d2b, Sep 6 2024, 20:11:23) [MSC v.1940 64 bit (AMD64)] on win32 Type "help", "copyright", "credits" or "license" for more information. Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/23 21:13:59 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/09/23 21:13:59 WARN SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor). This may indicate an error, since only one SparkContext should be running in this JVM (see SPARK-2243). The other SparkContext was created at:

se añadieron 193 caracteres en el cuerpo
Origen Enlace

He instalado Spark ultima version al igual que Java, realizado todos los ajustes en windows 11 con winutils y variables de entorno, directorio tmp, etc ejecuto en el terminal(cmd), siguiendo todo el proceso segun el tutorial del que dispongo, voy a la terminal cmd del pc e intento arrancar pyspark y me da estesalta el error: de abajo, segun intuyo tiene que ver con la SparkSession.

C:\spark>pyspark Python

Python 3.12.2 (tags/v3.12.2:6abddd9, Feb 6 2024, 21:26:36) [MSC v.1937 64 bit (AMD64)] on win32 Type "help", "copyright", "credits" or "license" for more information. Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/21 13:38:51 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/09/21 13:38:52 WARN SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor). This may indicate an error, since only one SparkContext should be running in this JVM (see SPARK-2243). The other SparkContext was created at:

He instalado Spark ultima version al igual que Java, realizado todos los ajustes en windows con winutils y variables de entorno, directorio tmp, etc ejecuto en el terminal(cmd) y me da este error:

C:\spark>pyspark Python 3.12.2 (tags/v3.12.2:6abddd9, Feb 6 2024, 21:26:36) [MSC v.1937 64 bit (AMD64)] on win32 Type "help", "copyright", "credits" or "license" for more information. Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/21 13:38:51 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/09/21 13:38:52 WARN SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor). This may indicate an error, since only one SparkContext should be running in this JVM (see SPARK-2243). The other SparkContext was created at:

He instalado Spark ultima version al igual que Java, realizado todos los ajustes en windows 11 con winutils y variables de entorno, directorio tmp, etc ejecuto en el terminal(cmd), siguiendo todo el proceso segun el tutorial del que dispongo, voy a la terminal cmd del pc e intento arrancar pyspark y me salta el error de abajo, segun intuyo tiene que ver con la SparkSession.

C:\spark>pyspark

Python 3.12.2 (tags/v3.12.2:6abddd9, Feb 6 2024, 21:26:36) [MSC v.1937 64 bit (AMD64)] on win32 Type "help", "copyright", "credits" or "license" for more information. Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/21 13:38:51 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/09/21 13:38:52 WARN SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor). This may indicate an error, since only one SparkContext should be running in this JVM (see SPARK-2243). The other SparkContext was created at:

Origen Enlace

Error instalar Spark windows 11

He instalado Spark ultima version al igual que Java, realizado todos los ajustes en windows con winutils y variables de entorno, directorio tmp, etc ejecuto en el terminal(cmd) y me da este error:

C:\spark>pyspark Python 3.12.2 (tags/v3.12.2:6abddd9, Feb 6 2024, 21:26:36) [MSC v.1937 64 bit (AMD64)] on win32 Type "help", "copyright", "credits" or "license" for more information. Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/21 13:38:51 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/09/21 13:38:52 WARN SparkContext: Another SparkContext is being constructed (or threw an exception in its constructor). This may indicate an error, since only one SparkContext should be running in this JVM (see SPARK-2243). The other SparkContext was created at: