Spark play with WSL anaconda jupyter (2)

Last time Continuation of environment settings

rdd = sc.parallelize(['A', 'B', 'C', 'A'])
keyvalues = rdd.map(lambda x: (x, 1))
counts = keyvalues.reduceByKey(lambda a, b: a + b)
counts.collect()
(base) xxxx:~$ sudo update-alternatives --config java
alternative java (/usr/bin/Provide java)Has two choices.

Choice Path Priority Status
------------------------------------------------------------
* 0            /usr/lib/jvm/java-11-openjdk-amd64/bin/java 1111 automatic mode
  1            /usr/lib/jvm/java-11-openjdk-amd64/bin/java 1111 manual mode
  2            /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java 1081 manual mode
(base) xxxx:~$ sudo update-alternatives --config java
alternative java (/usr/bin/Provide java)Has two choices.

Choice Path Priority Status
------------------------------------------------------------
* 0            /usr/lib/jvm/java-11-openjdk-amd64/bin/java 1111 automatic mode
  1            /usr/lib/jvm/java-11-openjdk-amd64/bin/java 1111 manual mode
  2            /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java 1081 manual mode

Current choice[*]To hold<Enter>, Otherwise press the key of the choice number: 2
update-alternatives: /usr/bin/java (java)In manual mode to provide/usr/lib/jvm/java-8-openjdk-amd64/jre/bin/use java
(base) xxxx:~$ java -version
openjdk version "1.8.0_222"
OpenJDK Runtime Environment (build 1.8.0_222-8u222-b10-1ubuntu1~18.04.1-b10)
OpenJDK 64-Bit Server VM (build 25.222-b10, mixed mode)

Recommended Posts

Spark play with WSL anaconda jupyter (2)
Use apache Spark with jupyter notebook (IPython notebook)
Play with Prophet
Play with PyTorch
Play with 2016-Python
Play with Pyramid
Play with Fathom
Candlestick with plotly + Jupyter
Basket analysis with Spark (1)
Play with Othello (Reversi)
Use Python 3.8 with Anaconda
Quickly launch Jupyter with Docker (target language: Anaconda / Ruby)
Getting started with Spark
Use nim with Jupyter
Building a Jupyter Lab development environment on WSL2 using Anaconda3
Build a Python environment with WSL + Pyenv + Jupyter + VS Code
Let's play with 4D 4th
Let's play with Amedas data-Part 1
Embed audio data with Jupyter
Using Graphviz with Jupyter Notebook
Play with reinforcement learning with MuZero
Install Python environment with Anaconda
Install Keras (used with Anaconda)
Play with push notifications with imap4lib
Use pip with Jupyter Notebook
Play around with Linux partitions
Let's play with Amedas data-Part 4
Use Windows 10 fonts with WSL
Use Cython with Jupyter Notebook
homebrew, pyenv, anaconda, Jupyter Notebook
Play WAVE files from WSL
Play RocketChat with API / Python
Try running Python with Try Jupyter
Let's play with Amedas data-Part 2
Switch virtual environment with jupyter
Play with ASE MD module
Server management with Jupyter (1) import
Try using folium with anaconda
Play with A3RT (Text Suggest)
How to run Jupyter and Spark on Mac with minimal settings