Create and use a Jupyter notebook

Introduction to Jupyter Notebook

• Provides a machine learning experiment environment that can be integrated into a cloud platform. This environment allows you to develop machine learning on your on-premises machine.
• Provides a tool to copy and process datasets. This allows you to submit processed data to persistent storage. You can also process datasets by using big data tools.
• Provides an environment for machine learning processes, such as testing and preprocessing. In the environment, you can write the code of machine learning tasks, package the code into Docker images, and push the images to your cluster or remote Docker repositories.

Step 1: Create a Jupyter notebook

1. Log on to the AI development console. For more information, see Log on to the AI development console.
2. In the left-side navigation pane of the AI development console, click Notebook.
3. On the Notebook page, click create notebook.
4. In the Notebook message and Notebook configure sections, set the parameters and click create notebook.
   
   1. Set Notebook Name, Notebook Image, Namespace, and Data Configuration. The selected namespace must be the one that the cluster administrator creates for AI development. You can set the other parameters based on your requirements.
   2. Turn on Workspace PVC. Select the persistent volume claim (PVC) associated to the workspace from the Target PVC drop-down list.
   3. In the Notebook configure section, set CPU (Cores), Memory (GB), and GPU (Card Numbers).
5. After the notebook is created, go to the Notebook page and click the created notebook to view the detailed information.

Step 2: Use a Jupyter notebook

1. On the Notebook page, find a notebook in the Running state and click its name.
2. On the page that appears, click Python 3 in the Notebook section.
   Note On the create notebook page, the notebook images provided by ACK supports only Python. If you want to use other languages, you can create and package custom notebook images by using Dockerfiles. For more information, see Create a custom notebook image.

   
3. Use Arena to submit a task in the notebook.

   Method 1: Use Arena CLI to submit a task

   

   Method 2: Use Arena SDK for Python to submit a task

   

Create a custom notebook image

To meet various requirements of different users, ACK allows you to specify a custom notebook image, as shown in the following figure.

You can perform the following steps to create and package a custom image by using a Dockerfile:

FROM tensorflow/tensorflow:1.15.5-gpu
USER root
RUN pip install jupyter && \
    pip install ipywidgets && \
    jupyter nbextension enable --py widgetsnbextension && \
    pip install jupyterlab && jupyter serverextension enable --py jupyterlab
# You can use other methods to install JupyterLab. You must expose the service through port 8888.
EXPOSE 8888
USER jovyan
CMD ["sh", "-c", "jupyter-lab --notebook-dir=/home/jovyan --ip=0.0.0.0 --no-browser --allow-root --port=8888 --ServerApp.token='' --ServerApp.password='' --ServerApp.allow_origin='*' --ServerApp.base_url=${NB_PREFIX} --ServerApp.authenticate_prometheus=False"]
USER root

The following table describes the parameters.