.
  • install spark kernel and pyspark kernel using toree

    Jupyter Notebook (formerly known as IPython Notebook) is an interactive notebook environment which supports various programming languages which allows you to interact with your data, combine code with markdown text and perform simple visualizations.

    Here are just a couple of reasons why using Jupyter Notebook with Spark is the best choice for users that wish to present their work to other team members or to the public in general:

    • Jupyter notebooks support tab autocompletion on class names, functions, methods and variables.
    • It offers more explicit and colour-highlighted error messages than the command line IPython console.
    [Read More...]
  • Permission denied when running jupyter notebook after switch user

    This error happens when you use a different user from the login user to run jupyter notebook.

    For example:

    If you login in using user root, then switch to user_x, then run:

    ipython notebook or jupyter notebook

    you will get the following exception:

    OSError: [Errno 13] Permission denied: ‘/run/user/1000/jupyter’

    The solution is:

    export XDG_RUNTIME_DIR=””

    [Read More...]