How do I deploy an Apache Spark cluster with the Oshinko command line interface tool?

Deploying an Apache Spark cluster through the Oshinko command line interface tool is a simple process that in most cases can be done by providing only a name for the new cluster.

Prerequisites

  • A terminal shell and OpenShift oc tool available with an active login to OpenShift.

  • An OpenShift project with the radanalytics.io manifest installed, see the Get Started instructions for more help.

Procedure

  1. Type oshinko create <cluster name> into your terminal shell, replacing <cluster name> with the name you will use to identify the cluster. It will look similar to this:

    $ oshinko create mycluster
shared cluster mycluster created
spark master: spark://mycluster:7077

  2. Confirm your cluster is created by typing oshinko get <cluster name>, replacing <cluster name> with the name you chose for the cluster. It will look similar to this:

    $ oshinko get mycluster

name                     workers                 status
mycluster                1                       Running
Additional resources