/docs/sphinx/launch.rst
ReStructuredText | 167 lines | 116 code | 51 blank | 0 comment | 0 complexity | b95ea9a37c23d8da19a68bb1a1084592 MD5 | raw file
- Launching a StarCluster on Amazon EC2
- =====================================
- Use the **start** command in StarCluster to launch a new cluster on Amazon EC2.
- The start command takes two arguments: the cluster template and a tagname
- for cluster identification.
- Below is an example of starting a StarCluster from the *default* cluster template
- defined in the config and tagged as *physicscluster*. This example will be used throughout
- this section.
- .. code-block:: none
- $ starcluster start physicscluster # this line starts the cluster
- StarCluster - (http://web.mit.edu/starcluster)
- Software Tools for Academics and Researchers (STAR)
- Please submit bug reports to starcluster@mit.edu
- >>> Using default cluster template: smallcluster
- >>> Validating cluster template settings...
- >>> Cluster template settings are valid
- >>> Starting cluster...
- >>> Launching a 2-node cluster...
- >>> Launching master node...
- >>> Master AMI: ami-17b15e7e
- >>> Creating security group @sc-physicscluster...
- RESERVATION r-d71f20be 123456789012 default
- INSTANCE i-10e91578 ami-17b15e7e pending gsg-keypair 0 m1.small ...
- >>> Launching worker nodes...
- >>> Node AMI: ami-17b15e7e
- RESERVATION r-ab1f20c2 123456789012 default
- INSTANCE i-14e9157c ami-17b15e7e pending gsg-keypair 0 m1.small ...
- >>> Waiting for cluster to start...
- >>> The master node is ec2-123-12-12-123.compute-1.amazonaws.com
- >>> Attaching volume vol-99999999 to master node on /dev/sdz ...
- >>> Setting up the cluster...
- >>> Mounting EBS volume vol-99999999 on /home...
- >>> Using private key /home/user/.ssh/id_rsa-gsg-keypair (rsa)
- >>> Creating cluster user: myuser
- >>> Using private key /home/user/.ssh/id_rsa-gsg-keypair (rsa)
- >>> Configuring scratch space for user: myuser
- >>> Configuring /etc/hosts on each node
- >>> Configuring NFS...
- >>> Configuring passwordless ssh for root
- >>> Configuring passwordless ssh for user: myuser
- >>> Generating local RSA ssh keys for user: myuser
- >>> Installing Sun Grid Engine...
- >>> Done Configuring Sun Grid Engine
- >>>
- The cluster has been started and configured.
- Login to the master node as root by running:
- $ starcluster sshmaster physicscluster
- or manually as myuser:
- $ ssh -i /home/user/.ssh/id_rsa-gsg-keypair myuser@ec2-123-12-12-123.compute-1.amazonaws.com
- When you are finished using the cluster, run:
- $ starcluster stop physicscluster
- to shutdown the cluster and stop paying for service
-
- >>> start took 6.922 mins
- The output of the **start** command should look similar to the above if everything went successfully.
- If you wish to use a different template besides the default, *largecluster* for example, the command becomes:
- .. code-block:: none
- $ starcluster start -c largecluster physicscluster
- This command will do the same thing as above only using the *largecluster* cluster template.
- Managing Multiple Clusters
- --------------------------
- To list all of your StarClusters on Amazon EC2 run the following command:
- .. code-block:: none
- $ starcluster listclusters
- The output should look something like:
- .. code-block:: none
- $ starcluster listclusters
- StarCluster - (http://web.mit.edu/starcluster)
- Software Tools for Academics and Researchers (STAR)
- Please submit bug reports to starcluster@mit.edu
- ---------------------------------------------------
- physicscluster (security group: @sc-physicscluster)
- ---------------------------------------------------
- Launch time: 2010-02-19T20:55:20.000Z
- Zone: us-east-1c
- Keypair: gsg-keypair
- EBS volumes:
- vol-c8888888 on master:/dev/sdj (status: attached)
- Cluster nodes:
- master running i-99999999 ec2-123-123-123-121.compute-1.amazonaws.com
- node001 running i-88888888 ec2-123-123-123-122.compute-1.amazonaws.com
- This will list each StarCluster you've started by tag name.
- Logging into the master node
- ----------------------------
- To login to the master node as root:
- .. code-block:: none
- $ starcluster sshmaster physicscluster
- or as user sgeadmin:
- .. code-block:: none
- $ starcluster sshmaster -u sgeadmin physicscluster
- Logging into the worker nodes
- -----------------------------
- To login to a worker node as root:
- .. code-block:: none
- $ starcluster sshnode physicscluster node001
- or as user sgeadmin:
- .. code-block:: none
- $ starcluster sshnode -u sgeadmin physicscluster node001
- The above commands will ssh to node001 of the *physicscluster*.
- Shutting Down a Cluster
- -----------------------
- Once you've finished using the cluster and wish to stop paying for it, simply run the **stop** command
- providing the cluster tag name you gave when starting:
- .. code-block:: none
-
- $ starcluster stop physicscluster
- This command will prompt for confirmation before destroying the cluster:
- .. code-block:: none
- $ starcluster stop physicscluster
- StarCluster - (http://web.mit.edu/starcluster)
- Software Tools for Academics and Researchers (STAR)
- Please submit bug reports to starcluster@mit.edu
- Shutdown cluster physicscluster (y/n)? y
- >>> Shutting down i-99999999
- >>> Shutting down i-88888888
- >>> Removing cluster security group @sc-physicscluster
- This will terminate all instances in the cluster tagged "physicscluster" and removes the @sc-physicscluster
- security group.