Skip to content
Snippets Groups Projects
Commit ce6511f1 authored by Caughlin Bohn's avatar Caughlin Bohn
Browse files

Changed ordering and moved more detailed guides to connectin/

parent 35c4ffb3
No related branches found
No related tags found
4 merge requests!78Added Office Hours Page,!77Added DUO Screenshot Update and SandStone Docs,!76Sandstone Doc Page And DUO Screenshots,!62Anaconda Number Fixed
...@@ -10,8 +10,8 @@ downloaded from [serial_dir.zip](/attachments/serial_dir.zip). ...@@ -10,8 +10,8 @@ downloaded from [serial_dir.zip](/attachments/serial_dir.zip).
#### Login to a HCC Cluster (Tusker or Crane) #### Login to a HCC Cluster (Tusker or Crane)
Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/for_windows_users">}})) or Terminal ([For Mac/Linux Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/connecting/for_windows_users">}})) or Terminal ([For Mac/Linux
Users]({{< relref "/quickstarts/for_maclinux_users">}})) and make a subdirectory called `serial_dir` under the `$WORK` directory. Users]({{< relref "/quickstarts/connecting/for_maclinux_users">}})) and make a subdirectory called `serial_dir` under the `$WORK` directory.
{{< highlight bash >}} {{< highlight bash >}}
$ cd $WORK $ cd $WORK
......
...@@ -10,8 +10,8 @@ scripts can be downloaded from [mpi_dir.zip](/attachments/mpi_dir.zip). ...@@ -10,8 +10,8 @@ scripts can be downloaded from [mpi_dir.zip](/attachments/mpi_dir.zip).
#### Login to a HCC Cluster #### Login to a HCC Cluster
Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/for_windows_users">}})) or Terminal ([For Mac/Linux Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/connecting/for_windows_users">}})) or Terminal ([For Mac/Linux
Users]({{< relref "/quickstarts/for_maclinux_users">}})) and make a subdirectory called `mpi_dir` under the `$WORK` directory. Users]({{< relref "/quickstarts/connecting/for_maclinux_users">}})) and make a subdirectory called `mpi_dir` under the `$WORK` directory.
{{< highlight bash >}} {{< highlight bash >}}
$ cd $WORK $ cd $WORK
......
...@@ -10,7 +10,7 @@ can be downloaded from [condor_dir.zip](/attachments/3178558.zip). ...@@ -10,7 +10,7 @@ can be downloaded from [condor_dir.zip](/attachments/3178558.zip).
#### Login to a HCC Cluster #### Login to a HCC Cluster
Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/for_windows_users">}})) or Terminal ([For Mac/Linux Users]({{< relref "/quickstarts/for_maclinux_users">}})) and make a subdirectory called `condor_dir` under the `$WORK` directory. In the subdirectory `condor_dir`, create job subdirectories that host the input data files. Here we create two job subdirectories, `job_0` and `job_1`, and put a data file (`data.dat`) in each subdirectory. The data file in `job_0` has a column of data listing the integers from 1 to 5. The data file in `job_1` has a integer list from 6 to 10. Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/connecting/for_windows_users">}})) or Terminal ([For Mac/Linux Users]({{< relref "/quickstarts/connecting/for_maclinux_users">}})) and make a subdirectory called `condor_dir` under the `$WORK` directory. In the subdirectory `condor_dir`, create job subdirectories that host the input data files. Here we create two job subdirectories, `job_0` and `job_1`, and put a data file (`data.dat`) in each subdirectory. The data file in `job_0` has a column of data listing the integers from 1 to 5. The data file in `job_1` has a integer list from 6 to 10.
{{< highlight bash >}} {{< highlight bash >}}
$ cd $WORK $ cd $WORK
......
+++ +++
title = "How to Connect" title = "How to Connect"
description = "What is a cluster and what is HPC" description = "What is a cluster and what is HPC"
weight = "20" weight = "9"
+++ +++
High-Performance Computing is the use of groups of computers to solve computations a user or group would not be able to solve in a reasonable time-frame on their own desktop or laptop. This is often achieved by splitting one large job amongst numerous cores or 'workers'. This is similar to how a skyscraper is built by numerous individuals rather than a single person. Many fields take advantage of HPC including bioinformatics, chemistry, materials engineering, and newer fields such as educational psychology and philosophy. High-Performance Computing is the use of groups of computers to solve computations a user or group would not be able to solve in a reasonable time-frame on their own desktop or laptop. This is often achieved by splitting one large job amongst numerous cores or 'workers'. This is similar to how a skyscraper is built by numerous individuals rather than a single person. Many fields take advantage of HPC including bioinformatics, chemistry, materials engineering, and newer fields such as educational psychology and philosophy.
{{< figure src="/images/cluster.png" height="450" >}} {{< figure src="/images/cluster.png" height="450" >}}
......
+++
title = "Introduction to HPC"
description = "What is a cluster and what is HPC"
weight = "35"
+++
High-Performance Computing is the use of groups of computers to solve computations that a user or group would not be able to solve in a reasonable time-frame on their own desktop or laptop. This is often achieved by splitting one large job amongst numerous cores or 'workers'. This is similar to how a skyscraper is built by numerous individuals rather than a single person. Many fields take advantage of HPC including bioinformatics, chemistry, materials engineering, and newer fields such as educational psychology and philosophy.
HPC clusters consist of four primary parts, the login node, management node, workers, and a central storage array. All of these parts are bound together with a scheduler such as HTCondor or SLURM.
{{< figure src="/images/cluster.png" height="450" >}}
##### [Source](https://training.h3abionet.org/technical_workshop_2015/?page_id=403)
#### Login Node:
Users will automatically land on the login node when they log in to the clusters. You will [submit jobs] ({{< ref "/guides/submitting_jobs" >}}) using one of the schedulers and pull the results of your jobs. Running jobs on the login node directly will be stopped so others can use the login node to submit jobs.
</br></br>
#### Management Node:
The management node contains and runs the schedulers and other utilities for managing the cluster.
</br></br>
#### Worker Nodes:
The worker nodes are what run and process your jobs that are submitted from the schedulers. Through the use of the schedulers, more work can be efficiently done by squeezing in all jobs possible for the resources requested throughout the nodes. They also allow for fair use computing by making sure one user or group is not using the entire cluster at once and allowing others to use the clusters.
</br></br>
#### Central Storage Array:
The central storage array allows all of the nodes within the cluster to have access to the same files without needing to transfer them around. HCC has three arrays mounted on the clusters with more details [here]({{< ref "/guides/handling_data" >}}).
\ No newline at end of file
+++ +++
title = "Setting Up and Using Duo" title = "Setting Up and Using Duo"
description = "Duo Setup Instructions" description = "Duo Setup Instructions"
weight = "10" weight = "8"
+++ +++
##### Use of Duo two-factor authentication (https://www.duosecurity.com) is required for access to HCC resources. ##### Use of Duo two-factor authentication (https://www.duosecurity.com) is required for access to HCC resources.
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment