From ce6511f186fc4143d7f3caaf0aa14cbb8a2bb856 Mon Sep 17 00:00:00 2001 From: Caughlin Bohn <cbohn4@unl.edu> Date: Fri, 21 Dec 2018 16:20:02 -0600 Subject: [PATCH] Changed ordering and moved more detailed guides to connectin/ --- .../running_applications/fortran_c_on_hcc.md | 4 ++-- .../running_applications/mpi_jobs_on_hcc.md | 4 ++-- .../submitting_jobs/condor_jobs_on_hcc.md | 2 +- .../_index.md} | 2 +- .../{ => connecting}/basic_linux_commands.md | 0 .../{ => connecting}/for_maclinux_users.md | 0 .../{ => connecting}/for_windows_users.md | 0 .../how_to_change_your_password.md | 0 content/quickstarts/hpc_intro.md | 22 ------------------- .../quickstarts/setting_up_and_using_duo.md | 2 +- 10 files changed, 7 insertions(+), 29 deletions(-) rename content/quickstarts/{connecting_to_clusters.md => connecting/_index.md} (98%) rename content/quickstarts/{ => connecting}/basic_linux_commands.md (100%) rename content/quickstarts/{ => connecting}/for_maclinux_users.md (100%) rename content/quickstarts/{ => connecting}/for_windows_users.md (100%) rename content/quickstarts/{ => connecting}/how_to_change_your_password.md (100%) delete mode 100644 content/quickstarts/hpc_intro.md diff --git a/content/guides/running_applications/fortran_c_on_hcc.md b/content/guides/running_applications/fortran_c_on_hcc.md index d2817682..8a5ed998 100644 --- a/content/guides/running_applications/fortran_c_on_hcc.md +++ b/content/guides/running_applications/fortran_c_on_hcc.md @@ -10,8 +10,8 @@ downloaded from [serial_dir.zip](/attachments/serial_dir.zip). #### Login to a HCC Cluster (Tusker or Crane) -Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/for_windows_users">}})) or Terminal ([For Mac/Linux -Users]({{< relref "/quickstarts/for_maclinux_users">}})) and make a subdirectory called `serial_dir` under the `$WORK` directory. +Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/connecting/for_windows_users">}})) or Terminal ([For Mac/Linux +Users]({{< relref "/quickstarts/connecting/for_maclinux_users">}})) and make a subdirectory called `serial_dir` under the `$WORK` directory. {{< highlight bash >}} $ cd $WORK diff --git a/content/guides/running_applications/mpi_jobs_on_hcc.md b/content/guides/running_applications/mpi_jobs_on_hcc.md index 7bc5c9ec..b2aaedbd 100644 --- a/content/guides/running_applications/mpi_jobs_on_hcc.md +++ b/content/guides/running_applications/mpi_jobs_on_hcc.md @@ -10,8 +10,8 @@ scripts can be downloaded from [mpi_dir.zip](/attachments/mpi_dir.zip). #### Login to a HCC Cluster -Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/for_windows_users">}})) or Terminal ([For Mac/Linux -Users]({{< relref "/quickstarts/for_maclinux_users">}})) and make a subdirectory called `mpi_dir` under the `$WORK` directory. +Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/connecting/for_windows_users">}})) or Terminal ([For Mac/Linux +Users]({{< relref "/quickstarts/connecting/for_maclinux_users">}})) and make a subdirectory called `mpi_dir` under the `$WORK` directory. {{< highlight bash >}} $ cd $WORK diff --git a/content/guides/submitting_jobs/condor_jobs_on_hcc.md b/content/guides/submitting_jobs/condor_jobs_on_hcc.md index 81150c1d..4a2ab4ea 100644 --- a/content/guides/submitting_jobs/condor_jobs_on_hcc.md +++ b/content/guides/submitting_jobs/condor_jobs_on_hcc.md @@ -10,7 +10,7 @@ can be downloaded from [condor_dir.zip](/attachments/3178558.zip). #### Login to a HCC Cluster -Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/for_windows_users">}})) or Terminal ([For Mac/Linux Users]({{< relref "/quickstarts/for_maclinux_users">}})) and make a subdirectory called `condor_dir` under the `$WORK` directory. In the subdirectory `condor_dir`, create job subdirectories that host the input data files. Here we create two job subdirectories, `job_0` and `job_1`, and put a data file (`data.dat`) in each subdirectory. The data file in `job_0` has a column of data listing the integers from 1 to 5. The data file in `job_1` has a integer list from 6 to 10. +Log in to a HCC cluster through PuTTY ([For Windows Users]({{< relref "/quickstarts/connecting/for_windows_users">}})) or Terminal ([For Mac/Linux Users]({{< relref "/quickstarts/connecting/for_maclinux_users">}})) and make a subdirectory called `condor_dir` under the `$WORK` directory. In the subdirectory `condor_dir`, create job subdirectories that host the input data files. Here we create two job subdirectories, `job_0` and `job_1`, and put a data file (`data.dat`) in each subdirectory. The data file in `job_0` has a column of data listing the integers from 1 to 5. The data file in `job_1` has a integer list from 6 to 10. {{< highlight bash >}} $ cd $WORK diff --git a/content/quickstarts/connecting_to_clusters.md b/content/quickstarts/connecting/_index.md similarity index 98% rename from content/quickstarts/connecting_to_clusters.md rename to content/quickstarts/connecting/_index.md index aa557e2c..b0149d21 100644 --- a/content/quickstarts/connecting_to_clusters.md +++ b/content/quickstarts/connecting/_index.md @@ -1,7 +1,7 @@ +++ title = "How to Connect" description = "What is a cluster and what is HPC" -weight = "20" +weight = "9" +++ High-Performance Computing is the use of groups of computers to solve computations a user or group would not be able to solve in a reasonable time-frame on their own desktop or laptop. This is often achieved by splitting one large job amongst numerous cores or 'workers'. This is similar to how a skyscraper is built by numerous individuals rather than a single person. Many fields take advantage of HPC including bioinformatics, chemistry, materials engineering, and newer fields such as educational psychology and philosophy. {{< figure src="/images/cluster.png" height="450" >}} diff --git a/content/quickstarts/basic_linux_commands.md b/content/quickstarts/connecting/basic_linux_commands.md similarity index 100% rename from content/quickstarts/basic_linux_commands.md rename to content/quickstarts/connecting/basic_linux_commands.md diff --git a/content/quickstarts/for_maclinux_users.md b/content/quickstarts/connecting/for_maclinux_users.md similarity index 100% rename from content/quickstarts/for_maclinux_users.md rename to content/quickstarts/connecting/for_maclinux_users.md diff --git a/content/quickstarts/for_windows_users.md b/content/quickstarts/connecting/for_windows_users.md similarity index 100% rename from content/quickstarts/for_windows_users.md rename to content/quickstarts/connecting/for_windows_users.md diff --git a/content/quickstarts/how_to_change_your_password.md b/content/quickstarts/connecting/how_to_change_your_password.md similarity index 100% rename from content/quickstarts/how_to_change_your_password.md rename to content/quickstarts/connecting/how_to_change_your_password.md diff --git a/content/quickstarts/hpc_intro.md b/content/quickstarts/hpc_intro.md deleted file mode 100644 index ac128756..00000000 --- a/content/quickstarts/hpc_intro.md +++ /dev/null @@ -1,22 +0,0 @@ -+++ -title = "Introduction to HPC" -description = "What is a cluster and what is HPC" -weight = "35" -+++ -High-Performance Computing is the use of groups of computers to solve computations that a user or group would not be able to solve in a reasonable time-frame on their own desktop or laptop. This is often achieved by splitting one large job amongst numerous cores or 'workers'. This is similar to how a skyscraper is built by numerous individuals rather than a single person. Many fields take advantage of HPC including bioinformatics, chemistry, materials engineering, and newer fields such as educational psychology and philosophy. - -HPC clusters consist of four primary parts, the login node, management node, workers, and a central storage array. All of these parts are bound together with a scheduler such as HTCondor or SLURM. -{{< figure src="/images/cluster.png" height="450" >}} -##### [Source](https://training.h3abionet.org/technical_workshop_2015/?page_id=403) - -#### Login Node: -Users will automatically land on the login node when they log in to the clusters. You will [submit jobs] ({{< ref "/guides/submitting_jobs" >}}) using one of the schedulers and pull the results of your jobs. Running jobs on the login node directly will be stopped so others can use the login node to submit jobs. -</br></br> -#### Management Node: -The management node contains and runs the schedulers and other utilities for managing the cluster. -</br></br> -#### Worker Nodes: -The worker nodes are what run and process your jobs that are submitted from the schedulers. Through the use of the schedulers, more work can be efficiently done by squeezing in all jobs possible for the resources requested throughout the nodes. They also allow for fair use computing by making sure one user or group is not using the entire cluster at once and allowing others to use the clusters. -</br></br> -#### Central Storage Array: -The central storage array allows all of the nodes within the cluster to have access to the same files without needing to transfer them around. HCC has three arrays mounted on the clusters with more details [here]({{< ref "/guides/handling_data" >}}). \ No newline at end of file diff --git a/content/quickstarts/setting_up_and_using_duo.md b/content/quickstarts/setting_up_and_using_duo.md index 72d79d1d..04f0847d 100644 --- a/content/quickstarts/setting_up_and_using_duo.md +++ b/content/quickstarts/setting_up_and_using_duo.md @@ -1,7 +1,7 @@ +++ title = "Setting Up and Using Duo" description = "Duo Setup Instructions" -weight = "10" +weight = "8" +++ ##### Use of Duo two-factor authentication (https://www.duosecurity.com) is required for access to HCC resources. -- GitLab