Skip to content
Snippets Groups Projects

Compare revisions

Changes are shown as if the source revision was being merged into the target revision. Learn more about comparing revisions.

Source

Select target project
No results found
Select Git revision
  • FAQ
  • RDPv10
  • UNL_OneDrive
  • atticguidelines
  • data_share
  • globus-auto-backups
  • good-hcc-practice-rep-workflow
  • hchen2016-faq-home-is-full
  • ipynb-doc
  • master
  • rclone-fix
  • sislam2-master-patch-51693
  • sislam2-master-patch-86974
  • site_url
  • test
15 results

Target

Select target project
  • dweitzel2/hcc-docs
  • OMCCLUNG2/hcc-docs
  • salmandjing/hcc-docs
  • hcc/hcc-docs
4 results
Select Git revision
  • 26-add-screenshots-for-newer-rdp-v10-client
  • 28-overview-page-for-connecting-2
  • RDPv10
  • gpu_update
  • master
  • overview-page-for-handling-data
  • patch-1
  • patch-10
  • patch-11
  • patch-12
  • patch-2
  • patch-3
  • patch-4
  • patch-5
  • patch-6
  • patch-7
  • patch-8
  • patch-9
  • runTime
  • submitting-jobs-overview
20 results
Show changes
Showing
with 60 additions and 185 deletions
+++
title = "Available Partitions for Crane"
description = "List of available partitions for crane.unl.edu."
scripts = ["https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/js/jquery.tablesorter.min.js", "https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/js/widgets/widget-pager.min.js","https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/js/widgets/widget-filter.min.js","/js/sort-table.js"]
css = ["http://mottie.github.io/tablesorter/css/theme.default.css","https://mottie.github.io/tablesorter/css/theme.dropbox.css", "https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/css/jquery.tablesorter.pager.min.css","https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/css/filter.formatter.min.css"]
+++
### Crane:
{{< table url="http://crane-head.unl.edu:8192/slurm/partitions/json" >}}
+++
title = "Available Partitions for Rhino"
description = "List of available partitions for rhino.unl.edu."
scripts = ["https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/js/jquery.tablesorter.min.js", "https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/js/widgets/widget-pager.min.js","https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/js/widgets/widget-filter.min.js","/js/sort-table.js"]
css = ["http://mottie.github.io/tablesorter/css/theme.default.css","https://mottie.github.io/tablesorter/css/theme.dropbox.css", "https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/css/jquery.tablesorter.pager.min.css","https://cdnjs.cloudflare.com/ajax/libs/jquery.tablesorter/2.31.1/css/filter.formatter.min.css"]
+++
### Rhino:
{{< table url="http://rhino-head.unl.edu:8192/slurm/partitions/json" >}}
+++
title = "Sandstone"
description = "How to use HCC's sandstone environment"
weight = "95"
+++
### Overview
The HCC Sandstone environment is a GUI interface to the Crane cluster featuring a file browser, text editor, web terminal and SLURM script helper,
To login to the Sandstone environment, go to [crane.unl.edu](https://crane.unl.edu) in your web browser and sign in using your HCC Login Info and DUO authentication.
Upon login, you will land at the File Browser.
### File Browser
The file browser allows you to view, access, and transfer files on Crane. On the left side you will have your available spaces, both your home and work directories. In the upper right of the page, you have buttons to upload files, create a file, and create a directory.
{{< figure src="/images/SandstonefileBrowserOver.png">}}
Clicking on either box under "My Spaces" will change your current directory to either your home or work directory and display your user/group usage and quotas. You can then navigate directories by clicking through them in a similar manner as you would with Windows or MacOS.
{{< figure src="/images/SandstonefileOptions.png">}}
Clicking on a file or directory will bring up some options such as the permissions and actions to do such as editing the file, duplicating or moving it, deleting it, and downloading it.
### Editor
The editor is a basic text editor that allows you to have multiple files loaded and manipulate the files. A small file explorer is available on the left side to access more files. There are similar actions available for files above the mini file browser.
{{< figure src="/images/Sandstoneeditor.png">}}
Like most text editors, basic functions exist to undo and redo changes, find and replace, and most importantly, to save the file.
{{< figure src="/images/SandstoneedtiorDropDown.png">}}
### Terminal
The terminal gives you access to the linux command line on crane, similar to what you would have if you SSH'd directly into Crane. Once the login and quote screen, you can enter commands and interact as you would with a standard terminal.
{{< figure src="/images/SandstoneTerminal.png">}}
### Slurm Assist
Slurm assist is a tool to help create and run slurm submit scripts. The first step is to select a base profile from the profile dropdown menu. Options will appear and the directives will automatically appear. The options are editable to better fit to your specific job with more details found in our submitting jobs documentation. After the directives are filled out, you can then add the commands to start your job in the script section. To save the job, select 'save script for later' and save the script in a known location for later.
{{< figure src="/images/SandstoneSASettings.png">}}
From here, you can also schedule the script recently create, by selecting "Schedule Job". A confirmation will appear with the Job ID and then an instruction on how to view the status of your job.
{{< figure src="/images/SandstoneJobConf.png">}}
{{< figure src="/images/SandstoneSAStatus.png">}}
You can view the progress of other jobs from slurm assist by going to the status page. Here you will see the State of the job, its ID, name, group name, runtime, and the start and end times.
{{< figure src="/images/SandstoneSAStatusPage.png">}}
{{< figure src="/images/SandstoneSAStatuses.png">}}
+++
title = "Submitting an MPI Job"
description = "How to submit an MPI job on HCC resources."
weight=40
+++
This script requests 16 cores on nodes with InfiniBand:
{{% panel theme="info" header="mpi.submit" %}}
{{< highlight batch >}}
#!/bin/sh
#SBATCH --ntasks=16
#SBATCH --mem-per-cpu=1024
#SBATCH --time=03:15:00
#SBATCH --error=/work/[groupname]/[username]/job.%J.err
#SBATCH --output=/work/[groupname]/[username]/job.%J.out
module load compiler/gcc/8.2 openmpi/2.1
mpirun /home/[groupname]/[username]/mpiprogram
{{< /highlight >}}
{{% /panel %}}
The above job will allocate 16 cores on the default partition. The 16
cores could be on any of the nodes in the partition, even split between
multiple nodes.
### Advanced Submission
Some users may prefer to specify more details. This will allocate 32
tasks, 16 on each of two nodes:
{{% panel theme="info" header="mpi.submit" %}}
{{< highlight batch >}}
#!/bin/sh
#SBATCH --nodes=2
#SBATCH --ntasks-per-node=16
#SBATCH --mem-per-cpu=1024
#SBATCH --time=03:15:00
#SBATCH --error=/work/[groupname]/[username]/job.%J.err
#SBATCH --output=/work/[groupname]/[username]/job.%J.out
module load compiler/gcc/8.2 openmpi/2.1
mpirun /home/[groupname]/[username]/mpiprogram
{{< /highlight >}}
{{% /panel %}}
+++
title = "Submitting HTCondor Jobs"
description = "How to submit HTCondor Jobs on HCC resources."
weight=50
+++
If you require features of HTCondor, such as DAGMan or Pegasus,
[HTCondor](http://research.cs.wisc.edu/htcondor/) can
submit jobs using HTCondor's PBS integration. This can
be done by adding `grid_resource = pbs` to the submit file. An example
submission script is below:
{{% panel theme="info" header="submit.condor" %}}
{{< highlight batch >}}
universe = grid
grid_resource = pbs
executable = test.sh
output = stuff.out
error = stuff.err
log = stuff.log
batch_queue = guest
queue
{{< /highlight >}}
{{% /panel %}}
The above script will translate the condor submit file into a SLURM
submit file, and execute the `test.sh` executable on a worker node.
{{% notice warning %}}
The `/home` directories are read only on the worker nodes. You
have to submit your jobs from the `/work` directory just as you would in
SLURM.
{{% /notice %}}
### Using Pegasus
If you are using [Pegasus](http://pegasus.isi.edu),
instructions on using the *glite* interface (as shown above) are
available on the
[User Guide](http://pegasus.isi.edu/wms/docs/latest/execution_environments.php#glite).
ignore: "facilities.md"
hide: true
---
title: "2012"
summary: "Historical listing of various HCC events for the year 2012."
---
Historical listing of HCC Events
----------
{{ children('Events/2012') }}
+++ ---
title = "Nebraska Supercomputing Symposium '12" title: Nebraska Supercomputing Symposium '12
description = "Nebraska Supercomputing Symposium '12." summary: "Nebraska Supercomputing Symposium '12."
+++ ---
{{< figure src="/images/2012-11-07.jpg" width="300" class="img-border">}} <img src="/images/2012-11-07.jpg" width="300" class="img-border">
{{< figure src="/images/2012-11-07hdr.jpg" width="300" class="img-border">}} <img src="/images/2012-11-07hdr.jpg" width="300" class="img-border">
{{< figure src="/images/PIVOT_Logo.png" width="100" class="img-border">}} Talks <img src="/images/PIVOT_Logo.png" width="100" class="img-border>
Talks
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
- [Intro slides](https://unl.box.com/s/4gctct2jgu2e78y7efld7w39xzbd1j4d) - [Intro slides](https://unl.box.com/s/4gctct2jgu2e78y7efld7w39xzbd1j4d)
......
+++ ---
title = "Supercomputing Mini Workshop 2012" title: Supercomputing Mini Workshop 2012
description = "Supercomputing Mini Workshop 2012." summary: "Supercomputing Mini Workshop 2012."
+++ ---
Presentation Presentation
============ ============
......
---
title: "2013"
summary: "Historical listing of various HCC events for the year 2013."
---
Historical listing of HCC Events
----------
{{ children('Events/2013') }}
+++ ---
title = "HCC OSG Workshop, June 2013" title: HCC OSG Workshop, June 2013
description = "HCC OSG Workstop, June 2013." summary: "HCC OSG Workstop, June 2013."
+++ ---
Location: Unity Room/212 in the Jackie Gaughan Multicultural Center Location: Unity Room/212 in the Jackie Gaughan Multicultural Center
......
+++ ---
title = "Supercomputing Mini Workshop 2013" title: Supercomputing Mini Workshop 2013
description = "Supercomputing Mini Workshop 2013." summary: "Supercomputing Mini Workshop 2013."
+++ ---
Supercomputing Mini Workshop - February 27, 2013 Supercomputing Mini Workshop - February 27, 2013
================================================ ================================================
{{% notice info %}}The materials found on this page were applicable at the time of the event. When referencing these, !!! noteThe materials found on this page were applicable at the time of the event. When referencing these,
please check current documentation to ensure the resources are still available.A list of currently available resources can be found on the please check current documentation to ensure the resources are still available.A list of currently available resources can be found on the
[Submitting Jobs page](https://hcc.unl.edu/docs/#resource-capabilities){{% /notice %}} [Submitting Jobs page](https://hcc.unl.edu/docs/#resource-capabilities)
In this hour-long mini workshop, you will obtain hands-on experience In this hour-long mini workshop, you will obtain hands-on experience
performing a simple calculation (summing from 1 to 16) with a performing a simple calculation (summing from 1 to 16) with a
......
+++ ---
title = "August 2014 UNO Workshop" title: August 2014 UNO Workshop
description = "August 2014 UNO Workshop." summary: "August 2014 UNO Workshop."
+++ ---
When: August 29, 2014 When: August 29, 2014
......
---
title: "2014"
summary: "Historical listing of various HCC events for the year 2014."
---
Historical listing of HCC Events
----------
{{ children('Events/2014') }}
+++ ---
title = "July 2014 Bioinformatics Workshop" title: July 2014 Bioinformatics Workshop
description = "July 2014 Bioinformatics Workshop" summary: "July 2014 Bioinformatics Workshop"
+++ ---
Monday - Wednesday, July 28 -30 (lunch will be provided) Monday - Wednesday, July 28 -30 (lunch will be provided)
......