From b7440de53a20343ba1c00c0ab43cccc835fc2366 Mon Sep 17 00:00:00 2001
From: Adam Caprez <acaprez2@unl.edu>
Date: Thu, 14 Nov 2019 04:05:53 +0000
Subject: [PATCH] Add section on GPU guest jobs.

---
 .../submitting_cuda_or_openacc_jobs.md           | 16 ++++++++++++++++
 1 file changed, 16 insertions(+)

diff --git a/content/guides/submitting_jobs/submitting_cuda_or_openacc_jobs.md b/content/guides/submitting_jobs/submitting_cuda_or_openacc_jobs.md
index 0f43d6af..566b43a8 100644
--- a/content/guides/submitting_jobs/submitting_cuda_or_openacc_jobs.md
+++ b/content/guides/submitting_jobs/submitting_cuda_or_openacc_jobs.md
@@ -94,3 +94,19 @@ module load cuda/8.0 compiler/pgi/16
 ./acc-app.exe
 {{< /highlight >}}
 {{% /panel %}}
+
+### Submitting Pre-emptable Jobs
+
+Some GPU hardware is reserved by various groups for priority access.  While the group that has
+purchased the priority access will always have immediate access, HCC makes these nodes
+available opportunistically.  When not otherwise utilized, **jobs can run on these resources with the
+limitation that they may be pre-empted (i.e. killed) at any time**.
+
+To submit jobs to these resources, add the following to your srun or sbatch command:
+
+{{< highlight batch >}}
+--partition=guest_gpu --gres=gpu
+{{< /highlight >}}
+
+**In order to properly utilize pre-emptable resources, your job must be able to support
+some type of checkpoint/resume functionality.**
-- 
GitLab