hccdemo

This is a walkthrough demo on machine learning to be run on HCC

Make sure you are in the WORK directory

clone the repo

git clone [the url of this repo]

download the FMNIST dataset files

wget https://www.dropbox.com/s/ywp0bx4q7g09qjh/fmnist_train_labels.npy?dl=1

wget https://www.dropbox.com/s/z62pv5j7x3svjeg/fmnist_train_data.npy?dl=1

remane the FMNIST files

mv fmnist_train_labels.npy\?dl\=1 fmnist_train_labels.npy

mv fmnist_train_data.npy\?dl\=1 fmnist_train_data.npy

to run the slurm script, put both run.sh and demo.py in the same directory. Than type

sbatch run.sh

after running a slurm script, logs will be placed in the current directory the filename will look similar to this

slurm-22578078.out

to view running jobs given a crane username, type the following

squeue -u <crane username>