Skip to content
Snippets Groups Projects

Commochameleon

Merged Adam Caprez requested to merge commochameleon into master
1 file
+ 28
7
Compare changes
  • Side-by-side
  • Inline
@@ -96,13 +96,6 @@ under.
@@ -96,13 +96,6 @@ under.
### Creating Custom Anaconda Environments
### Creating Custom Anaconda Environments
{{% notice info %}}
**NOTE:** By default, conda packages are installed in the user's `home` directory.
Since Crane's `home` directories are not writeable from the worker nodes,
the commands for installing, adding and removing conda packages shown here
should be performed on the **login node**, and not as part of an interactive or SLURM job.
{{% /notice %}}
The `create` command is used to create a new environment. It requires
The `create` command is used to create a new environment. It requires
at a minimum a name for the environment, and at least one package to
at a minimum a name for the environment, and at least one package to
install. For example, suppose we wish to create a new environment, and
install. For example, suppose we wish to create a new environment, and
@@ -127,6 +120,34 @@ conda activate mynumpy
@@ -127,6 +120,34 @@ conda activate mynumpy
Our new environment is now active, and we can use it. The shell prompt will change to indicate this as well.
Our new environment is now active, and we can use it. The shell prompt will change to indicate this as well.
 
### Using /common for environments
 
 
By default, conda environments are installed in the user's `home` directory at `~/.conda/envs`.
 
This is fine for smaller environments, but larger environments (especially ML/AI-based ones) can quickly
 
exhaust the space in the `home` directory.
 
 
For larger environments, we recommend using the `$COMMON` folder instead. To do so, use the `-p` option
 
instead of `-n` for `conda create`. For example, creating the same environment as above but
 
placing it in the folder `$COMMON/mynumpy` instead.
 
 
{{% panel theme="info" header="Create environment in /common" %}}
 
{{< highlight bash >}}
 
conda create -p $COMMON/mynumpy numpy=1.17
 
{{< /highlight >}}
 
{{% /panel %}}
 
 
To activate the environment, you must use the full path.
 
 
{{% panel theme="info" header="Activate environment in /common" %}}
 
{{< highlight bash >}}
 
conda activate $COMMON/mynumpy
 
{{< /highlight >}}
 
{{% /panel %}}
 
 
**Please note** that you'll need to add the `#SBATCH --licenses=common` directive to your submit scripts
 
as described [here]({{< relref "using_the_common_file_system" >}}) in order to use environments
 
in `$COMMON`.
 
### Adding and Removing Packages from an Existing Environment
### Adding and Removing Packages from an Existing Environment
To install additional packages in an environment, use the `install`
To install additional packages in an environment, use the `install`
Loading