Frequently encountered blockers

SLURM is rejecting my jobs because my home directory is full

e.g. "home directory over quota" ,

We are limited to 40 GB of files in our home directories. This error indicates you have to many files.

Steps to diagnose:

1. Run showquota or myquota to see your file system space usage. If 'home' is 40GB or greater that's your issue.

2. Run du -sh * in your home directory and look for any large directories.

3. Run du -sh .[^.]* in your home directory and look for any large dot directories. Common issues are large .cache directory and large .conda directory

4. Alternatively, you can use the Ncurses Disk Utility tool via shifter to view your home directory usage with an ncurses GUI:

   Copy

   shifterimg pull bytesco/ncdu
   shifter --entrypoint --image=bytesco/ncdu

What to do if Conda env dirs are too large?

• Quick solution: conda clean --all

• Permanent Solution: Change conda env directory to a project directory

What to do if .cache is too large?

• Quick solution: Delete it! rm -rf .cache

  • Is this safe to do? Yes (probably) but you may want to move a backup of the directory to a project directory if you're worried about it.