Skip to content

Storage and Data Transfer

All storage on Baskerville is provided for active research data. The storage is not provided for long-term data retention or archival.

Home Directory

User home directories are restricted to 20GB. Please avoid storing any research data in your home directory, which has only a small quota and so should only be used for settings and config files like .bashrc, or .gitconfig etc.

You can see the location of your home directory, and how much space you are using, by running:

my_quota

Home directory Quota

The quota on your home directory is 20GB. We will not increase the quota of your home directory.

Project Space

Project space, available at /bask/projects/, is the main storage space and should be used to store your research-related data, code, etc. Each Baskerville project has a dedicated storage space available to all members of the project. Project space by default is allocated at 1TB, however additional quota for projects can be requested and is allocated based on justified need.

You can see the project space available to you:

Temporary (scratch) storage

There are two directories of scratch space provided for temporary storage of the user data that is generated by running jobs:

  • /tmp: local scratch storage (scoped to the running job – see info below).
  • /scratch-global: shared (network) scratch storage, available across all the compute nodes.

Info

When inside a Slurm job the /tmp directory is constructed in a per-job privately mounted namespace and therefore not visible to the users of other jobs running on the node.

If a job uses significant I/O (Input/Output) then local scratch space (i.e. the /tmp directory) should be utilised and the files only written back to the final project directory (on the network storage) once the job completes. An example of where this would apply is if an application or script makes heavy use of the disk (as opposed to RAM) for its working data.

Data Transfer

Information to follow.


Last update: September 29, 2021