Storage and Data Transfer
All storage on Baskerville is provided for active research data. The storage is not provided for long-term data retention or archival.
Home Directory¶
User home directories are restricted to 20GB. Please avoid storing any research data in your home directory, which
has only a small quota and so should only be used for settings and config files like .bashrc, or .gitconfig etc.
You can see the location of your home directory, and how much space you are using, by running:
my_quota
Home directory Quota
The quota on your home directory is 20GB. We will not increase the quota of your home directory.
Project Space¶
Project space, available at /bask/projects/, is the main storage space and should be used to store your
research-related data, code, etc. Each Baskerville project has a dedicated storage space available to all members of
the project. Project space by default is allocated at 1TB, however additional quota for projects can be requested and
is allocated based on justified need.
You can see the project space available to you:
Temporary (scratch) storage¶
There are two directories of scratch space provided for temporary storage of the user data that is generated by running jobs:
/tmp: local scratch storage (scoped to the running job – see info below)./scratch-global: shared (network) scratch storage, available across all the compute nodes.
Info
When inside a Slurm job the /tmp directory is constructed in a per-job privately mounted
namespace and therefore not visible to the users of other jobs running on the node.
If a job uses significant I/O (Input/Output) then local scratch space (i.e. the /tmp directory) should be
utilised and the files only written back to the final project directory (on the network storage) once the job
completes. An example of where this would apply is if an application or script makes heavy use of the disk (as
opposed to RAM) for its working data.
Data Transfer¶
Information to follow.