Galen Collier
Thursday, August 6, 2020 at 11:51 pm

Amarel Users,

The expansion of storage space comprising our /scratch file system has slowed temporarily due to various constraints. This has created a situation where we must make significant changes to the space allocated to each user.

Starting November 17, each Amarel user’s /scratch file system quota (limit) will be set to 1 TB. That 1 TB quota will be a soft quota with a 2 TB hard quota (firm limit) and a 2-week grace period. That means a user can have up to 1 TB of data in the /scratch file system, but if more than 1 TB is written there, the user will have 2 weeks to remove files and get back under 1 TB before they will no longer be able to write to /scratch. So, if a job using /scratch generates more output than expected and the quota is exceeded, that job can still run to completion. The 2 TB hard quota means that it will not be possible to put more than 2 TB of data in /scratch.

Starting immediately, new Amarel accounts will be provisioned with the 1 TB /scratch quota.

When the transition to a 1 TB /scratch quota is completed in November, there will be increased demand for special allocations of storage. We will have a fixed space, approximately 200 TB, dedicated to hosting temporary allocations of /scratch space to enable projects that require it to move forward. Our special allocation request form is here: https://oarc.rutgers.edu/amarel-special-allocation-request/

Guidance for moving data from Amarel is available in the Amarel User Guide: https://sites.google.com/view/cluster-user-guide/amarel#h.3jyxmx35y8y2 Please be aware that network performance outside the Amarel environment can be a limiting factor with transfer speeds of approximately 10 MB/sec in some cases. Plan ahead if you must make large transfers.

Please let me know if you have questions or need help.

Galen

Galen Collier, PhD
Director, Research Support
Office of Advanced Research Computing (OARC)
Rutgers, The State University of New Jersey
Busch Campus, CoRE Building, 96 Frelinghuysen Road, Room 621
Piscataway, NJ 08854
mobile: 970.948.4858
email: galen.collier@rutgers.edu
http://it.rutgers.edu/oarc