November 16, 2020

A final reminder: the /scratch quota for all Amarel users will be reduced to 1 TB at noon tomorrow. See previous announcements and details below.

Galen

November 11, 2020

Amarel Users,

Reminder: Starting November 17, each Amarel user’s /scratch file system quota (limit) will be set to 1 TB

That 1 TB quota will be a soft quota with a 2 TB hard quota (firm limit) and a 2-week grace period. That means a user can have up to 1 TB of data in the /scratch file system, but if more than 1 TB is written there, the user will have 2 weeks to remove files and get back under 1 TB before they will no longer be able to write to /scratch. So, if a job using /scratch generates more output than expected and the quota is exceeded, that job can still run to completion. The 2 TB hard quota means that it will not be possible to put more than 2 TB of data in /scratch.

With this transition to a 1 TB /scratch quota happening at a time when the provisioning of owner-purchased /projects space has been delayed, there has been a significant increase in demand for temporary special allocations of /scratch storage. We have a fixed space, approximately 200 TB, dedicated to hosting temporary allocations of /scratch space to enable projects that require it to move forward. Once the delayed /projects space is available (within the next few weeks), we’ll have more flexibility with special allocation requests. Our special allocation request form is here: https://docs.google.com/forms/d/1GDLR21IV5gbhDVZcaWcZNkN9bW3lHrZaBCNSnyTnHX4

Guidance for moving data from Amarel is available in the Amarel User Guide: https://sites.google.com/view/cluster-user-guide/amarel#h.3jyxmx35y8y2 Please be aware that network performance outside the Amarel environment can be a limiting factor with transfer speeds of approximately 10 MB/sec in some cases. Plan ahead if you must make large transfers.

Please let me know if you have questions or need help.

Galen

November 4, 2020

Amarel Users,

This is just a reminder about the transition to 1 TB of /scratch space for all Amarel users that will occur on November 17. See the previous message (below) for details.

Information about how to check your storage utilization is presented in our user guide: https://sites.google.com/view/cluster-user-guide/amarel#h.kc5vkty50xan

Please let me know if you have questions or need help.

Galen

Galen Collier, PhD
Director, Research Support

From: Galen Collier
Sent: Thursday, August 6, 2020 11:50 PM
To: oarc_amarel_users@email.rutgers.edu <oarc_amarel_users@email.rutgers.edu>
Subject: Transitioning to a 1 TB /scratch quota

Amarel Users,

The expansion of storage space comprising our /scratch file system has slowed temporarily due to various constraints. This has created a situation where we must make significant changes to the space allocated to each user.

Starting November 17, each Amarel user’s /scratch file system quota (limit) will be set to 1 TB. That 1 TB quota will be a soft quota with a 2 TB hard quota (firm limit) and a 2-week grace period. That means a user can have up to 1 TB of data in the /scratch file system, but if more than 1 TB is written there, the user will have 2 weeks to remove files and get back under 1 TB before they will no longer be able to write to /scratch. So, if a job using /scratch generates more output than expected and the quota is exceeded, that job can still run to completion. The 2 TB hard quota means that it will not be possible to put more than 2 TB of data in /scratch.

Starting immediately, new Amarel accounts will be provisioned with the 1 TB /scratch quota.

When the transition to a 1 TB /scratch quota is completed in November, there will be increased demand for special allocations of storage. We will have a fixed space, approximately 200 TB, dedicated to hosting temporary allocations of /scratch space to enable projects that require it to move forward. Our special allocation request form is here: https://docs.google.com/forms/d/1GDLR21IV5gbhDVZcaWcZNkN9bW3lHrZaBCNSnyTnHX4

Guidance for moving data from Amarel is available in the Amarel User Guide: https://sites.google.com/view/cluster-user-guide/amarel#h.3jyxmx35y8y2 Please be aware that network performance outside the Amarel environment can be a limiting factor with transfer speeds of approximately 10 MB/sec in some cases. Plan ahead if you must make large transfers.

Please let me know if you have questions or need help.

Galen

Galen Collier, PhD
Director, Research Support
Office of Advanced Research Computing (OARC)
Rutgers, The State University of New Jersey
Busch Campus, CoRE Building, 96 Frelinghuysen Road, Room 621
Piscataway, NJ 08854
mobile: 970.948.4858
email: galen.collier@rutgers.edu
https://oarc.rutgers.edu