Rutgers students, researchers, and faculty utilizing Amarel
Rutgers departments, schools, centers, and institutes performing work on Amarel
Core compute hours since 2016
In July 2017, the Office of Advanced Research Computing (OARC) unveiled Amarel, a “condominium” style computing environment developed to serve the university’s wide-ranging research needs. The Amarel cluster provides a shared platform that optimizes resources for the benefit of all users. Named in honor of Dr. Saul Amarel, one of the founders of the Rutgers Computer Science Department and contributor to advanced computing and artificial intelligence research and methodologies, Amarel is designed to suit many different research applications.
Through Phase 4 (late 2020):
- 681 compute nodes
- 19,972 Intel Xeon cores
- 166 GPUs
- Open OnDemand servers
- InfiniBand FDR & EDR fabric
- Community-contributed software repository
- Spans three Rutgers data centers (Piscataway, Newark, and Camden) producing a unified compute, data, and storage system
- Rolling node/phase retirement with new node replacement, beginning in spring 2021
The Amarel model
Amarel is a shared community-owned advanced computing environment available to any investigator or student with projects requiring research computing resources. The model is distinguished by a set of uniform technical and policy elements that, while sufficiently flexible to support the degree of heterogeneity inherent in the Rutgers environment, affords a level of standardization that greatly simplifies management procedures, troubleshooting, and provides a more seamless user experience.
High Throughput Computing (HTC)
Large memory systems
Accelerators (GPGPUs, XEON PHIs, FPGAs)
The ability to couple with edge devices
Access to Amarel
While general access use is available to the entire Rutgers community, investigators can become condominium owners through a university-sponsored matching program. Owners have highest priority and are guaranteed access commensurate with their investment. Owner allocations are designed to feel as close to a locally maintained and managed system as possible, but with unused cycles being available to the general pool. Free access is available on a first come first served basis to the Rutgers community utilizing general pooled resources under an open access policy. Non-owner jobs can be preempted immediately by higher priority (owner) jobs.
Become an Amarel owner
Phase IV hardware specs
In 2020, OARC completed procurement and installation of its annual hardware, compute nodes, and storage assets for Amarel’s Phase IV. Installation by the vendor was delayed by campus/data center access restrictions and health/safety concerns due to COVID, but availability of the Amarel Phase IV resources rolled out to owners and the university community in late 2020.
Each of the new compute nodes includes the following:
- 2x Intel Xeon Gold 6230R (Cascade Lake) Processors (35.75MB cache, 2.10GHz): 2933 MHz DDR4 memory 26-core processors (52 cores/node)
- 12x16GB DIMMS (192GB/node)
- 480GB SSD on-board drive
- 10GigE and Infiniband HDR (100Gb/s) adapters
The price of $7,200 per node includes a four-year warranty. New owners receive 1 complimentary terabyte of storage with their first purchase.
NOTE: If you plan to use software on the cluster that requires special licensing, configuration, or data transfer support (e.g., something more complex than open source software you can install in your personal directory), the feasibility of installing and running that software must be evaluated by our infrastructure team. We have encountered software packages requiring remote authentication schemes, data transfer capability from compute nodes, and persistent local services like web servers that our cluster’s environment cannot support.
For more information on both Phase IV and available consumer GPUs, or to discuss your interest in becoming an Amarel owner, contact us.