Benchmarks

NVIDIA RTX A6000 Benchmarks for RELION Cryo-EM

January 26, 2021
3 min read
1_RrZnDof6ut46lEufaY5cBg.jpeg

NVIDIA RTX A6000 Benchmarks Overview

As a value-added supplier of scientific workstations and servers, Exxact regularly provides reference benchmarks in various GPU configurations to guide scientists in Cryogenic electron microscopy (cryo-EM) looking to procure systems optimized for their research. In this blog we benchmark NVIDIA’s newly released RTX A6000 GPU using Relion Cryo-EM, comparing GPU runtime to Total Runtime performance.

Software Summary

RELION (REgularised LIkelihood OptimisatioN), or Relion, has revolutionized the cryo–EM field since 2012. Developed by Scheres Lab at the MRC Laboratory of Molecular Biology, this stand-alone computer program uses a Bayesian approach to refine macromolecular structures by single-particle analysis of electron cryo-microscopy data.

The development of RELION is supported through long-term funding by the UK Medical Research Council, and is distributed under a GPLv2 license. This means that anyone (including commercial users) can download, use and modify RELION without having to pay anything. They just request that if RELION is useful in your work, that you cite their papers

RELION GPU Support Summary

With advancements in automation, compute power, and visual technology, the scope and complexity of datasets used in cryo-EM have grown substantially. GPU support and acceleration are essential for the flexibility of resource management, prevention of memory limitations, and to address the most computationally intensive processes of cryo-EM such as image classification, and high-resolution refinement.

Exxact RTX A6000 Benchmark System Specs

Make / ModelTS4-173535991-REL
Processor / Count2x AMD EPYC 7352
Total Logical Cores48
MemoryDDR4 512 GB
StorageSSD
OSCentos 7
CUDA Version11.1
Relion Version3.1

NVIDIA RTX A6000 Benchmarks – RELION

Relion Graphs Benchmark A6000

Compute Speed Increase from 2 GPUs to 4 GPUs is 53% faster!

Notes on System Memory

Although a minimum of 64 GB of RAM is recommended to run RELION with small image sizes (eg. 200×200) on either the original or accelerated versions of RELION, 360×360 problems run best on systems with more than 128GB of RAM. Systems with 256GB or more RAM are recommended for the CPU-accelerated kernels on larger image sizes. Insufficient memory causes individual MPI ranks to be killed, leading to zombie RELION jobs.

MPI Settings

Where some users may want to run more than one MPI rank per GPU, sufficient GPU memory is needed. Each MPI-slave that shares a GPU increases the use of memory. In this case, however, it’s recommended running a single MPI-slave per GPU for good performance and stable execution.

Notes on Scaling

Currently it is more beneficial to scale out than scale up. Based on previous tests it should be noted there may be diminishing returns in scaling once you pass 4 GPUs.

Have any questions about Relion Cryo-EM workstations and servers?
Contact Exxact Today

Topics

1_RrZnDof6ut46lEufaY5cBg.jpeg
Benchmarks

NVIDIA RTX A6000 Benchmarks for RELION Cryo-EM

January 26, 20213 min read

NVIDIA RTX A6000 Benchmarks Overview

As a value-added supplier of scientific workstations and servers, Exxact regularly provides reference benchmarks in various GPU configurations to guide scientists in Cryogenic electron microscopy (cryo-EM) looking to procure systems optimized for their research. In this blog we benchmark NVIDIA’s newly released RTX A6000 GPU using Relion Cryo-EM, comparing GPU runtime to Total Runtime performance.

Software Summary

RELION (REgularised LIkelihood OptimisatioN), or Relion, has revolutionized the cryo–EM field since 2012. Developed by Scheres Lab at the MRC Laboratory of Molecular Biology, this stand-alone computer program uses a Bayesian approach to refine macromolecular structures by single-particle analysis of electron cryo-microscopy data.

The development of RELION is supported through long-term funding by the UK Medical Research Council, and is distributed under a GPLv2 license. This means that anyone (including commercial users) can download, use and modify RELION without having to pay anything. They just request that if RELION is useful in your work, that you cite their papers

RELION GPU Support Summary

With advancements in automation, compute power, and visual technology, the scope and complexity of datasets used in cryo-EM have grown substantially. GPU support and acceleration are essential for the flexibility of resource management, prevention of memory limitations, and to address the most computationally intensive processes of cryo-EM such as image classification, and high-resolution refinement.

Exxact RTX A6000 Benchmark System Specs

Make / ModelTS4-173535991-REL
Processor / Count2x AMD EPYC 7352
Total Logical Cores48
MemoryDDR4 512 GB
StorageSSD
OSCentos 7
CUDA Version11.1
Relion Version3.1

NVIDIA RTX A6000 Benchmarks – RELION

Relion Graphs Benchmark A6000

Compute Speed Increase from 2 GPUs to 4 GPUs is 53% faster!

Notes on System Memory

Although a minimum of 64 GB of RAM is recommended to run RELION with small image sizes (eg. 200×200) on either the original or accelerated versions of RELION, 360×360 problems run best on systems with more than 128GB of RAM. Systems with 256GB or more RAM are recommended for the CPU-accelerated kernels on larger image sizes. Insufficient memory causes individual MPI ranks to be killed, leading to zombie RELION jobs.

MPI Settings

Where some users may want to run more than one MPI rank per GPU, sufficient GPU memory is needed. Each MPI-slave that shares a GPU increases the use of memory. In this case, however, it’s recommended running a single MPI-slave per GPU for good performance and stable execution.

Notes on Scaling

Currently it is more beneficial to scale out than scale up. Based on previous tests it should be noted there may be diminishing returns in scaling once you pass 4 GPUs.

Have any questions about Relion Cryo-EM workstations and servers?
Contact Exxact Today

Topics