News

CryoSPARC v3.0 Now Available

December 9, 2020
8 min read
blog-cryosparc-v3.0.jpg

CryoSPARC Overview

CryoSPARC (Cryo-EM Single Particle Ab-initio Reconstruction and Classification) is a software package for processing cryo-electron microscopy (cryo-EM) single particle data, used in research and drug discovery.

As a complete solution for cryo-EM processing, CryoSPARC allows:

  • Ultra-fast end-to-end processing of raw cryo-EM data and reconstruction of electron density maps, ready for ingestion into model building software
  • Optimized algorithms and GPU acceleration at all stages, from pre-processing through particle picking, 2D particle classification, 3D ab-initio structure determination, high resolution refinement, and heterogeneity analysis
  • Specialized and unique tools for therapeutically relevant targets, membrane proteins, continuously flexible structures
  • Interactive, visual and iterative experimentation for even the most complex workflows

Interested in getting faster results?
Learn more about CryoSPARC Optimized GPU Workstations

CryoSPARC v3.0 Release

The newest update is packed with performance optimizations and various stability enhancements.
Learn how to update your CryoSPARC instance here

What’s New

  • Improved Non-Uniform Refinement algorithm NEW and job type BETA. Higher resolution results and reduced sensitivity to parameter changes. For more details, see the new paper published in Nature Methods
    Plus:

    • Support for local and global CTF refinement during non-uniform refinement
    • Fast, new GPU implementation of non-uniform regularization developed with support from NVIDIA
    • Additionally, support for automatic adaptive marginalization over alignment variables (enabled by default) yielding further improvements for small molecules.
  • Upgraded to modern Python 3.7 runtime, including new updated dependencies and installation. Easy upgrades and downgrades between cryoSPARC v2 and v3.
  • Support for CUDA 11 + Ampere Architecture GPUs (3080, 3090, A100, etc.).
  • Full support for Thermo Fisher Scientific EER data in cryoSPARC and cryoSPARC Live. EER data is decompressed on the fly and can be upsampled and split into the desired number of fractions during processing.
  • Improved defect file and defect pixel support in motion correction jobs in cryoSPARC and cryoSPARC Live. Defect pixels can be specified in a .txt defect file or as zeros in the gain reference.
  • Helical Reconstruction BETA: New suite of tools for end-to-end helical processing and refinement, including:
    • NEW high-resolution Helical Refinement job that also supports non-uniform regularization, and enforcement and local optimization of helical symmetry
    • NEW Filament Tracer job tailored to the picking of filaments
    • Updates to Inspect Particle Picks to allow pruning of filament picks by curvature
    • Symmetry search utility for exploring the symmetry space in a helical volume
  • Extract From Micrographs will now re-center particles by default if they have already been extracted and aligned through 2D classification, 3D reconstruction, or refinement.
  • Homogeneous Reconstruction Only job type that performs 3D reconstruction from previously aligned particle images.
  • Ability to set priority values for jobs and users in cryoSPARC and cryoSPARC Live, allowing jobs to run in priority order instead of the order they were queued. Learn more about this feature with our Guide to Priority Job Queuing
  • CryoSPARC Live Session Data Management: View, delete and archive data created by cryoSPARC Live on a granular level. Save space taken up by data generated in old sessions and projects, while still being able to browse and view results.
  • A new Data Management tab is available in the Resource Manager in cryoSPARC, displaying details of all projects and workspaces available to the logged in user. At-a-glance information includes: project creation and ownership info, project directory location, last accessed/viewed, project size and other details.
  • Reduced GPU memory footprint in Patch Motion Correction. The overall GPU memory footprint of patch motion correction has been reduced. This enables most K3-sized image data to be processed on 11GB GPUs. Additionally, a “low-memory mode” switch is now available, which reduces it even further (at expense of speed).
  • Remove Duplicate Particles job checks for particles that are extracted too close together on a micrograph and keeps only one, to allow combining picks from multiple pickers without affecting FSC estimates.
  • Patch Motion Correction in cryoSPARC and cryoSPARC Live now optionally support movie data that has been saved with a variable dose rate among frames (e.g., from Leginon) – BETA
  • Systemd Unit File to restart cryoSPARC after server shutdown: A systemd unit file is now included to allow running cryoSPARC as a service.

Updates

  • Improvements to Patch CTF estimation for better CTF fit in cases where background or envelope estimation is difficult. Improved robustness in relative ice thickness measure.
  • Downsample Particles and Extract from Micrographs will now correctly scale particle alignment shifts, fixing issues where downsample was used immediately prior to local refinement or 3D variability.
  • Orientation distribution and posterior precision plots were added to Heterogeneous Refinement, and can be disabled by turning off the “Show viewing orientation distribution plots” parameter.
  • Import Micrographs now has an option to output constant CTF values, so that subsequent steps will ignore the CTF entirely. Useful for negative stain and exotic data collection.
  • Improved cryosparcm patch pre-apply validation.
  • Reduced SSD-cache coordination bandwidth, improving the robustness of caching on multi-node systems.
  • Smarter cluster job ID parsing following cluster submission. Ability to use shell redirects in cluster submission commands, enabling native support for the LSF cluster management system.
  • Each project, workspace and job now records a ‘last accessed’ timestamp, updating whenever a user views the project, workspace or job through the web application interface. This allows for administrators to quickly identify and remove/archive data that is no longer used.
  • Queuing interactive jobs always default to the master node.
  • Ability to specify a first and last name for new users in the Admin panel and through the command line interface.
  • Default umask is now 002, to allow write permissions by ‘group’ for folders created by cryoSPARC.
  • Renamed internal installation directories from cryosparc2_* to cryosparc_*

Fixed

  • Import Particles job fixes: Importing particle locations using micrographs created in v2.15+ failed because of a variable length UID prepended to the path of each micrograph; Using the “ignore raw data” parameter causes the job to fail with a missing pixel size error; Support for offsets specified in angstroms (_rlnOriginXAngst, _rlnOriginYAngst).
  • Import result group fails if some path fields are blank.
  • Inspect Picks “use_denoise” button failed to actually load denoised micrographs, even if they were connected.
  • Local Refinement now respects the static masking and minimization-over-per-particle-scale parameters, which were previously not used correctly.
  • Setting “Override number of iterations” to True without providing a number of iterations previously prevented Local Refinement from ever terminating.
  • Non-Uniform Refinement: Local processing causes an error if masks are too close to the edge of the refinement box.
  • Local Filtering had SSD:True hard-coded, causing it to fail when running on resources without SSDs.
  • Usernames are now correctly displayed in the details panel for a job.

Learn how to update your CryoSPARC instance here

Topics

blog-cryosparc-v3.0.jpg
News

CryoSPARC v3.0 Now Available

December 9, 20208 min read

CryoSPARC Overview

CryoSPARC (Cryo-EM Single Particle Ab-initio Reconstruction and Classification) is a software package for processing cryo-electron microscopy (cryo-EM) single particle data, used in research and drug discovery.

As a complete solution for cryo-EM processing, CryoSPARC allows:

  • Ultra-fast end-to-end processing of raw cryo-EM data and reconstruction of electron density maps, ready for ingestion into model building software
  • Optimized algorithms and GPU acceleration at all stages, from pre-processing through particle picking, 2D particle classification, 3D ab-initio structure determination, high resolution refinement, and heterogeneity analysis
  • Specialized and unique tools for therapeutically relevant targets, membrane proteins, continuously flexible structures
  • Interactive, visual and iterative experimentation for even the most complex workflows

Interested in getting faster results?
Learn more about CryoSPARC Optimized GPU Workstations

CryoSPARC v3.0 Release

The newest update is packed with performance optimizations and various stability enhancements.
Learn how to update your CryoSPARC instance here

What’s New

  • Improved Non-Uniform Refinement algorithm NEW and job type BETA. Higher resolution results and reduced sensitivity to parameter changes. For more details, see the new paper published in Nature Methods
    Plus:

    • Support for local and global CTF refinement during non-uniform refinement
    • Fast, new GPU implementation of non-uniform regularization developed with support from NVIDIA
    • Additionally, support for automatic adaptive marginalization over alignment variables (enabled by default) yielding further improvements for small molecules.
  • Upgraded to modern Python 3.7 runtime, including new updated dependencies and installation. Easy upgrades and downgrades between cryoSPARC v2 and v3.
  • Support for CUDA 11 + Ampere Architecture GPUs (3080, 3090, A100, etc.).
  • Full support for Thermo Fisher Scientific EER data in cryoSPARC and cryoSPARC Live. EER data is decompressed on the fly and can be upsampled and split into the desired number of fractions during processing.
  • Improved defect file and defect pixel support in motion correction jobs in cryoSPARC and cryoSPARC Live. Defect pixels can be specified in a .txt defect file or as zeros in the gain reference.
  • Helical Reconstruction BETA: New suite of tools for end-to-end helical processing and refinement, including:
    • NEW high-resolution Helical Refinement job that also supports non-uniform regularization, and enforcement and local optimization of helical symmetry
    • NEW Filament Tracer job tailored to the picking of filaments
    • Updates to Inspect Particle Picks to allow pruning of filament picks by curvature
    • Symmetry search utility for exploring the symmetry space in a helical volume
  • Extract From Micrographs will now re-center particles by default if they have already been extracted and aligned through 2D classification, 3D reconstruction, or refinement.
  • Homogeneous Reconstruction Only job type that performs 3D reconstruction from previously aligned particle images.
  • Ability to set priority values for jobs and users in cryoSPARC and cryoSPARC Live, allowing jobs to run in priority order instead of the order they were queued. Learn more about this feature with our Guide to Priority Job Queuing
  • CryoSPARC Live Session Data Management: View, delete and archive data created by cryoSPARC Live on a granular level. Save space taken up by data generated in old sessions and projects, while still being able to browse and view results.
  • A new Data Management tab is available in the Resource Manager in cryoSPARC, displaying details of all projects and workspaces available to the logged in user. At-a-glance information includes: project creation and ownership info, project directory location, last accessed/viewed, project size and other details.
  • Reduced GPU memory footprint in Patch Motion Correction. The overall GPU memory footprint of patch motion correction has been reduced. This enables most K3-sized image data to be processed on 11GB GPUs. Additionally, a “low-memory mode” switch is now available, which reduces it even further (at expense of speed).
  • Remove Duplicate Particles job checks for particles that are extracted too close together on a micrograph and keeps only one, to allow combining picks from multiple pickers without affecting FSC estimates.
  • Patch Motion Correction in cryoSPARC and cryoSPARC Live now optionally support movie data that has been saved with a variable dose rate among frames (e.g., from Leginon) – BETA
  • Systemd Unit File to restart cryoSPARC after server shutdown: A systemd unit file is now included to allow running cryoSPARC as a service.

Updates

  • Improvements to Patch CTF estimation for better CTF fit in cases where background or envelope estimation is difficult. Improved robustness in relative ice thickness measure.
  • Downsample Particles and Extract from Micrographs will now correctly scale particle alignment shifts, fixing issues where downsample was used immediately prior to local refinement or 3D variability.
  • Orientation distribution and posterior precision plots were added to Heterogeneous Refinement, and can be disabled by turning off the “Show viewing orientation distribution plots” parameter.
  • Import Micrographs now has an option to output constant CTF values, so that subsequent steps will ignore the CTF entirely. Useful for negative stain and exotic data collection.
  • Improved cryosparcm patch pre-apply validation.
  • Reduced SSD-cache coordination bandwidth, improving the robustness of caching on multi-node systems.
  • Smarter cluster job ID parsing following cluster submission. Ability to use shell redirects in cluster submission commands, enabling native support for the LSF cluster management system.
  • Each project, workspace and job now records a ‘last accessed’ timestamp, updating whenever a user views the project, workspace or job through the web application interface. This allows for administrators to quickly identify and remove/archive data that is no longer used.
  • Queuing interactive jobs always default to the master node.
  • Ability to specify a first and last name for new users in the Admin panel and through the command line interface.
  • Default umask is now 002, to allow write permissions by ‘group’ for folders created by cryoSPARC.
  • Renamed internal installation directories from cryosparc2_* to cryosparc_*

Fixed

  • Import Particles job fixes: Importing particle locations using micrographs created in v2.15+ failed because of a variable length UID prepended to the path of each micrograph; Using the “ignore raw data” parameter causes the job to fail with a missing pixel size error; Support for offsets specified in angstroms (_rlnOriginXAngst, _rlnOriginYAngst).
  • Import result group fails if some path fields are blank.
  • Inspect Picks “use_denoise” button failed to actually load denoised micrographs, even if they were connected.
  • Local Refinement now respects the static masking and minimization-over-per-particle-scale parameters, which were previously not used correctly.
  • Setting “Override number of iterations” to True without providing a number of iterations previously prevented Local Refinement from ever terminating.
  • Non-Uniform Refinement: Local processing causes an error if masks are too close to the edge of the refinement box.
  • Local Filtering had SSD:True hard-coded, causing it to fail when running on resources without SSDs.
  • Usernames are now correctly displayed in the details panel for a job.

Learn how to update your CryoSPARC instance here

Topics