All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
Fundamentals of image reconstruction from projection images
1. 8/13/18, Ludtke, VARI
Steve Ludtke
Charles C. Bell Professor
Biochemistry and Molecular Biology
Director, CryoEM/CryoET Core
Co-director CIBR Center
Baylor College of Medicine
Introduction to Single Particle Reconstruction
(and a quick intro to EMAN2 for the afternoon)
2. Biological TEM Methods
• Single Particle Analysis (SPA or SPR)
• Cellular Tomography (CryoET)
• Subtomogram Averaging
• Helical Processing
• 2-D Crystallography
• 3-D Microcrystals (MicroED)
4. 8/13/18, Ludtke, VARI
Bai, X. C., Fernandez, I. S., McMullan, G. & Scheres, S. H. Ribosome structures to near-atomic resolution from thirty thousand cryo-EM
particles. Elife 2, e00461 (2013). PMC3576727.
10. ✴ 30,000 particles
✴ 3000 projections (~2.6 degree sampling)
✴ 180 rotations
✴ 10 x 10 translations (if centering is decent)
✴ 65,536 pixels (256x256 image)
✴ 20 FLOPS/pixel
= 2.1 x 1018 FLOPS (2 exaFLOPS)
• @ 100 gigaFLOPS/s = 6,000 hours (~ 240 days on one typical workstation)
• Clearly we need to be smarter...
• (Actual EMAN2 time <3 hours on ... even more cleverness possible though)
Determine Particle Orientations
(Ribosome at ~4 Å)
11. ✴ 30,000 particles
✴ 3000 projections (~2.6 degree sampling)
✴ 180 rotations
✴ 10 x 10 translations (if centering is decent)
✴ 65,536 pixels (256x256 image)
✴ 20 FLOPS/pixel
= 2.1 x 1018 FLOPS (2 exaFLOPS)
• @ 100 gigaFLOPS/s = 6,000 hours (~ 240 days on one typical workstation)
• Clearly we need to be smarter...
• (Actual EMAN2 time <3 hours ... even more cleverness possible though)
Determine Particle Orientations
12. 8/13/18, Ludtke, VARI
Extract Particles
Determine
Orientations
3-D
Reconstruction
Interpret Map
Single Particle Analysis
21. One problem...
• To determine the particle orientations, we needed a 3-D reference
• catch 22
• All current CryoEM Single Particle solutions are iterative!
22. 8/13/18, Ludtke, VARI
Spider
(typical method, late 70s, Pub 1981)
Extract Particles
Determine
Orientations
3-D
Reconstruction
Interpret Map
Initial Model
Particles
Projections
Determine
Orientations
3-D
Reconstruction
Final
Reconstruction
23. 8/13/18, Ludtke, VARI
Extract Particles
Determine
Orientations
3-D
Reconstruction
Interpret Map
Initial Model
Particles
Projections
Alignment
3-D
Reconstruction
Final
Reconstruction
Class
Averages
PCA
Common
Lines
IMAGIC
(typical method, 1981)
24. 8/13/18, Ludtke, VARI
EMAN
(1998)
Extract Particles
Determine
Orientations
3-D
Reconstruction
Interpret Map
Initial Model
Particles
Projections
Classify
Particles
3-D
Reconstruction
Final
Reconstruction
Class
Averages
25. 8/13/18, Ludtke, VARI
Extract Particles
Determine
Orientations
3-D
Reconstruction
Interpret Map
Initial Model
Particles
3-D
Reference
Determine
Probabilities
Max. Lik.
Reconstruction
Final
Reconstruction
Relion
(2012, adapted from XMIPP)
43. 9/8/18, Ludtke, IMC19
"Gold Standard" Refinement
Particles
Odd
Even
Initial Map
1
Refine
Refine
Initial Map
2
FSC Resolution
Final
Map
Filter
Reduces impact of noise bias on
resolution, but does not cure it!
44. 8/13/18, Ludtke, VARI
EMAN2.1
320 CPU-hr
Relion 1.3
2200 CPU-hr
S. Cereviseae 80S Ribosome (EMD-2275)
Data taken from PDBe 3DEM test data
no movie alignment performed
Dataset 10002 (Bai XC, Fernandez IS,
McMullen G, Scheres SH)
Ludtke, 1/28/16
45. 8/13/18, Ludtke, VARI
EMAN2 Relion
TRPV1
Liao, M., Cao, E., Julius, D., and Cheng, Y. (2013). Structure of the TRPV1 ion channel determined by electron
cryo-microscopy. Nature. 504:107-112.
3.7 Å
48. EMAN2.2
http://eman2.org
EMAN2 and SPHIRE/SPARX share a common core and
are distributed together if you have one installed, you also have the other!
However, they are completely independent beyond that.
(this should also soon include Niels Volkmann's PyCoan)
49. History
• 1999 - EMAN1 released
• First to do Fourier-based reconstruction, full CTF correction, GUI
• 2003 - Started development of EMAN2
• Python Focus, redesign from scratch
• SPARX = EMAN2/PHENIX crossover, Pawel Penczek
• 2008 - Grant supporting SPARX ends -> Pawel changes its focus
• 2005 - 2009 Various pre-releases of EMAN2/SPARX
• 2010 - EMAN2.0/SPARX
• 2014 - EMAN2.1
• 2016 - SPHIRE - first beta
• 2017 - EMAN2.2
Relion first release
Frealign first release
Simple first release
CryoSPARC first release
CISTEM first release
~1980 SPIDER & IMAGIC
50. 8/13/18, Ludtke, VARI
What can it do?
• Movie alignment (continued work in progress)
• Micrograph screening
• CTF (micrograph, particle, tilt series)
• Single Particle Analysis
• 2-D Variability
• 3-D Variability
• Tomography alignment and reconstruction
• Subtomogram averaging
• Tomogram Segmentation
• Utility Functions (file conversion, image processing,…)
51. 8/13/18, Ludtke, VARI
EMAN2 Features
• Complete graphical workflow, all steps of single particle refinement
• Project system which organizes data and records all reconstruction info.
• Qt/OpenGL for 2d & 3d display.
• Support for all documented cryoEM file formats
• Over 200 general purpose image processing algorithms
• Interoperability features with Frealign, Relion, ResMap, IMOD…
• Tilt Validation, Random Conical Tilt, Single Particle Tomography
• Parallel processing using MPI and/or Threads
52. 8/13/18, Ludtke, VARI
EMAN2 Architecture
C++ Core
Python Core
Command-Line Programs
High-Level Programs
Project Manager
Interface
Easy
Flexible
53. 8/13/18, Ludtke, VARI
Extensible Core
Type Description #
Processor Generic image processing algorithms,
filters, masks, thresholds, etc. 220
Aligner
Algorithms used to align 2 images or
volumes to each other 32
Projector
Routines to generate 2-D projections of
3-D objects 7
Reconstructor
Routines to reconstruct 3-D objects from
2-D projections 13
Cmp
Similarity metrics used to compare two
images or volumes 15
Averager
Average together stacks of images in
various ways 12
Analyzer
Perform various operations on sets of
images, such as classification or PCA 9
Orientgen
Routines describing how projections cover
the asymmetric triangle 7
54. 8/13/18, Ludtke, VARI
MRC R/W IMAGIC R/W
SPIDER R/W HDF5 R/W
PIF R/W ICOS R/W
VTK R/W PGM R/W
Amira R/W Xplor W
Gatan DM2 R Gatan DM3 R
Gatan DM4 R FEI SER R
TIFF R/W Scans-a-lot R
LST R/W PNG R/W
Video-4-Linux R JPEG W
File Formats