AtomicSPI

Learning atomic scale biomolecular dynamics from single-particle imaging data.

Frédéric Poitevin , Ellen Zhong , Gordon Wetzstein , Nina Miolane , Jay Shenoy , Axel Levy , David Klindt , Ariana Peck

AtomicSPI

Project Goal

The goal of the AtomicSPI project is to deliver software helping structural biologists resolve molecular conformations from single particle imaging datasets. The project work itself consists of four connected deliverables:

  1. An atomic representation of the particle: A graph-based atomic model will enable the application of physics-based priors during refinement, and will be fit directly to data, rather than fitting to an intermediate reconstructed 3D map (current practice).
  2. A deep learning model that maps individual particles to a continuous space of conformations and orientations: The deep learning model will capture the molecular dynamics crucial to understanding biological function in a feasible low-dimensional space. The model will provide a distribution of conformations (i.e. the energy landscape) with applications for establishing steady-state kinetic models.
  3. A differentiable digital twin of the electron microscope: The simulation will map the predicted structures and orientations to the images that would be produced by the electron microscope or X-ray FEL source. Crucially, by making the simulation differentiable, it can be inverted to infer structures directly from data, proposing new structures/orientations that correspond to an experimental image.
  4. A deep learning reconstruction pipeline: The pipeline will tie together the above three components to learn atomic models directly from measured datasets. By combining the three components into a single step, the proposed method will be both more efficient and more accurate than existing analysis pipelines.

Accomplishments

We have accomplished all four deliverables above in the cryoEM setting and prototyped them in the X-ray SPI setting. As summarized in Figure 1, the work carried thanks to this LDRD belongs to a new wave of next-generation volume reconstruction algorithm development that combines generative modeling with end-to-end unsupervised deep learning techniques.

AtomicSPI
Comparison of generative reconstruction methods. We give a quick overview of our contributions to these methods in what follows. CryoPoseNet and CryoAI are two methods for homogeneous reconstruction, meaning they reconstruct a unique volume from the dataset. CryoFIRE and aNiMAte are not shown in the figure yet and are two methods for heterogeneous reconstruction, meaning they reconstruct one volume per particle in the dataset. CryoFIRE is a hybrid of CryoAI and CryoDRGN2, encodes both R, t and the conformation z of the particle in each image xi and learns an implicit neural network representation of the 3D volume of the molecule. aNiMAte belongs to the same category as CryoFold from MIT and AtomVAE from Deepmind, encodes t and z of the particle in each image xi which help interpret the variability in the dataset as meaningful deformation of a reference atomistic representation of the 3D volume of the molecule. X-RAI is similar to cryo-AI in the X-ray setting (i.e. with a different rendering pipeline).

We illustrate in Figure 2 our main achievements.

AtomicSPI
Development of Heterogeneous Reconstruction Methods across a wide array of Imaging Modalities. This figure highlights the most recent results from our work. (left) We demonstrate the ability to fit large atomic models to each of the images in experimental cryoEM datasets, through deformation along their normal modes. (top-right) In collaboration with Ellen Zhong, we show that implicit representations like the ones used in cryoAI or cryoFIRE can be used to reconstruct structural heterogeneity from in situ cryogenic electron tomography experiments. (bottom-right) The approach pioneered in cryoAI was adapted to the X-ray SPI modality through a simple change of the image formation model, highlighting the versatility of our approach and showcasing its modular architecture.

AtomicSPI Projects

For a deeper dive into the AtomicSPI projects, check out their individual pages:

Other directions explored in the project include studies on latent disentanglement of the conformational space and a general approach to solve inverse problems in protein space using diffusion-based priors.

Acknowledgements

This project sprung from discussions with Nina Miolane, following our initial work on cryo-EM image models. This project was supported by the LDRD program at SLAC from 2021 to 2024.

References

SPI Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

Shenoy, Jay and Levy, Axel and Ayyer, Kartik and Poitevin, Frederic and Wetzstein, Gordon

Nature Communications (2025)

Interpretability Towards interpretable Cryo-EM: disentangling latent spaces of molecular conformations

Towards interpretable Cryo-EM: disentangling latent spaces of molecular conformations

Klindt, David A and Hyvarinen, Aapo and Levy, Axel and Miolane, Nina and Poitevin, Frederic

Frontiers in Molecular Biosciences (2024)

CryoEM Revealing biomolecular structure and motion with neural ab initio cryo-EM reconstruction

Revealing biomolecular structure and motion with neural ab initio cryo-EM reconstruction

Levy, Axel and Grzadkowski, Michal and Poitevin, Frederic and Vallese, Francesca and Clarke, Oliver B and Wetzstein, Gordon and Zhong, Ellen D

bioRxiv (2024)

Protein Folding Solving Inverse Problems in Protein Space Using Diffusion-Based Priors

Solving Inverse Problems in Protein Space Using Diffusion-Based Priors

Levy, Axel and Chan, Eric R and Fridovich-Keil, Sara and Poitevin, Frederic and Zhong, Ellen D and Wetzstein, Gordon

arXiv preprint arXiv:2406.04239 (2024)

CryoEM CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Images

CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Images

Koo, Bongjin and Martel, Julien and Peck, Ariana and Levy, Axel and Poitevin, Frederic and Miolane, Nina

arXiv e-prints (2023)

Diffuse Scattering Modeling diffuse scattering with simple, physically interpretable models

Modeling diffuse scattering with simple, physically interpretable models

Peck, Ariana and Lane, Thomas J and Poitevin, Frederic

Methods in enzymology (2023)

SPI Amortized pose estimation for x-ray single particle imaging

Amortized pose estimation for x-ray single particle imaging

Shenoy, Jay and Levy, Axel and Poitevin, Frederic and Wetzstein, Gordon

Machine learning for structural biology Workshop (2023)

CryoEM Deep generative modeling for volume reconstruction in cryo-electron microscopy

Deep generative modeling for volume reconstruction in cryo-electron microscopy

Donnat, Claire and Levy, Axel and Poitevin, Frederic and Zhong, Ellen D and Miolane, Nina

Journal of structural biology (2022)

CryoEM Amortized inference for heterogeneous reconstruction in cryo-em

Amortized inference for heterogeneous reconstruction in cryo-em

Levy, Axel and Wetzstein, Gordon and Martel, Julien NP and Poitevin, Frederic and Zhong, Ellen

Advances in neural information processing systems (2022)

CryoEM CryoAI: Amortized inference of poses for ab initio reconstruction of 3d molecular volumes from real cryo-em images

CryoAI: Amortized inference of poses for ab initio reconstruction of 3d molecular volumes from real cryo-em images

Levy, Axel and Poitevin, Frederic and Martel, Julien and Nashed, Youssef and Peck, Ariana and Miolane, Nina and Ratner, Daniel and Dunne, Mike and Wetzstein, Gordon

European Conference on Computer Vision (2022)

CryoEM Heterogeneous reconstruction of deformable atomic models in Cryo-EM

Heterogeneous reconstruction of deformable atomic models in Cryo-EM

Nashed, Youssef and Peck, Ariana and Martel, Julien and Levy, Axel and Koo, Bongjin and Wetzstein, Gordon and Miolane, Nina and Ratner, Daniel and Poitevin, Frederic

Machine learning for structural biology Workshop (2022)

CryoEM CryoPoseNet: End-to-end simultaneous learning of single-particle orientation and 3D map reconstruction from cryo-electron microscopy data

CryoPoseNet: End-to-end simultaneous learning of single-particle orientation and 3D map reconstruction from cryo-electron microscopy data

Nashed, Youssef SG and Poitevin, Frederic and Gupta, Harshit and Woollard, Geoffrey and Kagan, Michael and Yoon, Chun Hong and Ratner, Daniel

Proceedings of the IEEE/CVF International Conference on Computer Vision (2021)

CryoEM Estimation of orientation and camera parameters from cryo-electron microscopy images with variational autoencoders and generative adversarial networks

Estimation of orientation and camera parameters from cryo-electron microscopy images with variational autoencoders and generative adversarial networks

Miolane, Nina and Poitevin, Frederic and Li, Yee-Ting and Holmes, Susan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (2020)