PSSR

PSSR enhances resolution and signal-to-noise ratio of point-scanning imaging data from scanning electron microscopes and laser scanning confocal microscopes using deep learning-based supersampling.


Key Features:

  • Deep Learning-Based Supersampling: Employs a deep learning framework to perform supersampling of undersampled point-scanning images to improve spatial resolution.
  • Simulated Training Data ('crappifier'): Uses a 'crappifier' algorithm to degrade high-SNR, high-pixel-resolution ground-truth images into simulated low-SNR, low-resolution counterparts for model training.
  • Multi-Frame Approach: Integrates information from adjacent frames for fluorescence time-lapse or other sequential data to improve spatiotemporal reconstruction accuracy.

Scientific Applications:

  • Cellular and Tissue Imaging: Enhances detail in cellular and tissue images acquired by point-scanning modalities for downstream analysis.
  • Time-Lapse Fluorescence Imaging: Improves spatiotemporal resolution in fluorescence time-lapse datasets by leveraging adjacent-frame information.
  • Improved SNR and Reduced Acquisition Burden: Enables restoration of low-SNR, undersampled data, supporting faster acquisition and potential sample preservation.

Methodology:

Computational methods explicitly include deep learning-based supersampling trained on pairs of high-quality ground-truth and simulated low-quality images produced by a 'crappifier' degradation algorithm, with an optional multi-frame model that incorporates adjacent frames for prediction.

Topics

Details

License:
BSD-3-Clause
Cost:
Free of charge (with restrictions)
Programming Languages:
Python
Added:
11/1/2021
Last Updated:
11/1/2021

Operations

Publications

Fang L, Monroe F, Novak SW, Kirk L, Schiavon CR, Yu SB, Zhang T, Wu M, Kastner K, Latif AA, Lin Z, Shaw A, Kubota Y, Mendenhall J, Zhang Z, Pekkurnaz G, Harris K, Howard J, Manor U. Deep learning-based point-scanning super-resolution imaging. Nature Methods. 2021;18(4):406-416. doi:10.1038/s41592-021-01080-z. PMID:33686300. PMCID:PMC8035334.

PMID: 33686300
PMCID: PMC8035334
Funding: - U.S. Department of Health & Human Services | NIH | National Institute on Deafness and Other Communication Disorders: DC018237 - U.S. Department of Health & Human Services | NIH | National Cancer Institute: CA014195 - National Science Foundation: 1707356, 2014862 - U.S. Department of Health & Human Services | NIH | National Institute of General Medical Sciences: GM137580, R35GM128823 - U.S. Department of Health & Human Services | National Institutes of Health: T32GM007240 - MEXT | Japan Society for the Promotion of Science: 19H03336 - Japan Agency for Medical Research and Development: JP20dm0207084 - Parkinson’s Foundation: PF-JFA-1888 - U.S. Department of Health & Human Services | NIH | National Institute of Mental Health: 2R56MH095980-06

Links