Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy

M Min Guo Y Yicong Wu (Laboratory of High Resolution Optical Imaging) C Chad M. Hobson Y Yijun Su S Shuhao Qian E Eric Krueger R Ryan Christensen G Grant Kroeschell J Johnny Bui M Matthew Chaw L Lixia Zhang J Jiamin Liu X Xuekai Hou X Xiaofei Han Z Zhiye Lu X Xuefei Ma A Alexander Zhovmer C Christian Combs M Mark Moyle E Eviatar Yemini H Huafeng Liu (State Key Laboratory of Extreme Photonics and Instrumentation) Z Zhiyi Liu A Alexandre Benedetto P Patrick La Riviere D Daniel Colón-Ramos H Hari Shroff

Abstract

AbstractOptical aberrations hinder fluorescence microscopy of thick samples, reducing image signal, contrast, and resolution. Here we introduce a deep learning-based strategy for aberration compensation, improving image quality without slowing image acquisition, applying additional dose, or introducing more optics. Our method (i) introduces synthetic aberrations to images acquired on the shallow side of image stacks, making them resemble those acquired deeper into the volume and (ii) trains neural networks to reverse the effect of these aberrations. We use simulations and experiments to show that applying the trained ‘de-aberration’ networks outperforms alternative methods, providing restoration on par with adaptive optics techniques; and subsequently apply the networks to diverse datasets captured with confocal, light-sheet, multi-photon, and super-resolution microscopy. In all cases, the improved quality of the restored data facilitates qualitative image inspection and improves downstream image quantitation, including orientational analysis of blood vessels in mouse tissue and improved membrane and nuclear segmentation in C. elegans embryos.

Article Details

Volume / Issue Vol. 16, Issue 1
Published January 02, 2025
ISSN 2041-1723
Publisher Nature Portfolio

Journal Info

Nature Communications

Nature Portfolio

ISSN: 2041-1723 Open Access Life Sciences

Authors (26)

M

Min Guo

Y

Yicong Wu

Laboratory of High Resolution Optical Imaging

C

Chad M. Hobson

Y

Yijun Su

S

Shuhao Qian

E

Eric Krueger

R

Ryan Christensen

G

Grant Kroeschell

J

Johnny Bui

M

Matthew Chaw

L

Lixia Zhang

J

Jiamin Liu

X

Xuekai Hou

X

Xiaofei Han

Z

Zhiye Lu

X

Xuefei Ma

A

Alexander Zhovmer

C

Christian Combs

M

Mark Moyle

E

Eviatar Yemini

H

Huafeng Liu

State Key Laboratory of Extreme Photonics and Instrumentation

Z

Zhiyi Liu

A

Alexandre Benedetto

P

Patrick La Riviere

D

Daniel Colón-Ramos

H

Hari Shroff