Descattering and image restoration with a transformer-based neural network in deep tissue imaging
Abstract
Imaging biological structures deep inside tissues is crucial but challenging due to common light scattering. This study proposes a multiattention network that directly maps degraded scattering two-photon excitation fluorescence (TPEF) images to high-quality scattering-free images, thereby computationally extending the imaging depth for TPEF without requiring complex optical additions. The model relies solely on simulated data rather than well-registered real data pairs, and is trained to descatter and restore hidden spatial information at greater depths. Quantitative evaluations on simulated fluorescent beads and vasculature show significant performance improvements in peak signal-to-noise ratio (23 to 29 dB) and structural similarity index (23×) compared to the raw data. We also apply the framework to various ex vivo and in vivo experiments, achieving clear visualization of lipid droplets up to a depth of 1,300 μm and of vascular structure and astrocytes up to 950 μm and 500 μm, respectively, in live mouse brains at lower excitation powers.
Article Details
Journal Info
Proceedings of the National Academy of Sciences
National Academy of Sciences
Authors (13)
Xiangcong Xu
State Key Laboratory of Radio Frequency Heterogeneous Integration, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University
Renlong Zhang
State Key Laboratory of Radio Frequency Heterogeneous Integration, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University
Chenggui Luo
State Key Laboratory of Radio Frequency Heterogeneous Integration, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University
Chi Zhang
Yanping Li
Danying Lin
State Key Laboratory of Radio Frequency Heterogeneous Integration, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University
Bin Yu
Liwei Liu
State Key Laboratory of Radio Frequency Heterogeneous Integration, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University
Xiaoyu Weng
State Key Laboratory of Radio Frequency Heterogeneous Integration, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University
Yiping Wang
Lingjie Kong
State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University
Jia Li
Junle Qu
State Key Laboratory of Radio Frequency Heterogeneous Integration, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University