Physics Informed Image Restoration
Most deep learning image restoration approaches rely on blind deconvolution without access to the forward model. In medical imaging, such as CT, these characteristics can often be measured or predicted, offering valuable information that has the potential to enhance performance. One strategy combines deep learning with known image quality models through model-based deconvolution with a deep learning prior. However, the direct one-step method, which uses blur and noise kernels as inputs to an end-to-end NN, remains challenging. In this work, we introduce a multi-input CNN variant that leverages image quality characteristics, such as blur and noise kernels, as auxiliary inputs to improve restoration performance. While one might assume that a general network structure with conditional inputs could address this issue, we found that it was not the case...
Background
Image restoration is a crucial task in medical imaging to recover lost details in images affected by noise and blur.
Methods
Our approach uses a deep CNN that incorporates physics-based priors to improve restoration fidelity.
Results
The model significantly outperforms traditional methods in PSNR and SSIM scores.
Conclusion
Physics-informed deep learning can enhance medical image restoration accuracy.