eess.IV - 2023-09-28

Neuromorphic Imaging with Joint Image Deblurring and Event Denoising

  • paper_url: http://arxiv.org/abs/2309.16106
  • repo_url: None
  • paper_authors: Pei Zhang, Haosen Liu, Zhou Ge, Chutian Wang, Edmund Y. Lam
  • for: 增强 neuromorphic 感知器的感知质量和精度,以便更好地进行神经元推理和分析。
  • methods: 提出了一种简单 yet effective的联合算法,可以同时重建锐利图像和噪声Robust事件,并利用事件 regularized prior 提供 auxiliary motion features для隐藏的噪声除去,以及图像梯度作为参照进行神经omorphic 噪声除去。
  • results: 在实际和synthetic 样本上进行了广泛的评估,并显示了我们的方法在 restore 质量和鲁棒性方面具有竞争力,并且在一些具有挑战性的实际场景下具有更高的robustness。
    Abstract Neuromorphic imaging reacts to per-pixel brightness changes of a dynamic scene with high temporal precision and responds with asynchronous streaming events as a result. It also often supports a simultaneous output of an intensity image. Nevertheless, the raw events typically involve a great amount of noise due to the high sensitivity of the sensor, while capturing fast-moving objects at low frame rates results in blurry images. These deficiencies significantly degrade human observation and machine processing. Fortunately, the two information sources are inherently complementary -- events with microsecond temporal resolution, which are triggered by the edges of objects that are recorded in latent sharp images, can supply rich motion details missing from the blurry images. In this work, we bring the two types of data together and propose a simple yet effective unifying algorithm to jointly reconstruct blur-free images and noise-robust events, where an event-regularized prior offers auxiliary motion features for blind deblurring, and image gradients serve as a reference to regulate neuromorphic noise removal. Extensive evaluations on real and synthetic samples present our superiority over other competing methods in restoration quality and greater robustness to some challenging realistic scenarios. Our solution gives impetus to the improvement of both sensing data and paves the way for highly accurate neuromorphic reasoning and analysis.
    摘要 (Note: The text has been translated into Simplified Chinese, which is the standard form of Chinese used in mainland China and Singapore. The translation is written in the formal style, which is appropriate for academic or professional writing.)