Skip to main content
Kent Academic Repository

LSHR-Net: a hardware-friendly solution for high-resolution computational imaging using a mixed-weights neural network

Bai, Fangliang, Liu, Jinchao, Liu, Xiaojuan, Osadchy, Margarita, Wang, Chao, Gibson, Stuart J. (2020) LSHR-Net: a hardware-friendly solution for high-resolution computational imaging using a mixed-weights neural network. Neurocomputing, . ISSN 0925-2312. (doi:10.1016/j.neucom.2020.04.010) (KAR id:81026)


Recent work showed neural-network based approaches to reconstructing images from compressively sensed measurements offer significant improvements in accuracy and signal compression. Such methods can dramatically boost the capability of computational imaging hardware. However, to date, there have been two major drawbacks: (1) the high-precision real-valued sensing patterns proposed in the majority of existing works can prove problematic when used with computational imaging hardware such as a digital micromirror sampling device and (2) the network structures for image reconstruction involve intensive computation, which is also not suitable for hardware deployment. To address these problems, we propose a novel hardware-friendly solution based on mixed-weights neural networks for computational imaging. In particular, learned binary-weight sensing patterns are tailored to the sampling device. Moreover, we proposed a recursive network structure for low-resolution image sampling and high-resolution reconstruction scheme. It reduces both the required number of measurements and reconstruction computation by operating convolution on small intermediate feature maps. The recursive structure further reduced the model size, making the network more computationally efficient when deployed with the hardware. Our method has been validated on benchmark datasets and achieved state of the art reconstruction accuracy. We tested our proposed network in conjunction with a proof-of-concept hardware setup.

Item Type: Article
DOI/Identification number: 10.1016/j.neucom.2020.04.010
Uncontrolled keywords: Single pixel camera, Computational imaging, Neural network, Image reconstruction, Super resolution, Binary weights
Subjects: Q Science
Divisions: Divisions > Division of Natural Sciences > Physics and Astronomy
Depositing User: Stuart Gibson
Date Deposited: 28 Apr 2020 09:41 UTC
Last Modified: 09 Dec 2022 03:28 UTC
Resource URI: (The current URI for this page, for reference purposes)

University of Kent Author Information

Bai, Fangliang.

Creator's ORCID:
CReDIT Contributor Roles:

Gibson, Stuart J..

Creator's ORCID:
CReDIT Contributor Roles:
  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.