Reconfigurable Snapshot HDR Imaging Using Coded Masks and Inception Network

Alghamdi, Masheal; Fu, Qiang; Thabet, Ali; Heidrich, Wolfgang

Reconfigurable Snapshot HDR Imaging Using Coded Masks and Inception Network

Files

037-045.pdf (28.87 MB)

paper1033_supplementary_crc.pdf (2.93 MB)

Date

2019

Authors

Alghamdi, Masheal
Fu, Qiang
Thabet, Ali
Heidrich, Wolfgang

Publisher

The Eurographics Association

Abstract

High Dynamic Range (HDR) image acquisition from a single image capture, also known as snapshot HDR imaging, is challenging because the bit depths of camera sensors are far from sufficient to cover the full dynamic range of the scene. Existing HDR techniques focus either on algorithmic reconstruction or hardware modification to extend the dynamic range. In this paper we propose a joint design for snapshot HDR imaging by devising a spatially-varying modulation mask in the hardware as well as building an inception network to reconstruct the HDR image. We achieve a reconfigurable HDR camera design that does not require custom sensors, and instead can be reconfigured between HDR and conventional mode with very simple calibration steps. We demonstrate that the proposed hardware-software solution offers a flexible yet robust way to modulating per-pixel exposures, and the network requires little knowledge of the hardware to faithfully reconstruct the HDR image. Comparison results show that our method outperforms state of the art in terms of visual perception quality.

        @inproceedings{10.2312:vmv.20191316
,
booktitle = {Vision, Modeling and Visualization
},
editor = {Schulz, Hans-Jörg and Teschner, Matthias and Wimmer, Michael
},
title = {{Reconfigurable Snapshot HDR Imaging Using Coded Masks and Inception Network
}},
author = {Alghamdi, Masheal and 
Fu, Qiang and 
Thabet, Ali and 
Heidrich, Wolfgang 
},
year = {2019
},
publisher = {The Eurographics Association
},
ISBN = {978-3-03868-098-7
},
DOI = {10.2312/vmv.20191316
}
}