Abstract

Today’s smartphones/phablets/tablets are equipped with cameras that have enabled people to capture their favorite moments. However, images or videos taken at public places using inexpensive low-resolution cameras are often degraded by the presence of occlusions such as fences/barricades. In order to reconstruct a fence-free high-resolution image, we use a video of a scene captured by panning a hand-held camera and model the effects of various degradations. Initially, we obtain the spatial locations of fences by semantic segmentation and subsequently estimate the subpixel motion between the degraded low-resolution frames. The unknown high-resolution de-fenced image is modeled as a nonlocal discontinuity-adaptive Markov random field (NL-DAMRF) and its maximum a posteriori estimate is obtained by minimizing an appropriate objective function. We propose a nonlocal extension of DAMRF prior to preserve high-frequency information in the reconstruction process. Specifically, we use the graduated nonconvexity algorithm to minimize the proposed nonconvex energy function. Experiments with both synthetic and real-world data demonstrate the efficacy of the proposed algorithm.

© 2018 Optical Society of America

Full Article  |  PDF Article
OSA Recommended Articles
Detection and removal of fence occlusions in an image using a video of the static/dynamic scene

Sankaraganesh Jonna, Krishna K. Nakka, Vrushali S. Khasare, Rajiv R. Sahay, and Mohan S. Kankanhalli
J. Opt. Soc. Am. A 33(10) 1917-1930 (2016)

Unified multiframe super-resolution of matte, foreground, and background

Sahana M. Prabhu and A. N. Rajagopalan
J. Opt. Soc. Am. A 30(8) 1524-1534 (2013)

Fast super-resolution using an adaptive Wiener filter with robustness to local motion

Russell C. Hardie and Kenneth J. Barnard
Opt. Express 20(19) 21053-21073 (2012)

References

You do not have subscription access to this journal. Citation lists with outbound citation links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Figures (14)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Tables (4)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Equations (22)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription

Metrics

You do not have subscription access to this journal. Article level metrics are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access OSA Member Subscription