Abstract

We present a low power all-CMOS implementation of temporal compressive sensing with pixel-wise coded exposure. This image sensor can increase video pixel resolution and frame rate simultaneously while reducing data readout speed. Compared to previous architectures, this system modulates pixel exposure at the individual photo-diode electronically without external optical components. Thus, the system provides reduction in size and power compare to previous optics based implementations. The prototype image sensor (127 × 90 pixels) can reconstruct 100 fps videos from coded images sampled at 5 fps. With 20× reduction in readout speed, our CMOS image sensor only consumes 14μW to provide 100 fps videos.

© 2016 Optical Society of America

Full Article  |  PDF Article
OSA Recommended Articles
High spatio-temporal resolution video with compressed sensing

Roman Koller, Lukas Schmid, Nathan Matsuda, Thomas Niederberger, Leonidas Spinoulas, Oliver Cossairt, Guido Schuster, and Aggelos K. Katsaggelos
Opt. Express 23(12) 15992-16007 (2015)

Compressive video sensing with side information

Xin Yuan, Yangyang Sun, and Shuo Pang
Appl. Opt. 56(10) 2697-2704 (2017)

Compressive holographic video

Zihao Wang, Leonidas Spinoulas, Kuan He, Lei Tian, Oliver Cossairt, Aggelos K. Katsaggelos, and Huaijin Chen
Opt. Express 25(1) 250-262 (2017)

References

  • View by:
  • |
  • |
  • |

  1. G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
    [Crossref] [PubMed]
  2. R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: motion deblurring using fluttered,” ACM Trans. Graphics 25(3), 795–804 (2006).
    [Crossref]
  3. D.L. Donoho, “Compressed sensing,” IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006).
    [Crossref]
  4. Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Video from a single coded exposure photograph using a learned over-complete dictionary,” in IEEE ICCV (IEEE, 2011), pp. 287–294.
  5. F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.
  6. T. H. Tsai, P. Llull, X. Yuan, L. Carin, and D. J. Brady, “Spectral-temporal compressive imaging,” Opt. Lett. 40(17), 4054–4057 (2015).
    [Crossref] [PubMed]
  7. P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).
  8. R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).
  9. D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
    [Crossref]
  10. Y. Oike and A. E. Gamal, “CMOS image sensor with per-column ΣΔ ADC and programmable compressed sensing,” IEEE J. Solid-State Circuits 48(1), 318–328 (2013).
    [Crossref]
  11. T. H. Tsai, X. Yuan, and D. J. Brady, “Spatial light modulator based color polarization imaging,” Opt. Express 23(9), 11912–11926 (2015)
    [Crossref] [PubMed]
  12. X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
    [Crossref]
  13. X. Lin, G. Wetzstein, Y. Liu, and Q. Dai, “Dual-coded compressive hyperspectral imaging,” Opt. Lett. 39(7), 2044–2047 (2014).
    [Crossref] [PubMed]
  14. H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
    [PubMed]

2015 (6)

T. H. Tsai, P. Llull, X. Yuan, L. Carin, and D. J. Brady, “Spectral-temporal compressive imaging,” Opt. Lett. 40(17), 4054–4057 (2015).
[Crossref] [PubMed]

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

T. H. Tsai, X. Yuan, and D. J. Brady, “Spatial light modulator based color polarization imaging,” Opt. Express 23(9), 11912–11926 (2015)
[Crossref] [PubMed]

X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
[Crossref]

H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
[PubMed]

2014 (2)

X. Lin, G. Wetzstein, Y. Liu, and Q. Dai, “Dual-coded compressive hyperspectral imaging,” Opt. Lett. 39(7), 2044–2047 (2014).
[Crossref] [PubMed]

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

2013 (1)

Y. Oike and A. E. Gamal, “CMOS image sensor with per-column ΣΔ ADC and programmable compressed sensing,” IEEE J. Solid-State Circuits 48(1), 318–328 (2013).
[Crossref]

2010 (1)

G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
[Crossref] [PubMed]

2006 (2)

R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: motion deblurring using fluttered,” ACM Trans. Graphics 25(3), 795–804 (2006).
[Crossref]

D.L. Donoho, “Compressed sensing,” IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006).
[Crossref]

Agrawal, A.

R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: motion deblurring using fluttered,” ACM Trans. Graphics 25(3), 795–804 (2006).
[Crossref]

Brady, D.

X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
[Crossref]

Brady, D. J.

Bub, G.

G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
[Crossref] [PubMed]

Carin, L.

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

T. H. Tsai, P. Llull, X. Yuan, L. Carin, and D. J. Brady, “Spectral-temporal compressive imaging,” Opt. Lett. 40(17), 4054–4057 (2015).
[Crossref] [PubMed]

X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
[Crossref]

Cossairt, O.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Dai, Q.

Donoho, D.L.

D.L. Donoho, “Compressed sensing,” IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006).
[Crossref]

Gamal, A. E.

Y. Oike and A. E. Gamal, “CMOS image sensor with per-column ΣΔ ADC and programmable compressed sensing,” IEEE J. Solid-State Circuits 48(1), 318–328 (2013).
[Crossref]

Gu, J.

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Video from a single coded exposure photograph using a learned over-complete dictionary,” in IEEE ICCV (IEEE, 2011), pp. 287–294.

Gupta, M.

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Video from a single coded exposure photograph using a learned over-complete dictionary,” in IEEE ICCV (IEEE, 2011), pp. 287–294.

Helmes, M.

G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
[Crossref] [PubMed]

Hitomi, Y.

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Video from a single coded exposure photograph using a learned over-complete dictionary,” in IEEE ICCV (IEEE, 2011), pp. 287–294.

Kagawa, K.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Katsaggelos, A. K.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Kawahito, S.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Kittle, D.

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

Kohl, P.

G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
[Crossref] [PubMed]

Koller, R.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Lee, P.

G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
[Crossref] [PubMed]

Liao, X.

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

Lin, X.

Liu, D.

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

Liu, Y.

Llull, P.

T. H. Tsai, P. Llull, X. Yuan, L. Carin, and D. J. Brady, “Spectral-temporal compressive imaging,” Opt. Lett. 40(17), 4054–4057 (2015).
[Crossref] [PubMed]

X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
[Crossref]

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

Matsuda, N.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Mitsunaga, T.

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Video from a single coded exposure photograph using a learned over-complete dictionary,” in IEEE ICCV (IEEE, 2011), pp. 287–294.

Mochizuki, F.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Nayar, S. K.

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Video from a single coded exposure photograph using a learned over-complete dictionary,” in IEEE ICCV (IEEE, 2011), pp. 287–294.

Niederberger, T.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Oike, Y.

Y. Oike and A. E. Gamal, “CMOS image sensor with per-column ΣΔ ADC and programmable compressed sensing,” IEEE J. Solid-State Circuits 48(1), 318–328 (2013).
[Crossref]

Okihara, S.I.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Pathak, A. P.

H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
[PubMed]

Raskar, R.

R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: motion deblurring using fluttered,” ACM Trans. Graphics 25(3), 795–804 (2006).
[Crossref]

Sapiro, G.

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

Schmid, L.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Schuster, G.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Senarathna, J.

H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
[PubMed]

Seo, M.W.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Spinoulas, L.

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Takasawa, T.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Tecza, M.

G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
[Crossref] [PubMed]

Thakor, N. V.

H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
[PubMed]

Tsai, T. H.

Tumblin, J.

R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: motion deblurring using fluttered,” ACM Trans. Graphics 25(3), 795–804 (2006).
[Crossref]

Tyler, B. M.

H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
[PubMed]

Wetzstein, G.

Yang, J.

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

Yasutomi, K.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Yu, H.

H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
[PubMed]

Yuan, X.

T. H. Tsai, X. Yuan, and D. J. Brady, “Spatial light modulator based color polarization imaging,” Opt. Express 23(9), 11912–11926 (2015)
[Crossref] [PubMed]

T. H. Tsai, P. Llull, X. Yuan, L. Carin, and D. J. Brady, “Spectral-temporal compressive imaging,” Opt. Lett. 40(17), 4054–4057 (2015).
[Crossref] [PubMed]

X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
[Crossref]

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

Zhang, B.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Zhu, R.

X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
[Crossref]

ACM Trans. Graphics (1)

R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: motion deblurring using fluttered,” ACM Trans. Graphics 25(3), 795–804 (2006).
[Crossref]

IEEE J. Sel. Top. Signal Process. (1)

X. Yuan, T. H. Tsai, R. Zhu, P. Llull, D. Brady, and L. Carin, “Compressive hyperspectral imaging with side information,” IEEE J. Sel. Top. Signal Process. 9(6), 964–976 (2015).
[Crossref]

IEEE J. Solid-State Circuits (1)

Y. Oike and A. E. Gamal, “CMOS image sensor with per-column ΣΔ ADC and programmable compressed sensing,” IEEE J. Solid-State Circuits 48(1), 318–328 (2013).
[Crossref]

IEEE Trans. Inf. Theory (1)

D.L. Donoho, “Compressed sensing,” IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006).
[Crossref]

IEEE Trans. Pattern Anal. Mach. Intell. (1)

D. Liu, J. Gu, Y. Hitomi, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging,” IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 248–260 (2014).
[Crossref]

Nat. Methods (1)

G. Bub, M. Tecza, M. Helmes, P. Lee, and P. Kohl, “Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging,” Nat. Methods 7(3), 209–211 (2010).
[Crossref] [PubMed]

Neuro Image (1)

H. Yu, J. Senarathna, B. M. Tyler, N. V. Thakor, and A. P. Pathak, “Miniaturized optical neuroimaging in unrestrained animals,” Neuro Image 113, 397–406 (2015).
[PubMed]

Opt. Express (1)

Opt. Lett. (4)

X. Lin, G. Wetzstein, Y. Liu, and Q. Dai, “Dual-coded compressive hyperspectral imaging,” Opt. Lett. 39(7), 2044–2047 (2014).
[Crossref] [PubMed]

T. H. Tsai, P. Llull, X. Yuan, L. Carin, and D. J. Brady, “Spectral-temporal compressive imaging,” Opt. Lett. 40(17), 4054–4057 (2015).
[Crossref] [PubMed]

P. Llull, X. Liao, X. Yuan, J. Yang, D. Kittle, L. Carin, G. Sapiro, and D. J. Brady, “Coded aperture compressive temporal imaging,” Opt. Lett. 21(9), 10526–10545 (2015).

R. Koller, L. Schmid, N. Matsuda, T. Niederberger, L. Spinoulas, O. Cossairt, G. Schuster, and A. K. Katsaggelos, “High spatio-temporal resolution video with compressed sensing,” Opt. Lett. 23(12), 15992–16007 (2015).

Other (2)

Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S. K. Nayar, “Video from a single coded exposure photograph using a learned over-complete dictionary,” in IEEE ICCV (IEEE, 2011), pp. 287–294.

F. Mochizuki, K. Kagawa, S.I. Okihara, M.W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito, “Single-shot 200Mfps 5 3-aperture compressive CMOS imager,” in IEEE ISSCC (IEEE, 2015), pp. 1–3.

Cited By

OSA participates in Crossref's Cited-By Linking service. Citing articles from OSA journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1
Fig. 1 Conventional Global Exposure imaging vs. Pixel-wise Coded Exposure imaging.
Fig. 2
Fig. 2 (A) Optical Implementation of PCE [4, 9] (B) Proposed all-CMOS PCE implementation at the image sensor focal plane.
Fig. 3
Fig. 3 System architecture for CMOS PCE chip.
Fig. 4
Fig. 4 Chip Micrograph.
Fig. 5
Fig. 5 Reconstructed video scenes using coded exposure images from the sensor.
Fig. 6
Fig. 6 Enhancing scene SNR and reducing motion blur simultaneously using PCE.
Fig. 7
Fig. 7 Power Consumption and Image Quality at different Compression Rate (CR).

Equations (2)

Equations on this page are rendered with MathJax. Learn more.

Y ( m , n ) = t = 1 T S ( m , n , t ) X ( m , n , t )
X ^ = argmin a a 0 s . t . Y SDa 2 ε .

Metrics