Tokyo Tech News
Tokyo Institute of Technology merged with Tokyo Medical and Dental University to form Institute of Science Tokyo (Science Tokyo) on October 1, 2024.
Over time, content on this site will be migrated to the Science Tokyo Web. Any information published on this site will be valid in relation to Science Tokyo.
Tokyo Tech News
Published: June 3, 2016
Masatoshi Okutomi and researchers at Tokyo Tech and Olympus R&D have developed a new imaging system for simultaneous acquisition of color (RGB) and near-infrared (NIR) images using only a single image sensor.
Commercially available compact and low-cost color digital cameras acquire single-sensor color images with a color filter array (CFA)— an array of R, G, and B filters and overlaid on the image sensor (Fig. 1). Therefore, the data acquired by CFA based image sensors are mosaic. A set of image processing algorithms such as an interpolation process of the mosaic data called demosaicking, and color correction is performed to acquire a full-color image. In this way, current color cameras realize low-cost and easy-to-use color image acquisition.
Figure 1.
In recent years, many applications using a pair of color (RGB) and near-infrared (NIR) images have been proposed by computer vision and image processing communities. With this background, the group of Masatoshi Okutomi at Tokyo Tech and researchers at Olympus R&D have developed a prototype of a new imaging system for the simultaneous acquisition of RGB and NIR images using a single image sensor. Figure 2 is an overview of a prototype of this system consisting of a novel CFA that contains both RGB and NIR filters. The arrangement of the new CFA is shown in the Fig. 2, where "N" represents the NIR filter. The researchers have also developed an image processing system that can execute sets of image processing algorithms, such as demosaicking and color correction, in real time. The new system can acquire and display high-quality RGB and NIR images simultaneously at 60 frames per second (fps). Since the new system can provide users with a practical solution for simultaneous acquiring both the RGB and the NIR images, it is expected to open up a new range of applications in many fields such as remote sensing, security, robotics, agriculture, and medical imaging, where the NIR information is useful.
Figure 2.
Acknowledgement
This research was partly supported by the MIC/SCOPE #141203024 funding.
Reference1
Authors: |
Kazunori Yoshizaki, Munenori Fukunishi, Yasuhiro Komiya, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi and Steven Lansel |
Title of original paper: |
"A Real-Time RGB-NIR Imaging System Using a Single Image Sensor" |
Conference: |
IEEE Conference on Computer Vision and Pattern Recognition (CVPR2016)(Demonstration, June 2016) |
Reference2
Authors: |
Hayato Teranaka, Yusuke Monno, Masayuki Tanaka and Masatoshi Okutomi |
Title of original paper: |
"Single-Sensor RGB and NIR Image Acquisition: Toward Optimal Performance by Taking Account of CFA Pattern, Demosaicking, and Color Correction" |
Conference: |
IS&T International Symposium on Electronic Imaging (EI2016), February, 2016. |
School of Engineering
—Creating New Industries and Advancing Civilization—
Information on School of Engineering inaugurated in April 2016
Further information
Professor Masatoshi Okutomi
Department of Systems and Control Engineering
School of Science
Email mxo@ctrl.titech.ac.jp
Contact
Center for Public Affairs and Communications
Email media@jim.titech.ac.jp
Tel +81-3-5734-2975