Fusion of thermal and visible cameras for the application of pedestrian detection

详细信息    查看全文

• 作者：Vijay John ; Shogo Tsuchizawa ; Zheng Liu ; Seiichi Mita
• 关键词：Sensor fusion ; Thermal imaging ; Optimization ; Pedestrian detection
• 刊名：Signal, Image and Video Processing
• 出版年：2017
• 出版时间：March 2017
• 年：2017
• 卷：11
• 期：3
• 页码：517-524
• 全文大小：
• 刊物类别：Engineering
• 刊物主题：Signal,Image and Speech Processing; Image Processing and Computer Vision; Computer Imaging, Vision, Pattern Recognition and Graphics; Multimedia Information Systems;
• 出版者：Springer London
• ISSN：1863-1711
• 卷排序：11

文摘

In this paper, we propose methods to calibrate visible and thermal cameras and register their images in the application of pedestrian detection. We calibrate the camera using a checkerboard pattern mounted on a heated rig. We implement the image registration using three different approaches. In the first approach, we use the camera calibration information to generate control points from the checkerboard pattern. These control points are then used to register the images. In the second approach, we generate trajectory points for image registration using an external illuminated object. In the third approach, we achieve the registration through face tracking without the aid of any external object. The particle swarm optimization algorithm performs the image registration using the generated control and trajectory points, observed in both the cameras. We demonstrate the advantages of fusing the thermal and visible camera within a pedestrian detection algorithm. We evaluate the proposed registration algorithms and perform a comparison with baseline algorithms, i.e. genetic and simulated annealing algorithms. Additionally, we also perform a detailed parameter evaluation of the particle swarm optimization algorithm. The experimental results demonstrate the accuracy of the proposed algorithm and the advantages of thermal-visible camera fusion.