Combining Passive Visual Cameras and Active IMU Sensors for Persistent Pedestrian Tracking

Abstract

Vision based pedestrian tracking becomes a hard problem when long-term/heavy occlusion happens or pedestrian temporarily moves out of the visual field. In this paper, a novel persistent pedestrian tracking system is presented which combines visual signal from surveillance cameras and sensor signals from Inertial Measurement Unit (IMU) carried by pedestrians themselves. IMU tracking performs Dead Reckoning (DR) approach utilizing accelerometer, gyroscope and magnetometer. IMU tracking has nothing to do with visual occlusion, so it keeps working even when pedestrians are visually occluded. Meanwhile, visual tracking assists in calibrating IMU to avoid the bias drift during DR. The experimental results show that the IMU and visual tracking are complementary to each other and their combination performs robust pedestrian tracking in many challenging scenarios.

Department(s)

Computer Science

Research Center/Lab(s)

Intelligent Systems Center

Keywords and Phrases

Cameras; Navigation; Security Systems; Units of Measurement; Dead Reckoning; Inertial Measurement Unit; Pedestrian Tracking; Surveillance Cameras; Visual Object Tracking; Visual Occlusions; Visual Signals; Visual Tracking; Tracking (Position); IMU Tracking; Persistent Pedestrian Tracking

International Standard Serial Number (ISSN)

1047-3203

Document Type

Article - Journal

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2017 Elsevier, All rights reserved.

Publication Date

01 Oct 2017

Link to Full Text

Share

 
COinS