Combining Passive Visual Cameras and Active IMU Sensors for Persistent Pedestrian Tracking
Vision based pedestrian tracking becomes a hard problem when long-term/heavy occlusion happens or pedestrian temporarily moves out of the visual field. In this paper, a novel persistent pedestrian tracking system is presented which combines visual signal from surveillance cameras and sensor signals from Inertial Measurement Unit (IMU) carried by pedestrians themselves. IMU tracking performs Dead Reckoning (DR) approach utilizing accelerometer, gyroscope and magnetometer. IMU tracking has nothing to do with visual occlusion, so it keeps working even when pedestrians are visually occluded. Meanwhile, visual tracking assists in calibrating IMU to avoid the bias drift during DR. The experimental results show that the IMU and visual tracking are complementary to each other and their combination performs robust pedestrian tracking in many challenging scenarios.
W. Jiang and Z. Yin, "Combining Passive Visual Cameras and Active IMU Sensors for Persistent Pedestrian Tracking," Journal of Visual Communication and Image Representation, vol. 48, pp. 419 - 431, Elsevier, Oct 2017.
The definitive version is available at https://doi.org/10.1016/j.jvcir.2017.03.015
Intelligent Systems Center
Keywords and Phrases
Cameras; Navigation; Security Systems; Units of Measurement; Dead Reckoning; Inertial Measurement Unit; Pedestrian Tracking; Surveillance Cameras; Visual Object Tracking; Visual Occlusions; Visual Signals; Visual Tracking; Tracking (Position); IMU Tracking; Persistent Pedestrian Tracking
International Standard Serial Number (ISSN)
Article - Journal
© 2017 Elsevier, All rights reserved.
01 Oct 2017