Debugging Object Tracking by a Recommender System with Correction Propagation
Abstract
In biomedical applications such as tracking hundreds of specimens over months, we assume none of the existing visual tracking approaches is capable of achieving 100 percent accuracy in these challenging real-world scenarios. Meanwhile, biological discovery and health diagnosis usually require high-quality tracking results for solid analysis. However, manually debugging (verifying and correcting) tracking results generated by automated tracking algorithms object-by-object and frame-by-frame in thousands of frames is too tedious. In this paper, we investigate how to debug automated object tracking results with humans in the loop. A novel iterative recommender system with correction propagation is proposed to assist multiple human annotators to debug tracking results in an effective, collaborative and efficient way. Tracking data that are highly erroneous are recommended to annotators based on their propagation influence and annotators' debugging histories. Different annotators debug the tracking data independently and their debugging results are collected for joint correction propagation. Since an error found by an annotator may have many analogous errors in the tracking data and the errors can also affect their nearby data, we propose a correction propagation scheme to propagate corrections from all human annotators to unchecked data which efficiently reduces human efforts and accelerates the convergence to perfect tracking accuracy. Our proposed approach is evaluated on three challenging biological datasets. The quantitative evaluation and comparison validate that the recommender system with correction propagation is effective and efficient to help humans debug tracking results generated by automated tracking algorithms.
Recommended Citation
M. Li and Z. Yin, "Debugging Object Tracking by a Recommender System with Correction Propagation," IEEE Transaction on Big Data, vol. 3, no. 4, pp. 429 - 442, Institute of Electrical and Electronics Engineers (IEEE), Dec 2017.
The definitive version is available at https://doi.org/10.1109/TBDATA.2017.2723022
Department(s)
Computer Science
Research Center/Lab(s)
Intelligent Systems Center
Keywords and Phrases
Biological Object Tracking; Data Debugging; Recommender System; Human In The Loop
International Standard Serial Number (ISSN)
2332-7790
Document Type
Article - Journal
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2017 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
01 Dec 2017
