A-Wristocracy: Deep Learning on Wrist-Worn Sensing for Recognition of User Complex Activities
Abstract
In this work we present A-Wristocracy, a novel framework for recognizing very fine-grained and complex in-home activities of human users (particularly elderly people) with wrist-worn device sensing. Our designed A-Wristocracy system improves upon the state-of-the-art works on in-home activity recognition using wearables. These works are mostly able to detect coarse-grained ADLs (Activities of Daily Living) but not large number of fine-grained and complex IADLs (Instrumental Activities of Daily Living). These are also not able to distinguish similar activities but with different context (such as sit on floor vs. sit on bed vs. sit on sofa). Our solution helps accurate detection of in-home ADLs/ IADLs and contextual activities, which are all critically important for remote elderly care in tracking their physical and cognitive capabilities. A-Wristocracy makes it feasible to classify large number of fine-grained and complex activities, through Deep Learning based data analytics and exploiting multi-modal sensing on wrist-worn device. It exploits minimal functionality from very light additional infrastructure (through only few Bluetooth beacons), for coarse level location context. A-Wristocracy preserves direct user privacy by excluding camera/ video imaging on wearable or infrastructure. The classification procedure consists of practical feature set extraction from multi-modal wearable sensor suites, followed by Deep Learning based supervised fine-level classification algorithm. We have collected exhaustive home-based ADLs and IADLs data from multiple users. Our designed classifier is validated to be able to recognize very fine-grained complex 22 daily activities (much larger number than 6-12 activities detected by state-of-the-art works using wearable and no camera/ video) with high average test accuracies of 90% or more for two users in two different home environments.
Recommended Citation
P. Vepakomma et al., "A-Wristocracy: Deep Learning on Wrist-Worn Sensing for Recognition of User Complex Activities," Proceedings of the IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks, BSN 2015 (2015, Cambridge, MA), Institute of Electrical and Electronics Engineers (IEEE), Jun 2015.
The definitive version is available at https://doi.org/10.1109/BSN.2015.7299406
Meeting Name
IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks, BSN 2015 (2015: Jun. 9-12, Cambridge, MA)
Department(s)
Computer Science
Keywords and Phrases
Cameras; Complex networks; Wearable sensors; Wearable technology; Activities of Daily Living; Activity recognition; Classification algorithm; Classification procedure; Cognitive capability; Complex activity; Multi-modal sensing; State of the art; Body sensor networks
International Standard Book Number (ISBN)
978-1-4673-7201-5
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2015 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
01 Jun 2015
