iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning


To achieve automatic recommendation of privacy settings for image sharing, a new tool called iPrivacy (image privacy) is developed for releasing the burden from users on setting the privacy preferences when they share their images for special moments. Specifically, this paper consists of the following contributions: 1) massive social images and their privacy settings are leveraged to learn the object-privacy relatedness effectively and identify a set of privacy-sensitive object classes automatically; 2) a deep multi-task learning algorithm is developed to jointly learn more representative deep convolutional neural networks and more discriminative tree classifier, so that we can achieve fast and accurate detection of large numbers of privacy-sensitive object classes; 3) automatic recommendation of privacy settings for image sharing can be achieved by detecting the underlying privacy-sensitive objects from the images being shared, recognizing their classes, and identifying their privacy settings according to the object-privacy relatedness; and 4) one simple solution for image privacy protection is provided by blurring the privacy-sensitive objects automatically. We have conducted extensive experimental studies on real-world images and the results have demonstrated both the efficiency and effectiveness of our proposed approach.


Computer Science

Research Center/Lab(s)

Intelligent Systems Center

Keywords and Phrases

Image Sharing; Privacy Setting Recommendation; Object-Privacy Alignment; Image Privacy Protection; Privacy-Sensitive Object Classes; Deep Multi-Task Learning; Tree Classifier For Hierarchical Object Detection

International Standard Serial Number (ISSN)

1556-6013; 1556-6021

Document Type

Article - Journal

Document Version


File Type





© 2017 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.

Publication Date

01 May 2017