Privacy protection of images in online settings

• US 10,694,373 B2
• Filed: 12/18/2017
• Issued: 06/23/2020
• Est. Priority Date: 12/18/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cahan, Amos, Mahindru, Ruchi, Salapura, Valentina, Shah, Syed Yousaf
• Primary Examiner(s): Zee, Edward
• Application Number:
  US15/845,171
• Publication Number:
  US 20190191300A1
• Time in Patent Office: 918 Days
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 21/60 Protecting data
• CPC Class Codes: G06F 21/62 Protecting access to data via a platform, e.g. using keys or access control rules
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06F 21/6254 by anonymising data, e.g. decorrelating personal data from the owner's identification
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: H04L 63/168 above the transport layer
• CPC Class Codes: H04W 12/02 Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]

Abstract

A system, method and program product for providing online privacy of image data. A centralized image privacy service is disclosed that includes: a user interface for allowing users to configure privacy profiles and provide profile images; an image scanning system that scans participating online sites for image data that matches the profile images; and a detection response system that determines a responsive action in response to a detected match based on an associated privacy profile, wherein the responsive action includes sending a masking request to the participating online site where the detected match occurred.

Claims

1. A centralized image privacy servicing method, the method comprising:

establishing privacy profiles using a user interface that allows users to configure the privacy profiles, wherein the privacy profiles comprise profile settings including;

an identity of one or more subjects that the users want to protect, profile images of the subjects that are used as training or baseline data for matching purposes, profile rules for each of the subjects including circumstances when image publication is allowed or not allowed and desired response when an unwanted image is detected, and user apps that provide contextual information for the profile rules;

scanning participating online sites for image data that matches the profile images using an image scanning system; and

determining a responsive action in response to a detected match based on an associated privacy profile, wherein the responsive action is determined by using a detection response system to identify an associated user and analyze the profile rules corresponding to the associated user, wherein the responsive action includes sending a masking request to the participating online site where the detected match occurred.

2. The centralized image privacy servicing method of claim 1, wherein each privacy profile includes a set of rules for handing a detected match.

3. The centralized image privacy servicing method of claim 2, wherein the set of rules specifies at least one user app for obtaining the contextual information.

4. The centralized image privacy servicing method of claim 3, wherein the contextual information includes at least one of calendar data, location data, or biometric data.

5. The centralized image privacy servicing method of claim 1, wherein each participating online site includes a masking request handler for processing masking requests.

6. The centralized image privacy servicing method of claim 1, wherein the masking request includes a location of a matching image and a proposed action.

7. The centralized image privacy servicing method of claim 1, wherein the responsive action includes issuing an alert to the associated user.

8. An embedded image privacy servicing method implemented at an online site, the method comprising:

accessing, periodically or on demand, privacy profiles for users from a centralized profile service using a privacy profile manager, wherein each privacy profile is established by a respective user and includes a profile image associated with the respective user, wherein each privacy profile comprises profile settings including;

an identity of one or more subjects that the respective user wants to protect, profile images of the subjects that are used as training or baseline data for matching purposes, profile rules for each of the subjects including circumstances when image publication is allowed or not allowed and desired response when an unwanted image is detected, and user apps that provide contextual information for the profile rules;

scanning image data being uploaded to the online site for image data that matches the profile images using an image scanning system; and

determining a responsive action in response to a detected match based on an associated privacy profile, wherein the responsive action is determined by using a detection response system to identify an associated user and analyze the profile rules corresponding to the associated user, wherein the responsive action includes masking uploaded image data.

9. The embedded image privacy servicing method of claim 8, wherein each privacy profile includes a set of rules for handing a detected match.

10. The embedded image privacy servicing method of claim 9, wherein the set of rules specifies at least one user app for obtaining the contextual information.

11. The embedded image privacy servicing method of claim 10, wherein the contextual information includes at least one of calendar data, location data, or biometric data.

12. The embedded image privacy servicing method of claim 8, wherein masking uploaded image data includes one of blocking an upload, blurring the image data, or whiting out a portion of the image data.

13. The embedded image privacy servicing method of claim 8, wherein the responsive action includes issuing an alert to the associated user.

14. A computer program product stored on a non-transitory computer readable storage medium, which when executed by a computing system, provides a centralized image privacy service, the program product comprising:

program code for establishing privacy profiles and allowing users to configure the privacy profiles, wherein the privacy profiles comprise profile settings including;

an identity of one or more subjects that the users want to protect, profile images of the subjects that are used as training or baseline data for matching purposes, profile rules for each of the subjects including circumstances when image publication is allowed or not allowed and desired response when an unwanted image is detected, and user apps that provide contextual information for the profile rules;

program code that scans participating online sites for image data that matches the profile images; and

program code that determines a responsive action in response to a detected match based on an associated privacy profile, wherein the responsive action is determined by identifying an associated user and analyzing the profile rules corresponding to the associated user, wherein the responsive action includes sending a masking request to the participating online site where the detected match occurred.

15. The computer program product of claim 14, wherein each privacy profile includes a set of rules for handing a detected match.

16. The computer program product of claim 15, wherein the set of rules specifies at least one user app for obtaining the contextual information.

17. The computer program product of claim 16, wherein the contextual information includes at least one of calendar data, location data, or biometric data.

18. The computer program product of claim 14, wherein the masking request includes a location of a matching image and a proposed action.

19. The computer program product of claim 14, wherein the responsive action includes at least one of:

removing the image data, blurring the image data or whiting out a portion of the image data.

20. The computer program product of claim 14, wherein the responsive action includes issuing an alert to the associated user.