Data protection based on user and gesture recognition

• US 9,734,352 B2
• Filed: 06/27/2014
• Issued: 08/15/2017
• Est. Priority Date: 06/27/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Huang, Jerry, Li, QingHu, Liu, Zhen, Liu, Chen
• Primary Examiner(s): DOAN, TRANG T
• Application Number:
  US14/403,024
• Publication Number:
  US 20160371504A1
• Time in Patent Office: 1,145 Days
• Field of Search: None
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06F 21/74 operating in dual or compartmented mode, i.e. at least one secure mode
• CPC Class Codes: G06F 21/84 output devices, e.g. displays or monitors
• CPC Class Codes: G06F 2221/2143 Clearing memory, e.g. to prevent the data from being stolen
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04W 12/06 Authentication

Abstract

A computing device is described herein that automatically enters a data protection mode in response to determining that a certain number of persons are located proximate to the computing device, that an owner or authorized user is not located proximate to the computing device, or that a certain user gesture has or has not been recognized. When the device enters the data protection mode, sensitive data stored on the device is automatically rendered invisible and/or inaccessible to a user thereof. The sensitive data may be rendered invisible and/or inaccessible in a manner that is not likely to be apparent to the user of the computing device.

Claims

1. A computing device, comprising:

at least one processor circuit configured to receive image data from one or more image capturing devices connected to or integrated with the computing device and to analyze the image data to determine a number of persons located proximate to the computing device; and

the at least one processor circuit being further configured to determine if the number of persons located proximate to the computing device exceeds a threshold value, to activate a first mode of operation of the computing device in response to a determination that the number of persons located proximate to the computing device does not exceed the threshold value, and to activate a second mode of operation of the computing device in response to a determination that the number of persons located proximate to the computing device exceeds the threshold value, the first mode of operation of the computing device being a mode in which sensitive data stored on the computing device and non-sensitive data stored on the computing device are both visible and accessible to a user, and the second mode of operation of the computing device being a mode in which the non-sensitive data stored on the computing device is visible and accessible to the user and the sensitive data stored on the computing device is rendered one or more of invisible to the user and inaccessible to the user,

the second mode of operation being a mode in which at least one item of sensitive data is rendered invisible to the user or inaccessible to the user by performing one or more of;

hard deleting the item of sensitive data;

soft deleting the item of sensitive data;

or

causing file system requests for the item of sensitive data to be ignored.

2. The computing device of claim 1, wherein the one or more image capturing devices comprise one or more cameras.

3. The computing device of claim 1, wherein the at least one processor circuit is configured to determine the number of persons located proximate to the computing device by analyzing the image data to identify a number of distinct faces.

4. The computing device of claim 1, wherein the at least one processor circuit is configured to determine the number of persons located proximate to the computing device by analyzing the image data to identify a number of distinct bodies.

5. The computing device of claim 1, wherein the at least one processor circuit is further:

configured to provide a user interface by which a user can specify the threshold value.

6. The computing device of claim 1, wherein the at least one processor circuit is configured to analyze the image data to determine the number of persons located proximate to the computing device by:

analyzing the image data to determine a number of persons within a certain distance of the computing device.

7. The computing device of claim 6, wherein the at least one processor circuit is further:

configured to provide a user interface by which a user can specify the certain distance.

8. A method for protecting sensitive data stored on a computing device, comprising:

receiving image data from one or more image capturing devices connected to or integrated with the computing device;

analyzing the image data to determine if an owner or authorized person is located proximate to the computing device;

in response to a determination that the owner or authorized person is located proximate to the computing device, activating a first mode of operation of the computing device in which sensitive data stored on the computing device and non-sensitive data stored on the computing device are both visible and accessible to a user; and

in response to a determination that the owner or authorized person is not located proximate to the computing device, activating a second mode of operation of the computing device in which the non-sensitive data stored on the computing device is visible and accessible to the user and the sensitive data stored on the computing device is rendered one or more of invisible to the user and inaccessible to the user,

the second mode of operation of the computing device being a mode in which at least one item of sensitive data is rendered invisible to the user or inaccessible to the user by performing one or more of;

hard deleting the item of sensitive data;

soft deleting the item of sensitive data;

or

causing file system requests for the item of sensitive data to be ignored.

9. The method of claim 8, wherein the one or more image capturing devices comprise one or more cameras.

10. The method of claim 8, wherein analyzing the image data to determine if the owner or authorized person is located proximate to the computing device comprises:

analyzing the image data to identify a face of the owner or authorized person.

11. The method of claim 8, wherein analyzing the image data to determine if the owner or authorized person is located proximate to the computing device comprises:

analyzing the image data to identify a body of the owner or authorized person.

12. The method of claim 8, wherein analyzing the image data to determine if the owner of authorized person is located proximate to the computing device comprises:

analyzing the image data to determine if the owner or authorized person is within a certain distance of the computing device.

13. The method of claim 12, further comprising:

providing a user interface by which a user can specify the certain distance.

14. A computer program product comprising a computer-readable memory having computer program logic recorded thereon that when executed by at least one processor causes the at least one processor to perform a method for protecting sensitive data stored on a computing device, the method comprising:

receiving image data from one or more image capturing devices connected to or integrated with the computing device;

analyzing the image data to determine whether a particular user gesture is recognized; and

based on the determination, selectively activating one of a first mode of operation of the computing device in which sensitive data stored on the computing device and non-sensitive data stored on the computing device are both visible and accessible to a user and a second mode of operation of the computing device in which the non-sensitive data stored on the computing device is visible and accessible to the user and the sensitive data stored on the computing device is rendered one or more of invisible to the user and inaccessible to the user,

the second mode of operation of the computing device being a mode in which at least one item of sensitive data is rendered invisible to the user or inaccessible to the user by performing one or more of;

hard deleting the item of sensitive data;

soft deleting the item of sensitive data;

or

causing file system requests for the item of sensitive data to be ignored.

15. The computer program product comprising the computer-readable memory of claim 14, wherein the one or more image capturing devices comprise one or more cameras.

16. The computer program product comprising the computer-readable memory of claim 14, wherein the particular gesture comprises one or more of a facial gesture, a hand gesture, an arm gesture, a body gesture, a leg gesture, and a foot gesture.

17. The computer program product comprising the computer-readable memory of claim 14, wherein the method further comprises:

providing a user interface by which a user can specify the particular gesture.