Video capture with privacy safeguard

• US 10,602,054 B2
• Filed: 01/09/2015
• Issued: 03/24/2020
• Est. Priority Date: 09/12/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Jung, Jaeyeon, Philipose, Matthai
• Primary Examiner(s): Topgyal, Gelek W
• Application Number:
  US14/593,839
• Publication Number:
  US 20160080642A1
• Time in Patent Office: 1,901 Days
• Field of Search: 386227
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G11B 19/02 Control of operating function, e.g. switching from recording to reproducing
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

A method to record video with a video camera while respecting bystander privacy includes acquiring sensory data separate from the video, parsing the sensory data for evidence of a human being in a field of view of the video camera, and recording video with the video camera if no human being is detected in the field of view, based upon the sensory data.

Claims

1. A method to record video with a video camera while respecting bystander privacy, the method comprising:

capturing video with the video camera;

acquiring thermal sensory data separate from the video;

parsing the thermal sensory data for evidence of a human being first entering a field of view of the video camera; and

based on detecting a human being first entering the field of view via the thermal sensory data while the video is being captured, suspending recording of the video until confirmation is received that the human being is willing to be recorded.

2. The method of claim 1, further comprising, when a human being is detected in the field of view via the thermal sensory data, delaying recording of the video until confirmation is received that the human being is willing to be recorded.

3. The method of claim 1, further comprising parsing the video to recognize one or more human beings and suspending recording of the video when a human being of the one or more human beings is not confirmed as willing to be recorded.

4. The method of claim 3, further comprising resuming recording of the video when it is confirmed that the human being is willing to be recorded.

5. The method of claim 4, further comprising parsing the thermal sensory data to recognize a hand or body gesture of a human being indicating willingness to be recorded, and resuming recording of the video on recognizing the hand or body gesture.

6. The method of claim 1, further comprising parsing the video to recognize a hand or body gesture of a human being.

7. The method of claim 6, further comprising suspending recording of the video on recognizing a hand or body gesture indicating unwillingness to be recorded.

8. The method of claim 7, wherein the gesture indicating unwillingness includes a hand over a face of the human being.

9. An imaging system comprising:

a video camera;

separate from the video camera, a sensor configured to acquire thermal sensory data over a field of view of the video camera; and

a controller configured to capture video with the video camera, parse the thermal sensory data for evidence of a human being first entering the field of view of the video camera, and based on detecting a human being first entering the field of view via the thermal sensory data while the video is being captured, to suspend recording of the video until confirmation is received that the human being is willing to be recorded.

10. The imaging system of claim 9, wherein the sensor is a far-infrared sensor.

11. The imaging system of claim 9, wherein the sensor is an imaging sensor of lower resolution and/or color depth than the video camera.

12. The imaging system of claim 9, further comprising an electronically closable shutter arranged over an aperture of the video camera, wherein the controller is configured to keep the shutter closed when recording of the video is not enabled.

13. The imaging system of claim 9, wherein the imaging system is wearable.

14. The imaging system of claim 9, wherein the imaging system is configured for continuous video acquisition.

15. A method to record video with a video camera while respecting bystander privacy, the method comprising:

acquiring far-infrared sensory data separate from the video;

parsing the far-infrared sensory data for evidence of a human being first entering a field of view of the video camera;

if no human being is detected in the field of view via the far-infrared sensory data, then recording video with the video camera without delay;

if a human being is detected in the field of view via the far-infrared sensory data, then delaying recording of the video until confirmation is received that the detected human being is willing to be recorded; and

based on detecting a human being first entering the field of view via the far-infrared sensory data while the video is being captured, suspending recording of the video until confirmation is received that the human being is willing to be recorded.

16. The method of claim 15, further comprising storing one or more images of human beings confirmed as willing to be recorded.

17. The method of claim 15, wherein the evidence of the human being includes a far-infrared image corresponding to a head and body shape of a human being.

18. The method of claim 15, further comprising parsing the far-infrared sensory data to recognize a gesture of one or more human beings indicating willingness to be recorded, and resuming recording of the video on recognizing the gesture indicating willingness to be recorded.

19. The method of claim 15, further comprising parsing the video to recognize a human being, and suspending recording of the video on determining that a recognized human being is not confirmed as willing to be recorded.

20. The method of claim 15, further comprising parsing the video to recognize a gesture of a human being indicating unwillingness to be recorded, and suspending recording of the video on recognizing the gesture.