Wearable computing device for detecting photography

• US 10,432,851 B2
• Filed: 10/28/2016
• Issued: 10/01/2019
• Est. Priority Date: 10/28/2016
• Status: Active Grant

• Current Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Tierney, John
• Primary Examiner(s): Montoya, Oschta I
• Application Number:
  US15/338,210
• Publication Number:
  US 20180124309A1
• Time in Patent Office: 1,068 Days
• CPC Class Codes: G03B 17/56 Accessories carrying-cases A45C11/38
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: G09B 21/007 using both tactile and audible presentation of the information
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

A wearable computing device for detecting photography includes an outer casing configured to be worn by a user. The wearable computing device also includes a device camera coupled to the outer casing. The device camera is designed to detect image data corresponding to a person holding a remote camera in an environment of the wearable computing device. The wearable computing device also includes a mobile processor coupled to the device camera. The mobile processor is designed to determine that a photograph will be taken based on the image data corresponding to the person holding the remote camera. The wearable computing device also includes an output device coupled to the mobile processor. The output device is designed to output data indicating that the photograph of the wearable computing device will be taken.

Claims

1. A wearable computing device for detecting photography comprising:

an outer casing configured to be worn by a user;

a device camera coupled to the outer casing and configured to detect image data corresponding to a person holding a remote camera in an environment of the wearable computing device;

a mobile processor coupled to the device camera and configured to determine that a photograph will be taken based on the image data corresponding to the person holding the remote camera, and determine a direction of the remote camera relative to the wearable computing device based on the image data corresponding to the person holding the remote camera; and

an output device coupled to the mobile processor and configured to output data indicating that the photograph of the wearable computing device will be taken, the output device including at least one of a speaker configured to output audio data providing directions for the user to turn to face the remote camera or a pair of vibration units each positioned on one side of the outer casing and configured to output stereo haptic feedback in a pattern that provides directions for the user to turn to face the remote camera.

2. The wearable computing device of claim 1 wherein the device camera is further configured to detect image data corresponding to an orientation of the remote camera relative to the wearable computing device and the mobile processor is further configured to determine that the photograph will be taken when the detected orientation of the remote camera indicates that the remote camera is oriented towards the wearable computing device.

3. The wearable computing device of claim 1 wherein the device camera is further configured to detect at least one of image data corresponding to a location of a finger relative to a button of the remote camera or a location of the remote camera relative to a head of the person holding the remote camera, and the mobile processor is further configured to determine that the photograph will be taken when at least one of the finger is located within a first predetermined distance of the button of the remote camera or the remote camera is located within a second predetermined distance of the head of the person holding the remote camera.

4. The wearable computing device of claim 3 wherein:

the device camera is further configured to detect image data corresponding to an amount of light present in the environment of the wearable computing device that corresponds to a flash of the remote camera;

the mobile processor is further configured to determine that the photograph has been taken when at least one of;

the amount of light present in the environment of the wearable computing device spikes,

the finger has moved away from the button of the remote camera by at least the first predetermined distance, or

the remote camera has moved away from the head of the person holding the remote camera by at least the second predetermined distance; and

the output device is further configured to output data indicating that the photograph has been taken in response to the mobile processor determining that the photograph has been taken.

5. The wearable computing device of claim 1 further comprising a microphone configured to detect audio data corresponding to at least one of a verbal cue indicating that an image has been taken or will be taken or a sound of a flash or a shutter of the remote camera and wherein the mobile processor is further configured to determine that the photograph has been taken or determine that the photograph will be taken based on the detected audio data.

6. The wearable computing device of claim 1 further comprising:

an input device coupled to the mobile processor and configured to receive input from the user indicating a desire to reduce a quality of the photograph; and

a light source coupled to the mobile processor and configured to generate light,

wherein the mobile processor is further configured to cause the light source to generate the light to reduce the quality of the photograph based on the input from the user indicating the desire to reduce the quality of the photograph and based on the determination by the mobile processor that the photograph will be taken.

7. A wearable computing device for detecting photography comprising:

an outer casing configured to be worn by a user;

a device camera coupled to the outer casing and configured to detect image data corresponding to an amount of light present in an environment of the wearable computing device that corresponds to a flash of a remote camera;

a mobile processor coupled to the device camera and configured to determine that a photograph has been taken when the amount of light present in the environment of the wearable computing device spikes, and to determine a direction of the remote camera relative to the wearable computing device based on the image data corresponding to the amount of light present in the environment; and

an output device coupled to the mobile processor and configured to output data indicating that the photograph of the wearable computing device has been taken, the output device including at least one of a speaker configured to output audio data providing directions for the user to turn to face the remote camera or a pair of vibration units each positioned on one side of the outer casing and configured to output stereo haptic feedback in a pattern that provides directions for the user to turn to face the remote camera.

8. The wearable computing device of claim 7 wherein the mobile processor is further configured to differentiate between light of a camera flash and other types of light based on at least one of a frequency of detected light or a duration of the detected light.

9. The wearable computing device of claim 7 further comprising a microphone configured to detect audio data corresponding to at least one of a sound of the flash of the remote camera or a verbal cue indicating that the photograph has been taken or will be taken and wherein the mobile processor is further configured to determine that the photograph has been taken or determine that the photograph will be taken based on the detected audio data.

10. The wearable computing device of claim 9 wherein the verbal cue includes at least one of the word “

cheese”

or an increasing or decreasing numerical or alphabetical count.

11. The wearable computing device of claim 7 further comprising a light source coupled to the mobile processor and configured to generate light and wherein the mobile processor is further configured to cause the light source to generate the light in response to determining that the photograph has been taken in order to reduce a quality of the photograph.

12. The wearable computing device of claim 7 wherein:

the device camera is further configured to detect image data corresponding to a person holding the remote camera in the environment of the wearable computing device;

the mobile processor is further configured to determine that the photograph will be taken based on the detected image data corresponding to the person holding the remote camera; and

the output device is further configured to output data indicating that the photograph will be taken.

13. A method for determining that a photograph of a user of a wearable computing device has been taken or will be taken, comprising:

detecting, by a device camera, image data corresponding to at least one of a person holding a remote camera in an environment of the wearable computing device or an amount of light present in the environment of the wearable computing device that corresponds to a flash of the remote camera;

determining, by a mobile processor coupled to the device camera, that the photograph of the user of the wearable computing device will be taken based on the image data corresponding to the person holding the remote camera;

outputting, by an output device coupled to the mobile processor, first output data indicating that the photograph of the user of the wearable computing device will be taken;

determining, by the mobile processor, that the photograph of the user of the wearable computing device has been taken based on at least one of the image data corresponding to the person holding the remote camera or the amount of light present in the environment of the wearable computing device;

determining, by the mobile processor, a direction of the remote camera relative to the wearable computing device based on the image data corresponding to the person holding the remote camera;

outputting, by the output device, second output data indicating that the photograph of the user of the wearable computing device has been taken; and

at least one of;

outputting, by a speaker, audio data providing directions for the user to turn to face the remote camera, or

outputting, by a pair of vibration units, stereo haptic feedback having a pattern that provides directions for the user to turn to face the remote camera.

14. The method of claim 13 further comprising:

detecting, by a microphone coupled to the mobile processor, audio data corresponding to at least one of a sound of the flash of the remote camera or a verbal cue indicating that the photograph has been taken or that the photograph will be taken; and

determining, by the mobile processor, that the photograph has been taken or that the photograph will be taken based on the detected audio data.

15. The method of claim 13 further comprising:

receiving, by an input device coupled to the mobile processor, input data indicating a desire to reduce a quality of the photograph; and

causing, by the mobile processor, a light source to generate light to reduce the quality of the photograph based on the input data and the determination by the mobile processor that the photograph has been taken or that the photograph will be taken.

16. The method of claim 13 further comprising:

detecting, by the device camera, image data corresponding to at least one of a finger relative to a button of the remote camera or a location of the remote camera relative to a head of the person holding the remote camera; and

determining, by the mobile processor, that the photograph will be taken when at least one of the finger is within a first predetermined distance of the button of the remote camera or the remote camera is within a second predetermined distance of the head of the person holding the remote camera.