Preparation of image capture device in response to pre-image-capture signal

• US 9,967,487 B2
• Filed: 11/25/2015
• Issued: 05/08/2018
• Est. Priority Date: 02/04/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Braun, Max Benjamin, Malkin, Peter, Brin, Sergey
• Primary Examiner(s): Spar, Ilana
• Assistant Examiner(s): HERMANN, KIRK W
• Application Number:
  US14/952,538
• Publication Number:
  US 20160080672A1
• Time in Patent Office: 895 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 25/709 Circuitry for control of the power supply

Abstract

Embodiments may be implemented by a computing device, such as a head-mountable display or mobile phone, in order to pre-emptively warm up the device'"'"'s camera, when it is probable that a user will be taking a photo. An illustrative method involves a computing device (a) receiving sensor data from one or more sensors associated with the computing device, wherein the computing device comprises an image-capture device, (b) analyzing the sensor data to detect at least one pre-image-capture signal, wherein the at least one pre-image-capture signal indicates a subsequent image-capture signal is likely to be received, and (c) in response to detecting the at least one pre-image-capture signal, causing the computing device to initiate an image-capture preparation process that prepares the image-capture device to capture an image.

Claims

1. A computing device comprising:

an image-capture device comprising at least one image sensor; and

a control system configured to;

while the computing device is powered on and the at least one image sensor is powered off;

(a) receive sensor data from one or more sensors, and (b) analyze the sensor data to detect at least one pre-image-capture signal that indicates a subsequent image-capture signal is likely to be received, wherein the detection of the at least one pre-image-capture signal comprises processing sensor data to determine whether or not there is motion indicative of visual fixation on a location in an environment of the computing device, wherein the motion sensor data indicating visual fixation comprises motion sensor data indicative of staring at the location for at least a predetermined period of time; and

in response to detection of the at least one pre-image-capture signal, initiate an image-capture preparation process comprising powering on the at least one image sensor to put the image-capture device in an image-ready state.

2. The computing device of claim 1, wherein the computing device is implemented as part of or takes the form of a head-mountable device (HMD).

3. The computing device of claim 1, wherein the control system is further configured to:

subsequent to the detection of the at least one pre-image-capture signal, and while the image-capture device in an image-ready state, receive an image-capture signal; and

in response to detection of the pre-image-capture signal, cause the image-capture device to capture an image.

4. The computing device of claim 1, wherein the control system is further configured to:

after initiating the image-capture preparation process, cause the image-capture device to remain in the image-ready state until either (a) an image-capture signal is received or (b) a predetermined period of time elapses without receipt of an image-capture signal.

5. The computing device of claim 1, wherein the one or more sensors comprise one or more of:

(a) one or more proximity sensors, (b) one or more image-capture devices, (c) one or more microphones, (d) one or more accelerometers, (e) one or more gyroscopes, and (f) one or more magnetometers.

6. The computing device of claim 1, further comprising an eye-tracking system, wherein the one or more sensors are part of an eye-tracking system.

7. The computing device of claim 1, wherein the control system is further configured to:

analyze sensor data to detect a wink signal; and

in response to detection of the wink signal, cause the image-capture device to capture an image.

8. The computing device of claim 1, wherein the motion sensor data indicative of staring at the location comprises motion sensor data indicative of a substantial lack of movement corresponding to starting at the location in the environment.

9. A computing device comprising:

an image-capture device comprising at least one image sensor; and

a control system configured to;

while the computing device is powered on and the at least one image sensor is powered off;

(a) receive sensor data from one or more sensors, and (b) analyze the sensor data to detect at least one pre-image-capture signal that indicates a subsequent image-capture signal is likely to be received, wherein the at least one pre-image-capture signal comprises sensor data that is indicative of a closed eye; and

in response to detection of the at least one pre-image-capture signal, initiate an image-capture preparation process comprising powering on the at least one image sensor to put the image-capture device in an image-ready state.

10. A computing device, wherein the computing device is implemented as part of or takes the form of a head-mountable device (HMD), the computing device comprising:

a button interface;

one or more proximity sensors that are arranged to detect a hand that is located near to the button interface;

an image-capture device comprising at least one image sensor; and

a control system configured to;

while the computing device is powered on and the at least one image sensor is powered off;

(a) receive sensor data from one or more sensors, and (b) analyze the sensor data to detect at least one pre-image-capture signal that indicates a subsequent image-capture signal is likely to be received, wherein the at least one pre-image-capture signal comprises a combination of (i) sensor data that is indicative of a hand within a certain distance from an interface feature and separated by air from the interface feature, wherein the interface feature is usable to initiate the subsequent image-capture signal, and (ii) motion sensor data processed to determine whether or not there is motion indicative of staring at a location in the environment for at least a predetermined period of time; and

in response to detection of the at least one pre-image-capture signal, initiate an image-capture preparation process comprising powering on the at least one image sensor to put the image-capture device in an image-ready state.

11. A computer-implemented method comprising:

receiving sensor data from one or more sensors associated with a computing device, wherein the computing device comprises an image-capture device having at least one image sensor, wherein the sensor data is received while the computing device is powered on and the at least one image sensor is powered off, and where the sensor data comprises motion sensor data;

analyzing the sensor data to detect at least one pre-image-capture signal, wherein the at least one pre-image-capture signal indicates a subsequent image-capture signal is likely to be received, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises detecting a portion of the motion sensor data that indicates visual fixation on a location in an environment of the computing device, wherein the portion of the motion sensor data comprises motion sensor data processed to determine whether or not there is motion indicative of staring at the location for at least a predetermined period of time; and

in response to detecting the at least one pre-image-capture signal, causing the computing device to initiate an image-capture preparation process that powers on the at least one image sensor to put the image-capture device in an image-ready state.

12. The method of claim 11, wherein the computing device is configured to capture an image in response to detection of a wink signal.

13. The method of claim 11, wherein analyzing the sensor data to detect the at least one pre-image-capture signal further comprises detecting sensor data that is indicative of a hand within a certain distance from an interface feature, wherein the interface feature is usable to initiate the subsequent image-capture signal.

14. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions comprising:

receiving sensor data from one or more sensors associated with a computing device, wherein the computing device comprises an image-capture device having at least one image sensor, wherein the sensor data is received while the computing device is powered on and the at least one image sensor is powered off;

analyzing the sensor data to detect at least one pre-image-capture signal, wherein the at least one pre-image-capture signal indicates a subsequent image-capture signal is likely to be received, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises processing a portion of the motion sensor data to determine whether or not there is motion that indicates visual fixation on a location in an environment of the computing device, wherein the portion of the motion sensor data comprises motion sensor data indicative of staring at the location for at least a predetermined period of time; and

in response to detecting the at least one pre-image-capture signal, causing the computing device to initiate an image-capture preparation process that powers on the at least one image sensor to put the image-capture device in an image-ready state.

15. The non-transitory computer readable medium of claim 14, wherein the computing device is configured to capture an image in response to detection of a wink signal.