Preparation of image capture device in response to pre-image-capture signal

• US 9,223,136 B1
• Filed: 02/04/2013
• Issued: 12/29/2015
• Est. Priority Date: 02/04/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Braun, Max Benjamin, Brin, Sergey, Malkin, Peter Kenneth
• Primary Examiner(s): Sitta, Grant
• Assistant Examiner(s): Hermann, Kirk
• Application Number:
  US13/758,888
• Time in Patent Office: 1,058 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 25/709 Circuitry for control of the power supply

Abstract

Embodiments may be implemented by a computing device, such as a head-mountable display or mobile phone, in order to pre-emptively warm up the device'"'"'s camera, when it is probable that a user will be taking a photo. An illustrative method involves a computing device (a) receiving sensor data from one or more sensors associated with the computing device, wherein the computing device comprises an image-capture device, (b) analyzing the sensor data to detect at least one pre-image-capture signal, wherein the at least one pre-image-capture signal indicates a subsequent image-capture signal is likely to be received, and (c) in response to detecting the at least one pre-image-capture signal, causing the computing device to initiate an image-capture preparation process that prepares the image-capture device to capture an image.

Claims

1. A computing device comprising:

an image-capture device comprising at least one image sensor; and

a control system configured to;

while the computing device is powered on and the at least one image sensor is powered off;

(a) receive sensor data from one or more sensors, and (b) analyze the sensor data to detect at least one pre-image-capture signal that indicates a subsequent image-capture signal is likely to be received, wherein the at least one pre-image-capture signal comprises sensor data that corresponds to fixation on a location in an environment of the computing device; and

in response to detection of the at least one pre-image-capture signal, initiate an image-capture preparation process that;

(a) puts the image-capture device in an image-ready state by at least powering on the at least one image sensor, and (b) provides no explicit visual indication that the image-capture device is in the image-ready state.

2. The computing device of claim 1, wherein the computing device is implemented as part of or takes the form of a head-mountable device (HMD).

3. The computing device of claim 1, wherein the control system is further configured to:

subsequent to the detection of the at least one pre-image-capture signal, and while the image-capture device in an image-ready state, receive an image-capture signal; and

in response to detection of the pre-image-capture signal, cause the image-capture device to capture an image.

4. The computing device of claim 1, wherein the control system is further configured to:

after initiating the image-capture preparation process, cause the image-capture device to remain in the image-ready state until either (a) an image-capture signal is received or (b) a predetermined period of time elapses without receipt of an image-capture signal.

5. The computing device of claim 1, wherein the one or more sensors comprise one or more of:

(a) one or more proximity sensors, (b) one or more image-capture devices, (c) one or more microphones, (d) one or more accelerometers, (e) one or more gyroscopes, and (f) one or more magnetometers.

6. The computing device of claim 1, further comprising an eye-tracking system, wherein the one or more sensors are part of an eye-tracking system.

7. The computing device of claim 1, wherein the control system is further configured to:

analyze sensor data to detect a wink signal; and

in response to detection of the wink signal, cause the image-capture device to capture an image.

10. The computing device of claim 1, wherein the at least one pre-image-capture signal comprises a first voice command, wherein the control system is further configured to:

respond to the first voice command by causing the computing device to operate in an image-capture mode; and

while the computing device is operating in the image-capture mode, respond to a second voice command by causing the image-capture device to capture an image.

8. A computing device comprising:

an image-capture device comprising at least one image sensor; and

a control system configured to;

while the computing device is powered on and the at least one image sensor is powered off;

(a) receive sensor data from one or more sensors, and (b) analyze the sensor data to detect at least one pre-image-capture signal that indicates a subsequent image-capture signal is likely to be received, wherein at least one pre-image-capture signal comprises sensor data that is indicative of a closed eye; and

in response to detection of the at least one pre-image-capture signal, initiate an image-capture preparation process that;

(a) puts the image-capture device in an image-ready state by at least powering on the at least one image sensor, and (b) provides no explicit visual indication that the image-capture device is in the image-ready state.

9. A computing device, wherein the computing device is implemented as part of or takes the form of a head-mountable device (HMD), the computing device comprising:

a button interface;

one or more proximity sensors that are arranged to detect a hand that is located near to the button interface;

the image-capture device comprising at least one or more image sensor; and

a control system configured to;

while the computing device is powered on and the at least one image sensor is powered off;

(a) receive sensor data from one or more sensors, and (b) analyze the sensor data to detect at least one pre-image-capture signal that indicates a subsequent image-capture signal is likely to be received, wherein at least one pre-image-capture signal comprises sensor data that is indicative of a hand within a certain distance from the interface feature and separated by air from the interface feature, wherein the interface feature is usable to initiate the subsequent image-capture signal; and

in response to detection of the at least one pre-image-capture signal, initiate an image-capture preparation process that;

(a) puts the image-capture device in an image-ready state by at least powering on the at least one image sensor, and (b) provides no explicit visual indication that the image-capture device is in the image-ready state.

11. A computer-implemented method comprising:

receiving sensor data from one or more sensors associated with a computing device, wherein the computing device comprises an image-capture device having at least one image sensor, wherein the sensor data is received while the computing device is powered on and the at least one image sensor is powered off;

analyzing the sensor data to detect at least one pre-image-capture signal, wherein the at least one pre-image-capture signal indicates a subsequent image-capture signal is likely to be received, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises at least one of (a) detecting sensor data that corresponds to fixation on a location in an environment of the computing device comprises, (b) detecting sensor data that is indicative of a closed eye, or (c) detecting sensor data that is indicative of a hand within a certain distance from an interface feature and separated by air from the interface feature, wherein the interface feature is usable to initiate the subsequent image-capture signal; and

in response to detecting the at least one pre-image-capture signal, causing the computing device to initiate an image-capture preparation process that;

(a) puts the image-capture device in an image-ready state by at least powering on the at least one image sensor, and (b) provides no explicit visual indication that the image-capture device is in the image-ready state.

12. The method of claim 11, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises detecting sensor data that corresponds to fixation on a location in an environment of the computing device.

13. The method of claim 11, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises detecting sensor data that is indicative of a closed eye, wherein the computing device is configured to capture an image in response to detection of a wink signal.

14. The method of claim 11, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises detecting sensor data that is indicative of a hand within a certain distance from an interface feature, wherein the interface feature is usable to initiate the subsequent image-capture signal.

15. The method of claim 11, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises detecting sensor data that is indicative of a first voice command, wherein the computing device is configured to:

(a) respond to the first voice command by causing the computing device to operate in an image-capture mode and (b) while operating in the image-capture mode, respond to a second voice command by causing the image-capture device to capture an image.

16. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions comprising:

receiving sensor data from one or more sensors associated with a computing device, wherein the computing device comprises an image-capture device having at least one image sensor, wherein the sensor data is received while the computing device is powered on and the at least one image sensor is powered off;

analyzing the sensor data to detect at least one pre-image-capture signal, wherein the at least one pre-image-capture signal indicates a subsequent image-capture signal is likely to be received, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises at least one of (a) detecting sensor data that corresponds to fixation on a location in an environment of the computing device comprises, (b) detecting sensor data that is indicative of a closed eye, or (c) detecting sensor data that is indicative of a hand within a certain distance from an interface feature and separated by air from the interface feature, wherein the interface feature is usable to initiate the subsequent image-capture signal; and

in response to detecting the at least one pre-image-capture signal, causing the computing device to initiate an image-capture preparation process that;

(a) puts the image-capture device in an image-ready state by at least powering on the at least one image sensor, and (b) provides no explicit visual indication that the image-capture device is in the image-ready state.

17. The non-transitory computer readable medium of claim 16, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises detecting sensor data that is indicative of a closed eye, wherein the computing device is configured to capture an image in response to detection of a wink signal.

18. The non-transitory computer readable medium of claim 16, wherein analyzing the sensor data to detect the at least one pre-image-capture signal comprises detecting sensor data that is indicative of a first voice command, wherein the computing device is configured to:

(a) respond to the first voice command by causing the computing device to operate in an image-capture mode and (b) while operating in the image-capture mode, respond to a second voice command by causing the image-capture device to capture an image.