Augmented video capture

• US 9,794,475 B1
• Filed: 11/06/2014
• Issued: 10/17/2017
• Est. Priority Date: 01/29/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Tome, Basheer, Raffle, Hayes Solos
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): Kao, Yih-Sien
• Application Number:
  US14/535,037
• Time in Patent Office: 1,076 Days
• Field of Search: None
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

Embodiments described herein may allow for dynamic image capture based on biometric data. An example device may include an image-capture device and a control system configured to: cause the image-capture device to capture video data; receive biometric data, which may be generated synchronously with the video data, from one or more sensors; while the image-capture device is capturing video data, control at least one image-capture setting of the image capture device based, at least in part, on the biometric data. The at least one image-capture setting affects the captured video data.

Claims

1. A computing device, comprising:

an image-capture device; and

a control system configured to;

cause the image-capture device to capture video data;

receive biometric data from one or more sensors, wherein the biometric data is generated synchronously with the video data, and wherein the biometric data comprises heart rate data;

determine that a first mode of travel is associated with the computing device; and

while the image-capture device is capturing the video data, control at least one image-capture setting of the image capture device based, at least in part, on both (a) the association of the first mode of travel with the computing device and (b) the biometric data, wherein the at least one image-capture setting is controlled so as to increase the rate of image frame capture of the video data based, at least in part, on receiving biometric data indicative of a higher than normal heart rate.

2. The computing device of claim 1, wherein the control system is further configured to cause at least one of the one or more sensors to generate biometric data while the image-capture device captures the video data.

3. The computing device of claim 1, further comprising at least one of the one or more sensors.

4. The computing device of claim 1, wherein the computing device is implemented as part of or takes the form of a head-mountable device (HMD).

5. The computing device of claim 1, wherein the control system is further configured to:

control at least one image-capture setting of the image capture device based, at least in part, on biometric data comprising one or more of;

(a) respiration rate, (b) body temperature, (c) level of perspiration, (d) muscle movement, (e) eye movement, (f) blinking, and (g) speech.

6. The computing device of claim 1, wherein the control system is further configured to:

control at least one image-capture setting of the image capture device based, at least in part, on biometric data collected from a user of the device and comprising one or more of;

(a) speed of travel, (b) altitude, (c) acceleration, (d) cadence of movement, (e) intensity of movement, (f) direction of travel, (g) orientation, (h) gravitational force, (i) inertia, and (j) rotation.

7. The computing device of claim 1, wherein the control system is further configured to:

control at least one image-capture setting of the image capture device based, at least in part, on biometric data comprising one or more of;

(a) location, (b) ambient light intensity, (c) time of day, (d) a type of activity a user is participating in, (e) height of a user, (f) age of a user.

8. The computing device of claim 1, wherein the at least one image-capture setting further relates resolution.

9. The computing device of claim 1, further comprising a display configured to display an indication of the biometric data.

10. The method of claim 1, wherein the first mode of travel is one of a plurality of possible modes of travel.

11. The computing device of claim 5, wherein the one or more sensors comprise one or more biometric sensors selected from the group consisting of:

(a) a heart rate monitor, (b) a respiration rate sensor, (c) a thermometer, (e) a perspiration sensor, (f) a microphone, (g) a decibel meter, (h) a bone conducting transducer, (i) an electromyograph, (j) a strain gauge, and (k) an eye-detection sensor.

12. The computing device of claim 6, wherein the one or more sensors comprise one or more movement or positioning sensors selected from the group consisting of:

(a) an accelerometer, (b) an inertial measurement unit, (c) a proximity sensor;

(d) a microphone;

(e) a gyroscope, (f) a magnetometer, (g) an optical sensor, (h) an ultrasonic sensor, (i) an odometer, and (j) a pedometer.

13. The computing device of claim 7, wherein the one or more sensors comprise one or more contextual sensors selected from the group consisting of:

(a) a location-tracking sensor, (b) light intensity sensor, (c) a clock, and (d) a sensor configured to receive an input from a user.

14. The computing device of claim 8, wherein the control system is configured to increase the rate of image frame capture based, at least in part, on receiving biometric data indicative of falling.

15. The computing device of claim 8, wherein the control system is configured to increase the rate of image frame capture based, at least in part, on receiving biometric data indicative of a higher than normal respiration rate.

16. The method of claim 10, wherein the possible modes of travel comprise two or more of the following modes of travel:

travel by car, walking, travel by aerial vehicle, and travel by bicycle.

17. A method comprising:

receiving, by a computing device, video data from an image-capture device;

receiving, by the computing device, biometric data from one or more sensors, wherein the biometric data is generated synchronously with the video data, and wherein the biometric data comprises heart rate data;

determine that a first mode of travel is associated with the computing device; and

while the image-capture device is capturing the video data, controlling at least one image-capture setting of the image capture device based, at least in part, on both (a) the association of the first mode of travel with the computing device and (b) the biometric data, wherein the at least one image-capture setting is controlled so as to increase the rate of image frame capture of the video data based, at least in part, on receiving biometric data indicative of a higher than normal heart rate.

18. The method of claim 17, further comprising:

causing at least one of the one or more sensors to generate the biometric data while the image-capture device captures the video data.

19. The method of claim 17, wherein the computing device is implemented as part of or takes the form of a head-mountable device (HMD).

20. The method of claim 17, wherein the at least one image capture setting of the image capture device further relates to resolution.

21. The method of claim 17, further comprising displaying an indication of the biometric data on a display in communication with the computing device.

22. A non-transitory computer readable medium having stored therein instructions executable by a processor to cause a computing device to perform functions comprising:

receiving video data from an image-capture device;

receiving biometric data from one or more sensors, wherein the biometric data is generated synchronously with the video data, and wherein the biometric data comprises heart rate data;

determining that a first mode of travel is associated with the computing device; and

while the image-capture device is capturing the video data, controlling at least one image-capture setting of the image capture device based, at least in part, on both (a) the association of the first mode of travel with the computing device and (b) the biometric data, wherein the at least one image-capture setting is controlled so as to increase the rate of image frame capture of the video data based, at least in part, on receiving biometric data indicative of a higher than normal heart rate.

23. The non-transitory computer readable medium of claim 22, wherein the at least one image capture setting of the image capture device further relates to resolution.