Autonomous media capturing

• US 10,334,158 B2
• Filed: 11/03/2015
• Issued: 06/25/2019
• Est. Priority Date: 11/03/2014
• Status: Active Grant

• Current Assignee: Robert John Gove
• Original Assignee: Robert John Gove
• Inventors: Gove, Robert John
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US14/931,755
• Publication Number:
  US 20160127641A1
• Time in Patent Office: 1,330 Days
• Field of Search: None
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G03B 15/006 Apparatus mounted on flying objects
• CPC Class Codes: G03B 2215/00 Special procedures for taking photographs; Apparatus therefor
• CPC Class Codes: G03B 37/00 Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/651 for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A media capture device (MCD) that provides a multi-sensor, free flight camera platform with advanced learning technology to replicate the desires and skills of the purchaser/owner is provided. Advanced algorithms may uniquely enable many functions for autonomous and revolutionary photography. The device may learn about the user, the environment, and/or how to optimize a photographic experience so that compelling events may be captured and composed into efficient and emotional sharing. The device may capture better photos and videos as perceived by one'"'"'s social circle of friends, and/or may greatly simplify the process of using a camera to the ultimate convenience of full autonomous operation.

Claims

1. A system comprising:

at least one situation sensor operative to capture situation data with respect to a subject situation; and

at least one processor operative to;

determine with the electronic device a plurality of scene attributes associated with the subject situation by analyzing the captured situation data;

generate coaching cues based on the plurality of scene attributes, wherein the coaching cues assist a user of the system to compose one of a photograph and a video of the subject situation that emulates a style of a professional photographer or videographer;

if the plurality of scene attributes are characterized to be unsatisfactory for a media capture event, provide the coaching cues as an output operative to instruct the user to adjust a characteristic of the subject situation or a position of the electronic device relative to the subject situation such that the media capture event complies with the style;

instruct the at least one situation sensor to autonomously execute the media capture event to compose one of the photograph and the video of the subject situation without user input when the plurality of scene attributes are characterized to be satisfactory for the media capture event; and

share one of the photograph and the video with at least a subset of an Internet based social network such that the one of the photograph and the video is available for viewing via the Internet based social network.

2. The system of claim 1, wherein the plurality of scene attributes comprise lighting environment of the subject situation and a pose position of the subject situation.

3. The system of claim 1, wherein the plurality of scene attributes comprise at least four of lighting, rule of thirds, emotion-based facial expressions, emotion-based body exoskeleton expressions, audio events of emotion expression, frame composition percentage of a face versus a surrounding environment, blemish avoidance, head tilt, head rotation, and inertia sensing of the electronic device.

4. The system of claim 1, wherein the plurality of scene attributes comprise analytics evaluated by a plurality of photography rules.

5. The system of claim 1, further comprising an output component operative to present the output to the system user.

6. The system of claim 5, wherein the output component comprises at least one of an audio output component, a visual output component, and a haptic output component.

7. The system of claim 1, wherein the coaching cues comprise an instruction operative to instruct the system user to change a characteristic of a facial feature of the subject situation.

8. The system of claim 1, wherein the coaching cues comprise an instruction operative to instruct the system user to change a characteristic of an exoskeletal feature of the subject situation.

9. The system of claim 1, wherein the coaching cues comprise an instruction operative to instruct the system user to change a lighting element of the subject situation.

10. The system of claim 1, wherein the at least one processor is operative to:

determine an emotion associated with the subject situation by analyzing the captured situation data; and

automatically share at least a portion of the captured situation data with at least a subset of a social network based on the determined emotion.

11. The system of claim 10, wherein:

the at least one processor is operative to share the at least a portion of the capture situation data with a first subset of the social network when the determined emotion is a first type of emotion;

the at least one processor is operative to share the at least a portion of the capture situation data with a second subset of the social network when the determined emotion is a second type of emotion;

the first subset of the social network is different than the second subset of the social network; and

the first type of emotion is different than the second type of emotion.

12. The system of claim 10, wherein the processor is further operative to:

receive feedback from the social network based on the shared at least a portion of the captured situation data; and

adjust the determined emotion based on the received feedback.

13. The system of claim 1, wherein the at least one processor is further operative to:

obtain feedback from the Internet based social network; and

incorporate the feedback into the coaching cues.

14. The system of claim 1, wherein the captured situation data comprises audio data.

15. The system of claim 1, wherein the captured situation data further comprises image data.

16. The system of claim 1, further comprising:

a drone capable of flying, the drone housing the at least one situation sensor and the at least one processor, wherein the drone is operative to reposition itself with respect to the subject situation in response to the coaching cues.

17. A method comprising:

capturing situation data with respect to a subject situation using at least one sensor component of an electronic device;

determining with the electronic device a plurality of scene attributes associated with the subject situation by analyzing the captured situation data;

generating coaching cues based on the plurality of scene attributes, wherein the coaching cues assist a user of the electronic device to compose one of a photograph and a video of the subject situation that emulates a style of a professional photographer or videographer;

if the plurality of scene attributes are characterized to be unsatisfactory for a media capture event, providing the coaching cues as an output operative to instruct the user to adjust a characteristic of the subject situation or a position of the electronic device relative to the subject situation such that the media capture event complies with the style;

instructing the at least one sensor component to autonomously execute the media capture event to compose one of the photograph and the video of the subject situation without user input when the plurality of scene attributes are characterized to be satisfactory for the media capture event; and

sharing one of the photograph and the video with at least a subset of an Internet based social network such that the one of the photograph and the video is available for viewing via the Internet based social network.

18. A non transitory computer readable medium comprising computer readable instructions recorded thereon for:

capturing situation data with respect to a subject situation using at least one sensor component of an electronic device;

determining with the electronic device a plurality of scene attributes associated with the subject situation by analyzing the captured situation data;

generating coaching cues based on the plurality of scene attributes, wherein the coaching cues assist a user of the electronic device to compose one of a photograph and a video of the subject situation that emulates a style of a professional photographer or videographer;

if the plurality of scene attributes are characterized to be unsatisfactory for a media capture event, providing the coaching cues as an output operative to instruct the user to adjust a characteristic of the subject situation or a position of the electronic device relative to the subject situation such that the media capture event complies with the style;

instructing the at least one sensor component to autonomously execute the media capture event to compose one of the photograph and the video of the subject situation without user input when the plurality of scene attributes are characterized to be satisfactory for the media capture event; and

sharing one of the photograph and the video with at least a subset of an Internet based social network such that the one of the photograph and the video is available for viewing via the Internet based social network.