System and method for exposing video-taking heuristics at point of capture

• US 8,300,117 B2
• Filed: 03/28/2008
• Issued: 10/30/2012
• Est. Priority Date: 03/28/2008
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Carter, Scott, Doherty, John, Adcock, John
• Primary Examiner(s): KHAN, USMAN A
• Application Number:
  US12/058,620
• Publication Number:
  US 20090244323A1
• Time in Patent Office: 1,677 Days
• Field of Search: 348/239, 348/208.14, 348/208.15, 348/333.04, 348/169
• US Class Current: 348/239
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence

Abstract

Described is a system and methods for embedding standard video-taking heuristics into video-recording devices to help improve the quality of captured video for consumer devices. The described approach uses a combination of audio, visual, and haptic feedback that responds to video as it is recorded. This feedback can help users compose better shots as well as help them develop an understanding of the fundamentals of good video-taking.

Claims

1. A method performed by a camera system, the method comprising:

executing a process, the process performed by the camera system, the process comprising;

a. Obtaining parameters of the camera system;

b. Determining a composition of a video shot;

c. Analyzing the parameters of the camera system and the composition of the video shot;

d. Providing a notification to a user, the notification being based on a result of the analyzing and being indicative of a behavior of the user, the behavior having a potential to negatively impact a quality of a video; and

e. Recommending a corrective action to the user in real time, to correctly capture a subject in the video shot, based on the analyzing of the parameters of the camera system and the composition of the video shot;

wherein the recommending the corrective action to the user is based on a template selected from a plurality of predetermined genre-sensitive templates;

wherein the video shot is recorded by the camera system in real time; and

wherein the recommending the corrective action to the user is conducted while the video shot is recorded.

2. The method of claim 1, wherein the analyzing comprises performing face recognition in the video shot and determining whether the subject is about to be lost.

3. The method of claim 1, wherein the parameters of the camera system comprise motion information obtained using a motion sensor and wherein the analyzing comprises performing a motion detection.

4. The method of claim 3, wherein the notification is indicative of an excessive motion of the camera system.

5. The method of claim 1, wherein the analyzing comprises performing a motion detection of the camera system using the video shot.

6. The method of claim 1, wherein the analyzing comprises detecting an irregular zooming of the camera system.

7. The method of claim 1, wherein the parameters of the camera system comprise an audio signal and wherein the analyzing comprises detecting a cross-talk.

8. The method of claim 1, wherein the analyzing comprises detecting and erratic, rapid, or excessive panning.

9. The method of claim 1, wherein the notification to the user comprises a haptic feedback.

10. The method of claim 1, wherein the notification to the user comprises an audio feedback.

11. The method of claim 1, wherein the notification to the user comprises a visual feedback.

12. A method performed by a camera system, the method comprising:

executing a process, the process performed by the camera system, the process comprising;

Obtaining at least one parameter of the camera system or at least one environmental parameter;

Analyzing the at least one parameter of the camera system or the at least one environmental parameter;

Providing a haptic notification to a user, the notification being based on a result of the analyzing; and

Recommending a corrective action to the user in real time, to correctly capture a subject in the video shot, based on the analyzing of the parameters of the camera system and the composition of the video shot;

wherein the recommending the corrective action to the user is based on a template selected from a plurality of predetermined genre-sensitive templates;

wherein the camera system records a video shot in real time; and

wherein the recommending the corrective action to the user is conducted while the video shot is recorded.

13. A camera system comprising:

A memory module operable to store parameters of the camera system;

A digital imager operable to provide information on a composition of a video shot;

An analysis module operable to analyze the parameters of the camera system and the composition of the video shot; and

A notification module operable to provide a notification to a user, the notification being based on a result of the analyzing and being indicative of a behavior of the user, the behavior having a potential to negatively impact a quality of a video, the notification module being further operable to recommend a corrective action to the user in real time, to correctly capture a subject in the video shot, based on the analyzing of the parameters of the camera system and the composition of the video shot;

wherein the recommending the corrective action to the user is based on a template selected from a plurality of predetermined genre-sensitive templates;

wherein the video shot is recorded by the camera system in real time; and

wherein the recommending the corrective action to the user is conducted while the video shot is recorded.

14. The camera system of claim 13, wherein the analyzing comprises performing face recognition in the video shot and determining whether the subject is about to be lost.

15. The camera system of claim 13, wherein the parameters of the camera system comprise motion information obtained using a motion sensor and wherein the analyzing comprises performing a motion detection.

16. The camera system of claim 15, wherein the notification is indicative of an excessive motion of the camera system.

17. The camera system of claim 13, wherein the analyzing comprises performing a motion detection of the camera system using the video shot.

18. The camera system of claim 13, wherein the analyzing comprises detecting an irregular zooming of the camera system.

19. The camera system of claim 13, wherein the parameters of the camera system comprise an audio signal and wherein the analyzing comprises detecting a cross-talk.

20. The camera system of claim 13, wherein the analyzing comprises detecting and erratic, rapid, or excessive panning.

21. The camera system of claim 13, wherein the notification to the user comprises a haptic feedback.

22. The camera system of claim 13, wherein the notification to the user comprises an audio feedback.

23. The camera system of claim 13, wherein the notification to the user comprises a visual feedback.

24. A camera system comprising:

A memory module operable to store at least one parameter of the camera system or at least one environmental parameter;

An analysis module operable to analyze the at least one parameter of the camera system or the at least one environmental parameter;

A notification module operable to provide a haptic notification to a user, the notification being based on a result of the analyzing; and

is operable to recommend a corrective action to the user in real time, for correctly capturing a subject in the video shot, based on the analyzing of the parameters of the camera system and the composition of the video shot;

wherein the recommending the corrective action to the user is based on a template selected from a plurality of predetermined genre-sensitive templates;

wherein the camera system records a video shot in real time; and

wherein the recommending the corrective action to the user is conducted while the video shot is recorded.

25. A non-transitory computer readable medium comprising a set of instructions, the set of instructions when executed by one or more processors of a camera system causing the one or more processors to:

a. Obtain parameters of the camera system;

b. Determine a composition of a video shot;

c. Analyze the parameters of the camera system and the composition of the video shot;

d. Provide a notification to a user, the notification being based on a result of the analyzing and being indicative of a behavior of the user, the behavior having a potential to negatively impact a quality of a video; and

e. Recommend a corrective action to the user in real time, to correctly capture a subject in the video shot, based on the analyzing of the parameters of the camera system and the composition of the video shot;

wherein the recommending the corrective action to the user is based on a template selected from a plurality of predetermined genre-sensitive templates;

wherein the video shot is recorded by the camera system in real time; and

wherein the recommending the corrective action to the user is conducted while the video shot is recorded.