Method and system for onboard camera video editing

• US 20070283269A1
• Filed: 05/31/2006
• Published: 12/06/2007
• Est. Priority Date: 05/31/2006
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Obrador, Pere, Zhang, Tong
• Application Number:
  US11/443,250
• Publication Number:
  US 20070283269A1
• Time in Patent Office: Days
• US Class Current: 715/723
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

A method and system are disclosed for onboard camera video editing. A video clip is segmented into at least one video segment having frames and the video quality of at least one frame is assessed to derive a quality score per frame and an average quality score for the video segment. To optimize quality of the video captured and to increase free memory space, at least one video segment is removed from the digital memory based on the quality score per frame and the average quality score.

Claims

1. An onboard camera video editing system having a digital memory to capture video, the system comprising:

a video segmentation unit which segments a video clip into one or more video segments having frames;

a video quality assessment unit which assesses video quality of at least one frame and derives a quality score per frame and an average quality score for the video segment; and

a video quality optimizer which removes at least one video segment with low quality from the digital memory to provide increased free memory space for future video capture.

2. The onboard camera video editing system according to claim 1, wherein the video segmentation unit segments video into semantic units.

3. The onboard camera video editing system according to claim 2, wherein segmenting video into semantic units is conducted by analyzing at least one video features chosen from the group comprising camera motion, color histogram, audio events and other low level audio and video features.

4. The onboard camera video editing system according to claim 1, wherein the video quality assessment unit evaluates video quality using high and low level features.

5. The onboard camera video editing system according to claim 1, comprising an estimation unit which estimates user'"'"'s subjective pressure in relation to memory usage.

6. The onboard camera video editing system according to claim 1, comprising a user interactive unit which provides the user advice on how to manage the digital memory or the video quality.

7. The onboard camera video editing system according to claim 1, wherein the onboard camera video editing system optimizes the video quality when not in a video capture mode.

8. The onboard camera video editing system according to claim 1, wherein a conservative mode and a fully automatic mode are provided for video editing.

9. The onboard camera video editing system according to claim 1, wherein video quality of each μ

-shot and frames within it are assessed by detecting and analyzing at least one video feature chosen from the group comprising camera motion, luminance histogram analysis to identify bad exposure, out-of-focus detection, brightness, noisy frame detection, shaking and rotation, periodic camera motion or large amplitude of rotation detection, audio highlights detection, face detection, and detection of other metadata at different levels.

10. A video editing method to edit captured video for a digital memory, the method comprising:

segmenting a video clip into at least one video segment having frames;

assessing the video quality of at least one frame to derive a quality score per frame and an average quality score for the video segment; and

removing at least one video segment from the digital memory based on the quality score per frame and the average quality score to optimize quality of the video captured in the digital memory and to increase free memory space.

11. The video editing method according to claim 10, wherein the segmenting of a video clip segments video into semantic units.

12. The video editing method according to claim 10, wherein the assessment of the video quality uses high and low level features.

13. The video editing method according to claim 10, comprising an estimation unit which estimates user'"'"'s subjective pressure in relation to memory usage.

14. The video editing method according to claim 10, comprising providing the user advice on how to manage the digital memory or the video quality.

15. The video editing method according to claim 10, wherein the video quality is optimized when not in a video capture mode.

16. The video editing method according to claim 10, wherein a conservative mode and a fully automatic mode are provided for video editing.

17. The video editing method according to claim 10, wherein video quality of each μ

-shot and frames within it are assessed by detecting and analyzing at least one video feature chosen from the group comprising camera motion, histogram analysis to identify bad exposure, out-of-focus detection, brightness, noisy frame detection, shaking and rotation, periodic camera motion or large amplitude of rotation detection, audio highlights detection, face detection, and detection of other metadata at different levels.

18. The video editing method according to claim 10, wherein the method is used to edit captured video for a digital memory, such as a random access memory, other solid-state memory, blue ray disc, and various forms of HD DVD.

19. A computer-readable medium having a program executable to edit captured video for consistency in visual quality, the program implementing a method comprising:

receiving μ

-shots for storage in a digital memory;

erasing segments of a given μ

-shot to achieve a level of overall quality Q_overall of modified μ

-shots for storage in the digital memory.

20. The computer-readable medium according to claim 19, wherein, if the segments remaining in the memory possess higher quality levels than a given threshold quality value, then at least one of the following steps are taken to further free up the digital memory:

recompressing a given segment to a higher compression ratio, downsampling, and removing the bulk of a given segment.

21. The computer-readable medium according to claim 19, wherein:

Q_overall=Σ

{circumflex over (Q)}_i/N;

{circumflex over (Q)}_i quantifies modified μ

-shot quality; and

N is the number of modified μ

-shots in the digital memory.

22. The computer-readable medium according to claim 21, wherein the modified μ

-shot quality {circumflex over (Q)}_i is based on at least one of;

f_i=a function of μ

-shot recompression;

f_i′

=a function of μ

-shot down sampling; and

f_i″

=a function of frame deletions.