Producing output video from multiple media sources including multiple video sources

• US 20080019661A1
• Filed: 07/18/2006
• Published: 01/24/2008
• Est. Priority Date: 07/18/2006
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Obrador, Pere, Girshick, Sahra Reza, Zhang, Tong
• Application Number:
  US11/488,556
• Publication Number:
  US 20080019661A1
• Time in Patent Office: Days
• US Class Current: 386/52
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

Systems and methods of producing an output video are described. In one approach, respective frame scores are assigned to video frames of input videos containing respective sequences of video frames. Shots of consecutive video frames are selected from the input videos based at least in part on the assigned frame scores. An output video is generated from the selected shots.

Claims

1. A method of producing an output video, comprising:

assigning respective frame scores to video frames of input videos containing respective sequences of video frames;

selecting shots of consecutive video frames from the input videos based at least in part on the assigned frame scores; and

generating an output video from the selected shots.

2. The method of claim 1, wherein the selecting comprises:

identifying segments of consecutive video frames of the input videos based at least in part on a thresholding of the assigned frame scores; and

ascertaining sets of coincident sections of respective ones of the segments identified in different ones of the input videos that have coincident temporal metadata.

3. The method of claim 2, wherein the selecting comprises selecting from each of the ascertained sets a respective shot corresponding to the coincident section highest in frame score.

4. The method of claim 2, wherein the selecting comprises identifying ones of the coincident sections in each of the ascertained sets containing image content from different scenes, and selecting each of the identified sections as a respective shot.

5. The method of claim 1, wherein the selecting comprises temporally dividing the video frames of the input videos into a series of clusters, and choosing at least one shot from each of the clusters.

6. The method of claim 5, wherein the dividing comprises clustering the video frames into contemporaneous groups based on temporal metadata associated with the video frames.

7. The method of claim 5, wherein the choosing comprises selecting a shot corresponding to a section of one of the input videos that is associated with temporal metadata that coincides with temporal metadata associated with a respective section of another one of the input videos.

8. The method of claim 1, further comprising assigning respective image quality scores to still images and choosing ones of the still images based at least in part on the assigned image quality scores, wherein the generating comprises generating the output video from the selected shots and the chosen still images.

9. The method of claim 8, wherein the choosing comprises choosing ones of the still images based at least in part on a thresholding of the image quality scores.

10. The method of claim 8, wherein the choosing comprises choosing ones of the still images respectively associated with temporal metadata that is free of overlap with temporal metadata respectively associated with any of the selected shots.

11. The method of claim 8, wherein the generating comprises chronologically integrating the chosen still images with the selected shots in accordance with temporal metadata respectively associated with the chosen still images and the selected shots.

12. The method of claim 11, wherein the integrating comprises identifying ones of the chosen still images respectively associated with temporal metadata that is coincident with temporal metadata respectively associated with coincident ones of the selected shots, and inserting the identified ones of the chosen still images into the output video at locations adjacent to the coincident ones of the selected shots.

13. The method of claim 1, further comprising, before the assigning, color correcting the video frames of the input videos.

14. The method of claim 1, further comprising cropping the video frames of the selected shots to a common aspect ratio.

15. The method of claim 1, wherein the generating comprises integrating content from media sources including the input videos that are respectively associated with temporal metadata having a collective extent and ensuring that the output video has a length that is at most coextensive with that collective extent.

16. A system for producing an output video, comprising:

a frame scoring module operable to assign respective frame scores to video frames of input videos containing respective sequences of video frames;

a shot selection module operable to select shots of consecutive video frames from the input videos based at least in part on the assigned frame scores; and

an output video generation module operable to generate an output video from the selected shots.

17. The system of claim 16, wherein the shot selection module is operable to identify segments of consecutive video frames of the input videos based at least in part on a thresholding of the assigned frame scores, and ascertain sets of coincident sections of respective ones of the segments identified in different ones of the input videos that have coincident temporal metadata.

18. The system of claim 16, wherein the shot selection module is operable to temporally divide the video frames of the input videos into a series of clusters, and choosing at least one shot from each of the clusters.

19. The system of claim 16, further comprising an image scoring module operable to assign respective image quality scores to still images, and an image selection module operable to choose ones of the still images based at least in part on the assigned image quality scores, wherein the output video generation module is operable to generate the output video from the selected shots and the chosen still images.

20. A system for producing an output video, comprising:

means for assigning respective frame scores to video frames of input videos containing respective sequences of video frames;

means for selecting shots of consecutive video frames from the input videos based at least in part on the assigned frame scores; and

means for generating an output video from the selected shots.