Video summary including a particular person

• US 9,013,604 B2
• Filed: 12/27/2013
• Issued: 04/21/2015
• Est. Priority Date: 05/18/2011
• Status: Active Grant

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Intellectual Ventures Fund 83 LLC (Intellectual Ventures LLC)
• Inventors: Karn, Keith Stoll, Pillman, Bruce Harold, Deever, Aaron Thomas, McCoy, John Robert, Razavi, Frank, Gretzinger, Robert
• Primary Examiner(s): SELBY, GEVELL V
• Application Number:
  US14/141,642
• Publication Number:
  US 20140105500A1
• Time in Patent Office: 480 Days
• Field of Search: 348/208.14, 348/222.1, 348/231.99, 348/231.3
• US Class Current: 348/231.99
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

A digital video camera system that provides a video summary using a method that includes: designating a reference image containing a particular person; capturing a video sequence of the scene using the image sensor, the video sequence including a time sequence of image frames; processing the captured video sequence using a video processing path to form a digital video file; during the capturing of the video sequence, analyzing the captured image frames using a person recognition algorithm to identify a subset of the image frames that contain the particular person; forming the video summary including fewer than all of the image frames in the captured video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the particular person; storing the digital video file in the storage memory; and storing a representation of the video summary in the storage memory.

Claims

1. A method comprising:

receiving a designation regarding a reference image, wherein the reference image contains a particular person;

analyzing, using a processing system, image frames to identify a subset of the image frames that contain the particular person;

forming, using the processing system, a summary including fewer than all of the image frames, wherein the summary includes at least part of the identified subset of image frames containing the particular person; and

storing the summary in storage memory as a separate summary file.

2. The method of claim 1, wherein the image frames are analyzed using a person recognition algorithm.

3. The method of claim 1, further comprising capturing the reference image using an image sensor.

4. The method of claim 1, wherein the image frames are analyzed using a facial recognition algorithm.

5. The method of claim 1, wherein the summary comprises a video summary.

6. The method of claim 5, wherein the video summary also includes additional image frames besides the identified subset of image frames containing the particular person.

7. The method of claim 5, wherein the video summary is a collection of still images selected from the identified subset of image frames containing the particular person.

8. The method of claim 1, wherein the reference image is downloaded to a digital video camera system.

9. An apparatus comprising a processing system, wherein the processing system comprises a processor and a storage memory, and the processing system is configured to:

receive a designation with respect to a reference image, wherein the reference image contains a particular person;

analyze, using the processor, image frames to identify a subset of the image frames that contain the particular person;

form a summary including fewer than all of the image frames, wherein the summary includes at least part of the identified subset of image frames containing the particular person; and

store the summary in the storage memory as a separate summary digital video file.

10. The apparatus of claim 9, wherein the image frames are analyzed using a facial recognition algorithm.

11. The apparatus of claim 10, wherein the summary comprises a video summary.

12. The apparatus of claim 11, wherein the video summary also includes additional image frames besides the identified subset of image frames containing the particular person.

13. The apparatus of claim 11, wherein the video summary is a collection of still images selected from the identified subset of image frames containing the particular person.

14. A non-transitory computer readable medium having stored thereon instructions executable to cause a processing system to perform functions, the functions comprising:

receiving a designation regarding a reference image, wherein the reference image contains a particular person;

analyzing, using a processing system, image frames to identify a subset of the image frames that contain the particular person;

forming, using the processing system, a summary including fewer than all of the image frames, wherein the summary includes at least part of the identified subset of image frames containing the particular person; and

storing the summary in storage memory as a separate summary file.

15. The computer readable medium of claim 14, wherein the image frames are analyzed using a facial recognition algorithm.

16. The computer readable medium of claim 14, wherein the summary comprises a video summary.

17. The computer readable medium of claim 16, wherein the video summary also includes additional image frames besides the identified subset of image frames containing the particular person.

18. The computer readable medium of claim 16, wherein the video summary is a collection of still images selected from the identified subset of image frames containing the particular person.