Video booklet
First Claim
1. A method implemented at least in part by a computing device executing computer-executable instructions stored in storage media, the method comprising:
- dividing a video recording into segments;
deriving, for each segment, a digital thumbnail image to represent the segment, the digital thumbnail image comprising a photo of a scene of the segment;
reshaping the thumbnail images using a pre-trained shape template such that each thumbnail image comprises an outline shape contour surrounding the photo;
storing the digital thumbnail images that represent the segments in a database;
printing each digital thumbnail image on paper to create a paper collection of thumbnail images;
receiving one of the printed thumbnail images as digital image information captured by a camera as a result of a user taking a photograph of the printed thumbnail image and providing the photograph of the printed thumbnail image to the computing device;
identifying the outline shape contour of the thumbnail image using an active shape model search;
based upon the identification, restoring the thumbnail image to a pre-trained template shape of the digital thumbnail image;
matching, by the computing device, the photograph of the printed thumbnail image with one of the corresponding digital thumbnail images stored in the database; and
retrieving and playing, by the computing device, the segment represented by the corresponding digital thumbnail image determined to match the received photograph.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are described for creating a video booklet that allows browsing and search of a video library. In one implementation, each video in the video library is divided into segments. Each segment is represented by a thumbnail image. Signatures of the representative thumbnails are extracted and stored in a database. The thumbnail images are then printed into an artistic paper booklet. A user can photograph one of the thumbnails in the paper booklet to automatically play the video segment corresponding to the thumbnail. Active shape modeling is used to identify and restore the photo information to the form of a thumbnail image from which a signature can be extracted for comparison with the database.
86 Citations
18 Claims
-
1. A method implemented at least in part by a computing device executing computer-executable instructions stored in storage media, the method comprising:
-
dividing a video recording into segments; deriving, for each segment, a digital thumbnail image to represent the segment, the digital thumbnail image comprising a photo of a scene of the segment; reshaping the thumbnail images using a pre-trained shape template such that each thumbnail image comprises an outline shape contour surrounding the photo; storing the digital thumbnail images that represent the segments in a database; printing each digital thumbnail image on paper to create a paper collection of thumbnail images; receiving one of the printed thumbnail images as digital image information captured by a camera as a result of a user taking a photograph of the printed thumbnail image and providing the photograph of the printed thumbnail image to the computing device; identifying the outline shape contour of the thumbnail image using an active shape model search; based upon the identification, restoring the thumbnail image to a pre-trained template shape of the digital thumbnail image; matching, by the computing device, the photograph of the printed thumbnail image with one of the corresponding digital thumbnail images stored in the database; and retrieving and playing, by the computing device, the segment represented by the corresponding digital thumbnail image determined to match the received photograph. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method implemented at least in part by a computing device executing computer-executable instructions stored in a storage media, comprising:
-
accessing, by the computing device, a video recording of a video collection for segmenting the video recording; dividing, by the computing device, the video recording into a plurality of segments by dividing the video recording into scenes, shots, and sub-shots based on one of discontinuities of timestamps, discontinuities of color, discontinuities of intensity, or discontinuities of camera motion; representing, by the computing device, each segment of the video recording with a thumbnail image, the thumbnail image comprising a photo of a scene of the segment, wherein the thumbnail image to represent a particular segment is selected by; selecting multiple video frames from the particular segment to each be a candidate thumbnail image for representing the particular segment, for each candidate thumbnail image, extracting a digital signature based on an intensity distribution, and selecting the candidate thumbnail image that best maximizes signature differences between the representative thumbnail and other representative thumbnails selected to represent other respective segments of the video recording, based on a comparison between the candidate thumbnail image and the representative thumbnail images selected to represent other respective segments; reshaping the thumbnail images using a pre-trained shape template such that each thumbnail image comprises an outline shape contour surrounding the photo; storing, by the computing device, each thumbnail image selected to represent a corresponding segment in a database, wherein each segment of the video recording is capable of being retrieved via the corresponding thumbnail image; printing the thumbnail images representing each segment of the video recording onto paper to create a paper collection of the thumbnail images corresponding to the segments of the video recording; receiving as input a digitally photographed image of one of the printed thumbnail images printed onto the paper, wherein the digitally photographed image is received by the computing device via a wireless transmission from a photo imaging device including a camera that took the digitally photographed image; identifying the outline shape contour of the thumbnail image; based upon the identification, restoring the thumbnail image to a pre-trained template shape of the digital thumbnail image; matching the digitally photographed image of the one of the printed thumbnail images with a corresponding representative thumbnail image stored in the database; and identifying one of the segments of the video recording corresponding to the matching thumbnail image for playing back the segment of the video recording represented by the matching thumbnail image that matches the digitally photographed image, wherein at least one printed thumbnail image is digitally photographed to play back the corresponding segment of the video recording. - View Dependent Claims (17)
-
-
18. A system, comprising:
-
a processor; a memory communicatively coupled to the processor, the memory comprising components including; a generating engine component configured for segmenting a video recording into a plurality of segments, representing each video segment with a corresponding digital thumbnail image, the digital thumbnail image comprising a photo of a scene of the segment, reshaping the thumbnail images using a pre-trained shape template such that each thumbnail image comprises an outline shape contour surrounding the photo, storing the digital thumbnail image representing each video segment in a database and printing each digital thumbnail image stored in the database on paper; and a browsing engine component configured for receiving as input a digital photograph of one of the printed thumbnail images as digital image information captured by a camera, identifying the outline shape contour of the thumbnail image using an active shape model search, restoring the thumbnail image to a pre-trained template shape of the digital thumbnail image, and referring to the database to locate a video segment corresponding to the digital image information captured by the camera by matching the digital image information captured by the camera with one of the thumbnail images stored in the database for playing the video segment corresponding to the digital image information captured by the camera.
-
Specification