Method and system for displaying selected portions of a motion video image

• US 5,532,833 A
• Filed: 05/11/1994
• Issued: 07/02/1996
• Est. Priority Date: 10/13/1992
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kaneko, Toyohisa, Takahashi, Junichi, Hong, Jung-Kook
• Primary Examiner(s): Tran, Thai Q.
• Application Number:
  US08/240,803
• Time in Patent Office: 783 Days
• Field of Search: 358/335, 358/310, 358/342, 358/311, 358/322, 360/14.1, 360/14.2, 360/14.3, 360/13
• US Class Current: 386/241
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G11B 17/005 Programmed access to indexed parts of tracks of operating discs, by guiding the disc
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/2587 Laser Discs; Optical disc using analog recording
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A method for storing and managing motion video image information for retrieving scenes of interest in a short time from a many-hour motion video image stored in a recording medium. As motion video image information for managing and retrieving a motion video image, a whole motion video image R is hierarchically divided into frame sequences A, A1, A11 . . . of shorter time according to the construction and the semantic contents thereof, and logical frame structure data representing the hierarchical relationship of the frame sequences, attribute data At of the frame sequences, and still video images rf of representative frames are generated, which are associated with each other to create a data file. Retrieval of a motion video image is performed by extracting frame sequences using the attribute data and logical frame structure as retrieval keys for the data file of the motion video image information, and confirming the contents using the still video image rf of the representative frames. Any scene can be randomly accessed and associated scenes can also be retrieved easily, and thus a motion video image of interest can quickly be retrieved from a many-hour motion video image.

Claims

1. A motion video image retrieval system for retrieving and displaying a desired portion of a sequence of still video image frames forming a motion video image, said system comprising:

memory means, distinct from said motion video image, comprising;

means for storing frame sequence data indicating the organization of said motion video image into a plurality of still video image frame sequences according to physical or semantic changes in scenes of said motion video image, means for storing still video image data frames representative of individual still video image frames of each of said frame sequences,

means for storing logical frame structure data of said frame sequences, and

means for storing attribute data for each of said frame sequences;

means for retrieving from said memory means a representative frame selected from said still video image data frames, corresponding to said logical frame structure and said attribute data for a selected frame sequence as selected by a user of said system; and

means for displaying said retrieved representative frame of said still video image data frames from said retrieving means, on a video display, said retrieved representative frame being said desired portion of said motion video image.

2. A system as recited in claim 1, further comprising:

frame sequence generating means for organizing said individual frames of said motion video image into frame sequences according to changing scenes of said motion video image and for generating said frame sequence data;

means for determining a corresponding representative frame for each of said frame sequences and for generating said still video image data frames; and

means for creating said attribute data for each of said frame sequences.

3. A system as recited in claim 2, wherein said frame sequence generating means comprises a scene change detector for detecting changes in scenes of said motion video image.

4. A system as recited in claim 1, further comprising:

logical frame structure creating means for creating a logical frame structure to describe the logical structure of said frame sequences while subdividing and merging said frame sequences into a frame inclusion relationship and for generating said logical frame structure data.

5. A system as recited in claim 4, wherein said logical frame sequence creating means automatically organizes frames of said motion video image into frame sequences according to an inclusion relationship, and wherein said logical frame structure creating means divides and merges said frame sequences into a logical frame structure according to user input.

6. A motion video image retrieval system for displaying a desired portion of a motion video image formed of a sequence of individual still video image frames, said system comprising:

means for storing a motion video image;

frame sequence generating means for organizing individual frames of said motion video image into frame sequences according to scene changes in said motion video image and for generating frame sequence information indicative thereof;

representative frame creating means for determining frames representative of said frame sequences and creating a still video image data frame for each of said representative frames;

logical frame structure creating means for creating a logical structure of said frame sequences, and for generating logical frame structure data indicative thereof,

means for creating said attribute data for each of said frame sequences,

memory means comprising;

means for storing frame sequence data indicating the organization of said motion video image into a plurality of frame sequences according to physical or semantic changes of said motion video image, and including said frame sequence information,

means for storing said still video image data frames, distinct from said motion video image, for each of said representative frames of said frame sequences,

means for storing said logical frame structure data, and

means for storing said attribute data for each of said frame sequences;

means for retrieving from said memory means a still video image data frame, corresponding to logical frame structure data and said attribute data for a selected frame sequence as selected by a user of said system;

means for displaying at least one of a still image from said retrieval means of said representative frame from said still video image data frames, according to said logical frame structure data and said attribute data corresponding to said selected frame sequence, and an entire selected frame sequence of frames from said still video image data frames on a TV monitor responsive to logical frame structure data and attribute data entered by a user.

7. A motion video image retrieval system as recited in claim 6, wherein said logical frame structure creating means automatically creates a logical structure of said frame sequences while subdividing and merging said frame sequences according to a frame inclusion relationship.

8. A method for displaying a desired portion of a motion video image formed of a sequence of individual still video image frames, said method comprising:

storing frame sequence data, within a memory which is distinct from said motion video image, indicating the organization of said motion video image into a plurality of frame sequences according to physical or semantic changes in scenes of said motion video image, storing still video image data frames representative of individual frames of said frame sequences, storing logical frame structure data describing a logical frame structure of said frame sequences, and storing attribute data for each of said frame sequences;

retrieving from said memory an individual frame, the representative still video image data frame of which corresponds to logical frame structure data and attribute data for a selected frame sequence as selected by a user of said system; and

displaying said individual frame, on a video display, said individual frame being said desired portion of said motion video image.

9. A method as recited in claim 8, further comprising the steps of:

organizing individual frames of said motion video image into frame sequences according to changes in scenes of said motion

video image and including data indicative thereof in said stored frame sequence data;

creating attribute data for each of said frame sequences and including said attribute data in said stored attribute data; and

determining a corresponding representative frame for each of said sequences and including said representative frames in said stored still video image data frames.

10. A method as recited in claim 8, wherein said logical frame structure of said frame sequences is created by subdividing and merging said frame sequences according to a frame inclusion relationship.

11. A method as recited in claim 8, further comprising:

displaying still images of said frame sequences on said display.

12. A method as recited in claim 8, wherein said logical frame structure is created by dividing and merging said frame sequences according to user input.