Multimedia data presentation device and editing device with automatic default selection of scenes

• US 5,818,435 A
• Filed: 06/12/1995
• Issued: 10/06/1998
• Est. Priority Date: 06/10/1994
• Status: Expired due to Term

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Fletcher, Paul, Rogers, Mark, Yamada, Yasutaka, Cooke, Phil, McGill, Gary, Kozuka, Masayuki, Inoue, Mitsuhiro, Endo, Koichiro
• Primary Examiner(s): Jankus, Almis R.
• Application Number:
  US08/489,344
• Time in Patent Office: 1,212 Days
• Field of Search: 395/806, 395/807, 395/762, 395/173-175, 395/326-332, 395/347-350, 395/352-354, 395/356, 395/357, 395/960-963
• US Class Current: 715/202
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 2220/213 Read-only discs
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 2220/61 wherein solid state memory is used for storing A/V content storing computer data in solid state memories G06F
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/329 on a disc [VTOC]
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

The object of the present invention is to provide a multimedia presentation device which, by executing a setting process for an information block, which is an address of an automatic branch, by means of an automatic discharge process for a button which stores the branch address, enables the user to understand how a branch address was selected. Command discharge condition information is stored the information block reproduction means for managing buttons which are automatically discharged at an end of a reproduction period or other such time, so that by executing a branch process by automatically selecting a button in place of a user operation, then even if there has been no user selection of a branch address before the end of the reproduction period, a branch address can be automatically selected and, by showing on the display the button which for manual selection stores a link to the same branch address, the data can be presented in a form which can readily understood by the user.

Claims

1. A multimedia presentation device, comprising:

information storage means for storing data in the form of information blocks and control information data for managing the information blocks, including a multi-level composition data showing how the information blocks are linked to each other, wherein;

said multi-level composition data provides linkage of a plurality of information blocks which have sibling relations and parent-child relations,

some of the information blocks further have a plurality of child information blocks,

among the information blocks which are parents in a parent-child relation, some are linked so that, even without a user making a selection, a display can advance to a child information block by means of an automatic default mode when a predetermined time period has elapsed, and

said information blocks include at least one of a type one media, such as video, sound and graphics, and a type two media, which include graphic button media elements simulating user control switches which further contain link information for moving from a present information block to another information block;

reproduction control information management means for retrieving the control information data, including the multi-level composition data of the information blocks, from the information storage means;

indication input means for inputting an indication by the user;

information reproduction means for retrieving one information block from the information storage means and reproducing it, visually and aurally presenting to the user any of type one media and any of type two media included in the retrieved information block;

operation time management means for measuring a time of reproduction and presentation of a new information block and for determining whether there is an indication from the indication input means between a start of presentation by the information reproduction means and an expiration of the predetermined time period;

reproduction control means for controlling the information reproduction means so as to retrieve, when there is an indication from the indication input means within the predetermined time period after the start of presentation, an indicated information block from the information storage means, and

so as to retrieve, when the operation time management means determines that there is no indication within the predetermined time period after the start of presentation, an information block which is a child information block which can be automatically replaced for an information block currently being presented; and

movement address display control means for controlling the information reproduction means, when a child information block is to be reproduced by means of the automatic default mode, so as to display, before presenting the child information block, a button media element out of the group two media which shows said child information block in a visually different display format relative to other button media elements, in a same manner as when said button is indicated by a user.

2. The multimedia presentation device of claim 1, wherein the information storage means stores an automatic default mode condition for each parent information block which has a child information block which can be automatically defaulted and

the reproduction control information management means includes:

default condition storage unit for retrieving an automatic default condition from the information storage means and storing it; and

set time rewriting unit for referring, when a new information block reproduced by the information reproduction means has a child block which can be automatically defaulted, to an automatic default condition stored by the storage unit and rewriting a new predetermined time period for the operation time management means.

3. The multimedia presentation device of claim 2, wherein the information blocks have a predetermined route for tracing a course by means of automatic defaulting between upper level information blocks and lower level information blocks.

4. The multimedia presentation device of claim 1, wherein

the information storage means stores automatic default order data, for each parent information block which has a number of child information blocks which can be automatically defaulted, said automatic default order data showing which child information block should be retrieved next by means of automatic default, and

the reproduction control information management means includes:

a discharge order storage unit for retrieving the automatic default order data from the information storage means and storing it; and

a next information block indication unit for referencing, when during reproduction an information block is to be automatically default, a content of the discharge order storage unit and indicating to the reproduction control means a next information block to be reproduced.

5. The multimedia presentation device of claim 1, wherein

the groups of information blocks each include at least one route made up of a grouping of information blocks which are to be automatically reproduced in a predetermined order which does not depend on any operation by the user;

the reproduction control information management means retrieves information relating to the route from the information storage means and stores it;

the indication input means includes a presentation switching operation unit for switching from an information block currently being presented to one of a preceding information block, a following information block, and a parent information block; and

the reproduction control means contains a determination unit for referencing, once a presentation switching means has been operated, a content of the reproduction control information management means, and determining,

when a content of an operation indication is for a presentation switch to a parent information block, if there is a parent information block to which transfer from the information block currently being presented is possible, and

when a content of an operation indication is for a presentation switch to one of a preceding information block and following information block, if the information block currently being presented is part of the linkage,

wherein when the determination result of the determination unit is affirmative, the reproduction control means retrieves an appropriate information block from the information storage means and presents it.

6. The multimedia presentation device of claim 1, further comprising information retrieval means for retrieving an information block and control information from the information storage means and sending the retrieved information block and the retrieved control information to the information reproduction means and the reproduction control information management means,

wherein the information retrieval means includes:

a read head unit for accessing the information storage means and retrieving information blocks and control information;

a communication line for carrying a communication signal to the information reproduction means and the reproduction information control management means; and

a communication control unit for transmitting the retrieved information block and the retrieved control information to the information reproduction means and the reproduction information control management means, according to a fixed communication method.

7. The multimedia presentation device of claim 6,

the information storage means stores an automatic default condition for each parent information block which has a child information block which can be automatically defaulted, and

the reproduction control information management means includes:

discharge condition storage unit for retrieving an automatic default condition from the information storage means and storing it; and

set time rewriting unit for referring, when a new information block reproduced by the information reproduction means has a child block which can be automatically defaulted to an automatic default condition stored by the storage unit and rewriting a set time of the operation time management means.

8. The multimedia presentation device of claim 7, wherein the information blocks have a main route for tracing a course by means of automatic discharging between upper level information blocks and lower level information blocks.

9. The multimedia presentation device of claim 6, wherein

the information storage means stores automatic discharge order data, for each parent information block which has a number of child information blocks which can be automatically discharged, said automatic discharge order data showing which child information block should be retrieved next by means of automatic discharge, and

the reproduction control information management means includes:

a discharge order storage unit for retrieving the automatic discharge order data from the information storage means and storing it; and

a next information block indication unit for referencing, when during reproduction an information block is to be automatically discharged, a content of the discharge order storage unit and indicating to the reproduction control means a next information block to be reproduced.

10. The multimedia presentation device of claim 6, wherein

the groups of information blocks each include at least one route made up of a grouping of information blocks which are to be automatically reproduced in a decided order which does no depend on any operation by the user;

the reproduction control information management means retrieves information relating to the route from the information storage means and stores it;

the indication input means includes a presentation switching operation unit for switching from an information block currently being presented to one of a preceding information block, a following information block, and a parent information block; and

the reproduction control means contains a determination unit for referencing, once the presentation switching means has been operated, a content of the reproduction control information management means, and determining,

when a content of an operation indication is for a presentation switch to a parent information block, if there is a parent information block to which transfer from the information block currently being presented is possible, and

when a content of an operation indication is for a presentation switch to one of a preceding information block and following information block, if the information block currently being presented is on the route,

wherein when the determination result of the determination unit is affirmative, the reproduction control means retrieves an appropriate information block from the information storage means and presents it.

11. An editing device which enables a user to interactively change a presentation order of presentation information which is made up of multimedia data, said editing device comprising:

scene link management information storage means for storing scene link management information made up of link relation information showing which scenes are connected and link type information;

editing information temporary storage means for retrieving the scene link management information from the scene link management information storage means and temporarily storing the scene link management information as edited scene link management information;

input means for receiving an editing request input from an input device, such as a mouse;

editing control means for converting the edited scene link management information stored by the editing information temporary storage means, based on a type two editing request input from the input means;

scene link composition screen generation means for retrieving the edited scene link management information from the editing information temporary storage means, and, in addition to generating a scene figure for expressing a scene as a simplified figure and a scene link line figure for expressing a link between scenes as a line figure, for deciding, based on the edited scene link management information, a format of the scene figure and the scene link line figure and a display position of the scene figure and the scene link figure, thereby generating a scene link composition screen in which at least one scene figure is connected by a scene link line figure; and

display output means for outputting the scene link composition screen generated by the scene link composition screen generation means to an output device.

12. The editing device of claim 11, wherein

the scene link management information is a table which records, for any given scene, scene identifiers for any scenes which are linked to said given scene and information which shows that a relationship linking scenes is one of a parent-child and a sibling relationship,

and the editing control means includes a rewriting unit for rewriting at least one of an appropriate scene identifier and an appropriate relationship in the mid-editing scene link management information stored by the editing information temporary storage means, in accordance with a type one editing request input.

13. The editing device of claim 12, wherein the scene link composition screen generation means includes:

a judgement unit for referencing the mid-editing scene link management information in the editing information temporary storage means and judging what kind of relationship a scene to be drawn has with a scene which has already been drawn; and

a drawing position deciding unit for deciding a drawing position of a simplified figure for a next scene

by setting coordinates of a next drawing position so that the scene to be drawn is displaced at a fixed distance with regard to the scene already drawn in one of main axes, when a judgement result is a sibling relationship, and

by setting coordinates of a next drawing position so that the scene to be drawn is displaced at a fixed distance with regard to the scene already drawn in both of main axes, when a judgement result is a parent-child relationship.

14. The editing device of claim 13, wherein

the scene link management information storage means, in addition to storing the link relation information showing which scenes are connected and the link type information, also stores scene level information which describes interlevel relationships between scenes connected on different levels, and

the scene link composition screen generation means further includes:

a scene detection unit for detecting scenes which have a sub level, out of the mid-editing scene link management information retrieved from the editing information temporary storage means; and

a scene representation figure generation unit for generating, for a detected scene with a sub level, a scene representation figure which is to be displayed in place of all scenes on sub levels.

15. The editing device of claim 14, wherein

the scene link composition screen generation means further includes:

a drawing selection unit for having the scene representation figure generation unit process, when the scene detection unit detects a number of identical scenes with a sub level, all but one of the identical scenes, and for having one remaining scene processed by the judgement unit and drawing position deciding unit so that the one remaining scene is drawn with all scenes on sub levels represented by simplified figures; and

identification mark generation means for displaying scenes out of the identical scenes with a sub level whose sub level is represented by a scene representation figure with different identification marks to a scene out of the identical scenes with a sub level whose sub levels are represented by simplified figures, with an identification mark being positioned next to each respective scene.

16. The editing device of claim 15, wherein

the input means receives a selection indication from the user for selecting which of the identical scenes having a sub level is to be displayed with all of its sub levels represented by simplified figures;

and

the scene link composition screen generation means further includes a drawing selection control unit

for controlling the drawing selection unit, according to a selection indication received by the input means, so as to always display a scene with a sub level indicated by the selection indication with all of its sub levels represented by simplified figures, and

for having other identical scenes displayed with their sub levels represented by scene representation figures.

17. The editing device of claim 11, further including:

scene information storage means for storing source data made up of video, audio, graphics, text and suchlike and scene composition information for composing a scene out of the source data; and

scene editing screen generation means for retrieving scene composition information from the scene information storage means via the editing information temporary storage means and, in addition to generating a scene editing screen for editing scenes, for retrieving the mid-editing scene link management information from the editing information temporary storage means and for generating a list screen of scenes which are linked to a present screen, based on the mid-editing scene link management information, before overwriting the list screen on one area of the scene editing screen,

wherein the scene editing screen generated by the scene editing screen generation means is outputted to the display output means.

18. The editing device of claim 17, wherein the display output means includes a selection unit for alternatively outputting scene link composition screen and the scene editing screen which are inputted into the display output means, wherein the selection unit is operated by means of the input means.

19. An editing device which enables a user to interactively change a presentation order of presentation information which is made up of multimedia data, said editing device comprising:

scene information storage means for storing scene information including source data, made up of video, audio, graphics, text and suchlike, and scene composition information for composing a scene out of the source data;

scene link management information storage means for storing scene link management information made up of link relation information showing which scenes are connected and link type information, as well as scene level information for describing an inter-level relationship for scenes linked on different levels;

editing information temporary storage means for retrieving the scene link management information from the scene link management information storage means and temporarily storing the scene link management information as edited scene link management information;

input means for receiving an editing request input from an input device, such as one of a mouse and a keyboard;

editing control means for converting the edited scene link management information stored by the editing information temporary storage means based on a type one editing request input from the input means, and for converting the scene link management information stored by the storage means to the edited scene link management information stored by editing information temporary storage means, based a type two editing request input from the input means;

scene information retrieval means for retrieving the scene information from the scene information storage means and the scene link management information from the editing information temporary storage means;

scene reproduction screen generation means for generating a scene reproduction screen for reproducing a scene, based on the scene information retrieved by scene information retrieval means;

scene link composition screen generation means for generating a scene figure for expressing a scene as a simplified figure and a scene link line figure for expressing a link between scenes as a line figure, based on the scene link management information retrieved by the scene information retrieval means and for deciding, based on the scene link management information, a format of the scene figure and the scene link line figure and a display position of the scene figure and the scene link line figure, as well as expressing any scenes which have a sub level as scene representation figures and storing a display status for each of the scenes which have a sub level, so that when a same scene with a sub level is simultaneously displayed several times, sub levels belonging to one of the same scenes are displayed and remaining same scenes have their sub levels represented by scene representation figures, thereby generating a scene link composition screen in which at least one scene figure is connected by a scene link line figure, at a same time retrieving information for a scene to be reproduced from the scene information retrieval means and, based on the scene link composition screen, visually changing a scene figure and a scene link line figure corresponding to the scene to be reproduced by the scene reproduction screen generation means; and

display output means for outputting the scene link composition screen generated by the scene link composition screen generation means and the scene reproduction screen generated by the scene reproduction screen generation device to an output device.

20. An editing device for editing a combination of multimedia data, such as video, static images, text and sound, to be reproduced simultaneously, the editing device comprising:

data storage means for storing the multimedia data and data related information;

data retrieval means for retrieving one of the multimedia data and data related information, such as reproduction time, from the data storage means;

period information storage means for storing time period information specifying a reproduction time for each reproduction of multimedia data;

data information storage means for storing a channel number, a period number and an address showing a position where a piece of data is stored in the data storage means;

data indication means for indicating a portion of data, out of the multimedia data stored by the data storage means, which is to be used as editing object data;

time period indication means for indicating a reproduction time period of the newly indicated editing object data;

channel indication means for indicating a channel for reproduction of the newly indicated editing object data;

editing information control means

for storing in the data information storage means the reproduction time period indicated by the time period indication means, the channel indicated by the channel indication means and an address of the editing object data indicated by the data indication means,

for retrieving a data reproduction time for the editing object data indicated by the data indication means from the data retrieval means and a period time of a time period indicated by the period indication means from the period information storage means, before comparing the data reproduction time and the period time, and

for converting, when the data reproduction time is longer than the period time, an appropriate period time in the period information storage means to a value of the data reproduction time, in other cases leaving the period time as it is;

editing information display means for processing information for visually displaying editing information for the multimedia data, based on a content of the period information storage means and on a content of the data information storage means, when a content of one of the period information storage means and the data information storage means is updated by the editing information management means;

reproduction indication input means for inputting an indication for reproducing edited multimedia data;

reproduction control means for retrieving, once a reproduction indication is inputted into the reproduction indication input means, appropriate data from the data storage means based on an address stored by the data information storage means, in accordance with the period information stored by the period information storage means;

image data display means for processing image data to be displayed in the data retrieved by the reproduction control means; and

audio data output means for processing audio data to be outputted in the data retrieved by the reproduction control means.

21. The editing device of claim 20, wherein

the data information storage means stores, in addition to a channel number, a period number, and an address showing a position where data is stored in the data storage means, a reproduction base time which is a necessary time for one reproduction of one portion of data,

the editing information management means stores the data reproduction time, which is one portion of the data related information retrieved by the data retrieval means, as the reproduction base time in the data information storage means,

the editing information display means processes editing information for display by changing, when a reproduction base time in the data information storage means is set a fixed value beforehand, a period time of an appropriate time period to a reproduction time, and

the reproduction control means controls, when a reproduction base time in the data information storage means is set a fixed value beforehand, a change of a period time for an appropriate time period to the reproduction time.

22. The editing device of claim 21, wherein

the data information storage means also stores a remaining time process number,

the editing information control means stores a remaining time process number, which is one portion of the data related information retrieved by the data retrieval means, in the data information storage means,

the editing information display means processes information for displaying a display pattern corresponding to a remaining time process number which is set beforehand for a display area for any remaining time after expiration of a reproduction base time during a period time,

the image data display means processes image data using a predetermined method in accordance with a remaining time process number as a reproduction process for any remaining time after expiration of a reproduction base time during a period time, and

the audio data output means processes audio data using a predetermined method in accordance with a remaining time process number as a reproduction process for any remaining time after expiration of a reproduction base time during a period time.

23. A multimedia data presentation device that successively reproduces information blocks which are composed of multimedia data that is made up of a combination of at least image information, audio information, and at least two button media which are used to receive a user indication,

the multimedia data presentation device comprising:

information storage means for storing the information blocks and sets of information block reproduction control information,

wherein each set of information block reproduction control information corresponds to a different information block, and each set of information block reproduction control information showing a next information block to be reproduced corresponding to each of button media in a present information block, button media reproduction time period information showing a reproduction time period for all of the button media in the present information block during which a user indication can be received, and an automatic discharge condition for automatically selecting one of the button media in the present information block that is determined when the reproduction time period for the button media has elapsed;

information retrieval means for retrieving an information block to be reproduced and a corresponding set of information block reproduction control information from the information storage means;

indication input means for receiving a user indication;

operation time management means for determining whether the indication input means has received a user indication within the reproduction time period for a button medium corresponding to a next information block, in accordance with the button media reproduction control information corresponding to the present information block;

automatic button selection means for automatically selecting a button medium corresponding to an information block to be reproduced next in accordance with the automatic discharge condition in the set of information block reproduction control information corresponding to the present information block;

information block reproduction means for determining, when the user indication has been given within the reproduction time period for the button media, an information block corresponding to a button medium indicated by the user indication as a next information block to be reproduced, and determining, when no user indication has been given within the reproduction period for the button media, an information block corresponding to the button medium automatically selected by the automatic button selection means as a next information block to be reproduced; and

information output means for decoding an information block and outputting decoded data.