Method of presenting multimedia data in a desired form by comparing and replacing a user template model with analogous portions of a system

• US 5,278,946 A
• Filed: 11/29/1990
• Issued: 01/11/1994
• Est. Priority Date: 12/04/1989
• Status: Expired due to Term

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Kashioka, Seiji, Sugihara, Akiko, Matsushima, Hitoshi, Shimada, Shigeru
• Primary Examiner(s): Lee, Thomas C.
• Assistant Examiner(s): Harper, Burch
• Application Number:
  US07/619,506
• Time in Patent Office: 1,139 Days
• Field of Search: 395/155, 395/62, 395/60, 395/66, 395/153, 395/154, 395/156, 395/157, 395/158, 395/159, 395/160, 395/161, 364/491, 364/401, 382/30, 382/16, 382/48
• US Class Current: 706/53
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

Multimedia data in an object structure include entity objects and relation objects, wherein each entity object has data representing a media element as internal data, and each relation object represents a relation between the entity objects. A relation object is searched according to information specified by a search command, and a searched relation object and internal data of an entity object related thereto are displayed on the screen of a display unit as a set of display elements. To generate a digest of the multimedia data, a matching between a structure portion of a user model and a structure portion of a system model is examined. The user model is generated according to a request of the user and arranged in layers, while the system model has been previously generated. The multimedia data are arranged in layers according to the importance of respective data elements constituting the multimedia data. According to an examination result, a user model structure portion is selectively replaced by a system model structure portion, and the replaced user model is adjusted so as to display the same.

Claims

1. A method of presenting multimedia data in a desired form, comprising the steps of:

establishing a user model having a plurality of user model structure portions;

establishing a plurality of system models each having a plurality of system model structure portions;

determining similarity levels of each user model structure portion of the user model to each system model structure portion of the plurality of system models, said user model being generated in accordance with a request and having a hierarchical semantic structure of the desired form, and said system models having hierarchical semantic structures of multimedia data layered in accordance with a predetermined hierarchy of each element of the multimedia data;

replacing each user model structure portion by a specific one of the corresponding system model structure portions in accordance with the similarity levels, while adjusting the specific system model structure portion to the user model structure portion in accordance with the similarity level determination; and

executing the user model modified by the replacing step to present the multimedia data in the desired form.

2. A method according to claim 1, wherein the user model and the system models are modeled in an object structure, and each object structure of the user model and system the models includes a "part-of" structure and an "is-a" structure.

3. A method according to claim 2, further comprising the step of generating, in accordance with the request, the user model from a template model which represents a general schematic structure of the multimedia data.

4. A method according to claim 2, wherein the establishing step establishes the system models from elements of the multimedia data.

5. A method according to claim 2, wherein said step of determining similarity levels comprises the steps of:

sequentially extracting a "part-of" structure portion of the user model while changing a destination node over predetermined nodes in the user model;

examining, when a "part-of" user model structure portion is to be replaced by a "part-of" system model structure portion having a similarity level above a predetermined level, the similarity level determination of the "part-of" system model structure portion with respect to the "part-of" user model structure portion; and

replacing the "part-of" user model structure portion by the "part-of" system model structure portion after adjusting the user model in accordance with the similarity level determination.

6. A method according to claim 5, wherein said extracting step comprises the step of, when a destination node is selected, extracting a user model structure portion having a first layer level difference in a predetermined area with the destination node as the center thereof, and extracting a user model structure portion above a second layer level in the periphery thereof, wherein said second layer level is higher than said first layer level.

7. A method of supplying data analogous to data designated by a request, said method being executed by a computer system and comprising the steps of:

establishing system models each having a hierarchical semantic structure of data layered in accordance with a predetermined hierarchy, each of a plurality of nodes of the hierarchical semantic structure being an object representing the data and a procedure for the data or relation among its lower objects;

generating a specific user model representing a request and having a hierarchical semantic structure of a desired form;

examining an analogy level between each of a plurality of portions of the specific user model and each of a plurality of portions of each system model;

synthesizing portions of the system models which are selected in accordance with the specific user model and the analogy levels to produce an analogous model; and

executing the analogous model to represent the data in the desired form.

8. A method according to claim 7, wherein said generating step comprises the steps of:

selecting a user model from a plurality of user models in accordance with a kind of the request; and

determining the semantic structure of the selected user model in accordance with details of the request to generate the specific user model.

9. A method according to claim 7, wherein said examining step comprises the step of:

repeatedly examining an analogy level between a portion of the specific user model and a portion of each system model

while defining a scope for the portion of the specific user model and for the portion of each system model, and

while changing the portion of the specific user model and the portion of each system model.

10. A method according to claim 7, wherein said synthesizing step comprises the step of replacing each portion of the specific user model by portions of the system models which are selected in accordance with the analogy levels.