Automatic question formulation from a user selection in multimedia content

• US 20050076055A1
• Filed: 08/22/2002
• Published: 04/07/2005
• Est. Priority Date: 08/28/2001
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Mory, Benoit, Laffargue, Franck
• Application Number:
  US10/487,734
• Publication Number:
  US 20050076055A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/489 using time information

Abstract

The invention notably has for its object to permit a user who uses multimedia content to make a search for an object of interest evoked in said content, without having to formulate the question himself. For this purpose, a selection tool (for example, a key) permits the user to select a passage of the content while he is using it. When the user makes a selection, a context data is extracted from the content (for example, the current reading time). This context data is then used for recovering one or more descriptions in a document (for example, an MPEG-7 document) which describes said content. The recovered descriptions are finally used for automatically formulating a question intended to be transmitted to a search engine.

Claims

1. Electronic equipment comprising reading means for reading a multimedia content which is described in a document containing descriptions, characterized in that it comprises a user command which permits a user to make a selection in said multimedia content, extraction means for extracting from said multimedia content one or more context data relating to said selection, means for recovering one or more descriptions in said document from said context data, and automatic formulation means based on recovered descriptions, of a question intended to be transmitted to a search engine.

2. Electronic equipment as claimed in claim 1, characterized in that said multimedia content contains a plurality of multimedia entities associated with a reading time, said document comprises descriptions relating to one or more multimedia entities which can be recovered from a reading time, and the current reading time (T) at the moment of the selection forms a context data.

3. Electronic equipment as claimed in claim 1, characterized in that said multimedia content contains objects identified by an object identifier, said document comprises descriptions relating to one or more objects that can be recovered by an object identifier, said user command comprises an object selection tool and the object identifier of the selected object forms a context data.

4. Electronic equipment as claimed in claim 1, characterized in that said document is a tree-like structure of father and son nodes (N0, N1, N2, N3, N21, N22, N31, N32, N33) containing one or various descriptions that are instances of one or more descriptors, a content description in a father node being valid for the son node when no other node from said father to said son node contains another description that is an instance of the same descriptor, and said description recovery means compare the context data with instances of one or more descriptors called recovery descriptors for selecting a node in the tree-like structure and recovering other descriptions which are also valid for this node.

5. A method of formulating a question intended to be transmitted to a search engine while a user is using a multimedia content, said multimedia content being described in a document that contains descriptions, characterized in that it comprises:

a selection step (1) by the user in said multimedia content,

an extraction step (2) for extracting from the multimedia content one or more context data relating to said selection,

a recovery step (3;

4) of one or more descriptions in said document from said context data and

an automatic formulation step (5) of said question from recovered descriptions.

6. A method as claimed in claim 5 of formulating a question, characterized in that said multimedia content contains a plurality of multimedia entities associated with a reading time, said document comprises descriptions relating to one or more of the media entities, which may be recovered from a reading time and in that the current reading time (T) constitutes context data at the moment of the selection (S).

7. A method as claimed in claim 5 of formulating a question, characterized in that said multimedia content contains objects identified by an object identifier, said document comprises descriptions relating to one or more objects which may be recovered by an object identifier, said selection step comprises an object selection and in that the object identifier of the selected object constitutes a context data.

8. A method as claimed in claim 5 of formulating a question, characterized in that said document is a tree-like structure of father and son nodes (N0, N1, N2, N3, N21, N22, N31, N32, N33) containing one or various descriptions that are instances of one or more descriptors, a content description in a father node being valid for the son node when no other node from said father to said son node contains another description that is an instance of the same descriptor, and said description recovery means compare the context data with instances of one or more descriptors called recovery descriptors for selecting a node in the tree-like structure and recovering other descriptions which are also valid for this node.

9. A program comprising program code instructions for implementing a method as claimed in claim 5, when it is executed by a processor.

10. A system comprising equipment (EQT) as claimed in claim 5 which comprises transceiver means (EX/RX) for transmitting said question to a remote search engine (SE) and for receiving a response (R) to said question coming from said remote search engine, a search engine (R) and transmission means (TR) for transmitting said question from the equipment to the search engine and for transmitting said response from the search engine to said equipment.