MULTIMODAL INTERFACE FOR SEARCHING MULTIMEDIA CONTENT

• US 20090089251A1
• Filed: 10/02/2007
• Published: 04/02/2009
• Est. Priority Date: 10/02/2007
• Status: Abandoned Application

• Current Assignee: AT&T Knowledge Ventures, L.P. (AT&T, Inc.)
• Original Assignee: AT&T Knowledge Ventures, L.P. (AT&T, Inc.)
• Inventors: Johnston, Michael James, Levine, Michelle F., D'Haro, Luis Fernando, Renger, Bernard S.
• Application Number:
  US11/866,323
• Publication Number:
  US 20090089251A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3326 using relevance feedback from the user, e.g. relevance feedback on documents, documents sets, document terms or passages
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A disclosed method and computer program product for searching a multimedia content database include determining a first query parameter provided by a user via a first input modality and optionally determining a second query parameter provided the user via a second input modality. A multidimensional query is generated where the query is indicative of the first and second query parameters. The query is applied to the multimedia content database to retrieve records of matching content. The retrieved records are then displayed to the user. The user may refine the query results using additional multidimensional and multimodal queries.

Claims

1. A computer program product comprising instructions, stored on a computer readable medium, for searching a multimedia content database, the instructions comprising instructions to:

determine a first query parameter provided by a user via a combination of a first input modality and a second input modality;

generate a query indicative of the first query parameter;

apply the query to a multimedia content database to extract records of matching content; and

display the matching content records.

2. The computer program product of claim 1, wherein a record in the multimedia content directory is associated with a plurality of fields and wherein the first query parameter corresponds to a first field.

3. The computer program product of claim 2, wherein the fields include a set of fields selected from the group of fields consisting of duration, rating, genre, actor, director, writer, producer, credited crew member, plot descriptions, plot keywords, release date, language, aspect ratio, resolution, channel, original air date, and scheduled broadcast time.

4. The computer program product of claim 1, wherein the first and second input modalities are selected from a group of modalities consisting of a spoken modality, a handwritten modality, a text input modality, a point-and-click modality, and a navigation based modality.

5. The computer program product of claim 1, further comprising ordering the matching content records and wherein displaying the matching content records comprises displaying the matching content in an ordered list based on the ordering.

6. The computer program product of claim 5, wherein the ordered list is displayed in a first display window, wherein the display includes a second display window containing a description of the first record in the ordered list.

7. The computer program product of claim 5, wherein the ordered list is displayed in a first display window, wherein the display includes a third display window displaying values of at least one field associated with the first record in the ordered list.

8. The computer program product of claim 7, wherein the matching content record corresponds to a program and wherein the third display window displays crew members credited in the program.

9. The computer program product of claim 8, wherein the third display window displays at least one of the credited actors as a selectable link, wherein the selectable link, when invoked, generates a secondary query using a credited actor associated with the selected link as a criteria.

12. The service of claim 11, wherein the fields include a set of fields selected from the group of fields consisting of duration, rating, genre, actor, director, writer, producer, credited crew member, plot descriptions, plot keywords, release date, language, aspect ratio, resolution, channel, original air date, and scheduled broadcast time.

10. A search service for use with a multimedia content database, the service comprising:

enabling a set top box to determine a first query parameter provided by a user via a first input modality;

enabling the set top box to determine a second query parameter provided the user via a second input modality;

enabling the set top box to generate a multidimensional query indicative of the first and second query parameters;

enabling the set top box to apply the multidimensional query to a multimedia content database to extract records of matching content; and

configuring the set top box to format and output the extracted display to a display device for display.

11. The service of claim 10, wherein a record in the multimedia content directory is associated with a plurality of fields and wherein the first query parameter corresponds to a first field and the second query parameter corresponds to a second field.

13. The service of claim 10, wherein the first and second input modalities are selected from a group of modalities consisting of consisting of a spoken modality, a handwritten modality, a text input modality, a point-and-click modality, and a navigation based modality.

14. The service of claim 10, further comprising ordering the matching content records and wherein displaying the matching content records comprises displaying the matching content in an ordered list based on the ordering.

15. The service of claim 14, wherein the ordered list is displayed in a first display window, wherein the display includes a second display window containing a description of the first record in the ordered list.

16. The service of claim 14, wherein the ordered list is displayed in a first display window, wherein the display includes a third display window displaying values of at least one field associated with the first record in the ordered list.

17. The service of claim 16, wherein the matching content record corresponds to a program and wherein the third display window displays actors credited in the program.

18. The service of claim 17, wherein the third display window displays at least one of the credited actors as a selectable link, wherein the selectable link, when invoked, generates a secondary query based on applicable credited actor.

19. A set top box for use in a multimedia content distribution network, the set top box including a controller and storage accessible to the controller, the set top box further comprising:

a first interface for receiving user input via a first input modality;

a second interface for receiving user input via a second input modality; and

wherein the storage includes controller executable modules including a module enabled to integrate a first parameter specified via the first input modality with a second parameter specified via the second input modality to generate a query and a module to apply the query to a multimedia content database to extract records from the database and a display module to present the extracted records to the user.

20. The set top box of claim 19, wherein the first and second modalities are selected from the group of modalities consisting of consisting of a spoken modality, a handwritten modality, a text input modality, a point-and-click modality, and a navigation based modality.