METHOD AND APPARATUS FOR GENERATING A MULTIMEDIA-BASED QUERY

• US 20100145971A1
• Filed: 12/08/2008
• Published: 06/10/2010
• Est. Priority Date: 12/08/2008
• Status: Abandoned Application

• Current Assignee: Motorola Mobility, Inc. (Lenovo Group Ltd.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Cheng, Yan-Ming, Kane, John Richard
• Application Number:
  US12/329,979
• Publication Number:
  US 20100145971A1
• Time in Patent Office: Days
• US Class Current: 707/759
• CPC Class Codes: G06F 16/43 Querying

Abstract

A method and apparatus for generating a query from multimedia content is provided herein. During operation a query generator (101) will receive multi-media content and separate the multi-media content into at least a video portion and an audio portion. A query will be generated based on both the video portion and the audio portion. The query may comprise a single query based on both the video and audio portion, or the query may comprise a “bundle” of queries. The bundle of queries contains at least a query for the video portion, and a query for the audio portion of the multimedia event.

Claims

1. A method for generating a query, the method comprising the steps of:

receiving multi-media content;

separating the multi-media content into at least a video portion and an audio portion;

generating at least one query based on the video portion and the audio portion.

2. The method of claim 1 wherein the step of generating at least one query comprises the step of generating a video query and an audio query.

3. The method of claim 1 further comprising the steps of:

receiving relevant search terms from a suggestion service;

wherein the step of generating the at least one query is also based on the relevant search terms from the suggestion service.

4. The method of claim 3 wherein the suggestion service provides a service designed to supply related thesaurus-like words or concepts based on query inputs.

5. The method of claim 1 further comprising the steps of:

receiving a personal profile from a personal profile database;

wherein the step of generating the at least one query is also based on the input from the personal profile database.

6. The method of claim 5 wherein the personal profile database comprises a database containing user interests.

7. The method of claim 1 further comprising the steps of:

receiving an input from a user;

wherein the step of generating the at least one query is also based on the input from the user.

8. The method of claim 7 wherein the input from the user is a voice input.

9. The method of claim 1 wherein:

the step of separating the multi-media content into at least a video portion and an audio portion comprises the step of separating the multi-media content into at least a video portion, an audio portion, and a textual portion; and

the step of generating at least one query based on the video portion and the audio portion comprises the step of generating at least one query based on the video portion, the audio portion, and the textual portion.

10. A method for generating a query, the method comprising the steps of:

receiving a video stream and an audio stream;

selecting a portion of the video stream and the audio stream for query generation;

creating at least one query to be sent out based on the portion of the video stream and the portion of the audio stream.

11. The method of claim 10 further comprising the steps of:

receiving an input from a user;

wherein the step of creating the at least one query is also based on the input from the user.

12. The method of claim 11 wherein the input from the user comprises a voice input.

13. The method of claim 10 further comprising the steps of:

receiving relevant search terms from suggestion service;

wherein the step of creating the at least one query is also based on the relevant search terms from the suggestion service.

14. The method of claim 13 wherein the suggestion service provides a service designed to supply related thesaurus-like words or concepts based on query inputs.

15. The method of claim 10 further comprising the steps of:

receiving profile from a personal profile database;

wherein the step of creating the at least one query is also based on the profile from the personal profile database.

16. The method of claim 15 wherein the personal profile database comprises a database containing user interests.

17. The method of claim 10 further comprising the steps of:

receiving a textual stream;

selecting a portion of the textual stream for query generation;

wherein the step of creating the at least one query to be sent out based on the portion of the video stream and the portion of the audio stream comprises the step of creating the at least one query to be sent out based on the portion of the video stream, the portion of the audio stream, and the portion of the textual stream.

18. An apparatus comprising:

media separation circuitry receiving multimedia content and outputting a video stream and an audio stream; and

query generation circuitry receiving the video stream and the audio stream selecting a portion of the video stream and the audio stream and outputting a query based on the portion of the video stream and the portion of the audio stream.

19. The apparatus of claim 18 wherein the query generation circuitry also receives a user input and the query is also based on the user input.

20. The apparatus of claim 18 wherein the query generation circuitry also receives input from a personal profile database and the query is also based on a personal profile.