Method and system for information querying

• US 10,114,893 B2
• Filed: 10/31/2014
• Issued: 10/30/2018
• Est. Priority Date: 09/06/2007
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Begeja, Lee, Liu, Zhu, Renger, Bernard S., Shahraray, Behzad, Gibbon, David Crawford
• Primary Examiner(s): Lewis, Jonathan V
• Application Number:
  US14/530,124
• Publication Number:
  US 20150052119A1
• Time in Patent Office: 1,460 Days
• Field of Search: None
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

Methods and systems for information querying are described. At least one recent image of a video signal may be accessed. Recent text associated with the at least one recent image may be accessed. A presentation image may be provided from the at least one recent image for presentation on a display. An original portion of the recent text may be identified within the presentation image. A selection of a user portion of the recent text may be received. An information source may be queried with the selection of the user portion of the recent text. The information source may be capable of using the selection to provide a result.

Claims

1. A method, comprising:

receiving, by a processing system comprising a processor, a query command during a media presentation, wherein the media presentation includes media images and an audio portion;

determining a first text portion associated with the media images based on an analysis of the audio portion of the media presentation temporally associated with a receipt of the query command;

providing a presentation image of the first text portion to be included in the media presentation;

accessing, by the processing system, a media image of the media images associated with the media presentation in accordance with the receiving of the query command;

accessing, by the processing system, a prior image of the media images of the media presentation responsive to the accessing the media image;

receiving, by the processing system, a selection of a portion of the first text portion as a second text portion;

performing, by the processing system, facial recognition on the prior image to receive facial recognition data;

querying, by the processing system, an information source with the second text portion and the facial recognition data, the information source being capable of using the facial recognition data to provide a first result related to the selection of the second text portion;

providing, by the processing system, the first result to be included in the media presentation;

receiving, by the processing system, a selection of a third text from text included in the first result;

querying, by the processing system, the information source based on the selection of the third text to provide a second result; and

providing, by the processing system, the second result to be included in the media presentation.

2. The method of claim 1, further comprising identifying keywords from the second text portion.

3. The method of claim 1, further comprising providing feedback regarding the querying of the information source.

4. The method of claim 1, further comprising:

receiving the first result from the information source in response to the query; and

providing the first result for the presentation on a display presenting the media presentation.

5. The method of claim 1, wherein the media presentation further comprises embedded images, accessed images, or combinations thereof, and

wherein the query command pauses the presentation.

6. The method of claim 1, wherein the first result comprises one of text data, image data, audio data, video data, or combinations thereof.

7. A method, comprising:

accessing, by a processing system comprising a processor, a plurality of candidate terms associated with a media presentation based on an analysis of an audio portion of the media presentation, wherein the media presentation provides the plurality of candidate terms in a selectable image;

receiving, by the processing system, a predictive text entry for the media presentation as a selection of one of the plurality of candidate terms;

identifying, by the processing system, an identified term associated with the media presentation based on the plurality of candidate terms and the predictive text entry;

querying, by the processing system, an information source with the identified term;

accessing, by the processing system, a prior image of the media presentation based on a command;

performing, by the processing system, facial recognition on the prior image to receive facial recognition data, wherein the querying of the information source is performed with the predictive text entry and the facial recognition data;

providing a first result of the performing the facial recognition in the media presentation;

receiving, by the processing system, a selection of a third text from text included in the first result;

querying, by the processing system, the information source based on the selection of the third text to provide a second result; and

providing, by the processing system, the second result to be included in the media presentation.

8. The method of claim 7, further comprising providing feedback regarding the querying of the information source.

9. The method of claim 7, further comprising:

receiving the first result from the information source in response to the query.

10. The method of claim 7, wherein the accessing the prior image of the media presentation is based on a stop command.

11. The method of claim 7, further comprising selecting a presentation image from a plurality of images of the media presentation, wherein the selecting comprises one of pausing, fast-forwarding, slow-forwarding, or rewinding the media presentation from a prior image to the presentation image.

12. The method of claim 11, further comprising accessing a second text associated with the presentation image using speech recognition of a second audio portion associated with the presentation image of the media presentation.

13. The method of claim 12, further comprising:

receiving a selection of a portion of the second text to produce presented text; and

providing the presentation image and the presented text to be included in the media presentation.

14. A non-transitory, machine-readable storage medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, comprising:

receiving a query command responsive to selecting a media image from a media presentation;

accessing the media image associated with the media presentation in accordance with the receiving of the query command;

accessing recent text temporally associated with a receipt of the query command associated with the media presentation, wherein the recent text is determined based on an analysis of an audio portion of the media presentation;

providing a presentation image of the recent text to be included in the media presentation;

receiving a selection of a portion of the recent text to produce a presented text;

performing facial recognition on the media image to receive facial recognition data;

querying a first information source with a portion of the presented text and the facial recognition data, the information source being capable of using the portion to provide a first search result;

receiving the first search result from the first information source in response to the query;

providing the first search result and the presented text for presentation on a display;

receiving a selection of a third text from text included in the first search result;

querying one of the first information source or a second information source based on the selection of the third text to provide a second search result; and

presenting the second search result at the display.

15. The non-transitory, machine-readable storage medium of claim 14, wherein the operations further comprise identifying keywords from the recent text as a portion of the recent text.

16. The non-transitory, machine-readable storage medium of claim 14, wherein the operations further comprise providing feedback regarding the querying of the information source.

17. The non-transitory, machine-readable storage medium of claim 14, wherein the media presentation comprises one of an audio signal, a video signal, embedded images, accessed images, or combinations thereof, and

wherein the first search result comprises one of text data, image data, audio data, video data, or combinations thereof.

18. The non-transitory, machine-readable storage medium of claim 14, wherein the selecting comprises one of pausing, fast-forwarding, slow-forwarding, or rewinding the media presentation from a prior image to pause on the media image.