Method and system for information querying

• US 8,904,442 B2
• Filed: 09/06/2007
• Issued: 12/02/2014
• Est. Priority Date: 09/06/2007
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Begeja, Lee, Liu, Zhu, Renger, Bernard S., Shahraray, Behzad, Gibbon, David Crawford
• Primary Examiner(s): Pendleton, Brian T
• Assistant Examiner(s): Lewis, Jonathan V
• Application Number:
  US11/851,254
• Publication Number:
  US 20090070305A1
• Time in Patent Office: 2,644 Days
• Field of Search: 715/720, 715/721, 715/230
• US Class Current: 725/53
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

Methods and systems for information querying are described. At least one recent image of a video signal may be accessed. Recent text associated with the at least one recent image may be accessed. A presentation image may be provided from the at least one recent image for presentation on a display. An original portion of the recent text may be identified within the presentation image. A selection of a user portion of the recent text may be received. An information source may be queried with the selection of the user portion of the recent text. The information source may be capable of using the selection to provide a result.

Claims

1. A method comprising:

accessing a prior image of a video signal, wherein the prior image is obtained from a plurality of images of a media presentation of the video signal;

accessing a first text associated with the prior image using speech recognition of an audio portion associated with the prior image;

receiving a selection of a portion of the first text;

providing a presentation image from the video signal for presentation on a display, wherein the providing the presentation image comprises;

receiving an image selection command;

responsive to receiving the image selection command, selecting the presentation image from the plurality of images of the media presentation, wherein the selecting comprises one of fast-forwarding, slow-forwarding, or rewinding the media presentation from the prior image to the presentation image;

accessing a second text associated with the presentation image using speech recognition of a second audio portion associated with the presentation image of the media presentation;

receiving a selection of a portion of the second text to produce presented text;

presenting the presentation image and the presented text;

querying a first information source based on the presented text, wherein the first information source is capable of using the selection to provide a first search result;

presenting the first search result at the display;

receiving a selection of a third text from text included in the first search result;

querying one of the first information source or a second information source based on the selection of the third text to provide a second search result; and

presenting a result of the second search result at the display.

2. The method of claim 1, comprising:

determining a type of media content associated with the presentation image; and

selecting one of the first information source or the second information source based on the type of media content.

3. The method of claim 1, wherein the receiving of the selection comprises:

receiving a text adjustment command for the presented text; and

selecting another portion of the presented text in accordance with the text adjustment command as the presented text.

4. The method of claim 3, wherein the selecting of the another portion of the presented text is in accordance with the text adjustment command and tagging of a part of a speech of the second text.

5. The method of claim 3, further comprising:

recognizing a phrase in the text,

wherein the selection of the presented text is in accordance with the text adjustment command and the recognizing of the phrase in the second text.

6. The method of claim 1, wherein the receiving of the selection comprises:

receiving a history command;

providing a past query for presentation in accordance with the receiving of the history command; and

receiving the selection of the past query as the first text.

7. The method of claim 1, wherein the receiving of the selection comprises:

receiving a history command;

providing a past text selection for presentation in accordance with the receiving of the history command; and

receiving the selection of the past text selection as the first text.

8. The method of claim 1, further comprising performing facial recognition on the prior image to receive facial recognition data,

wherein the querying of the information source is performed with the presented text and the facial recognition data.

9. The method of claim 1, further comprising:

receiving the selection of the presented text from a first device; and

transmitting the result to a second device without transmitting the result to the first device.

10. The method of claim 1, wherein at least a portion of the presented text is from content of the media presentation that is presented subsequent to the prior image.

11. A non-transitory machine-readable storage medium comprising instructions, wherein responsive to executing the instructions, a processor performs operations comprising:

accessing a prior image of a video signal based on a stop command issued by an end user during a media presentation that includes the prior image, wherein the prior image is a portion of images of the media presentation;

accessing a first text associated with the prior image of the media;

receiving a selection of a portion of the first text;

receiving an image selection command;

responsive to receiving the image selection command, selecting a presentation image from the portion of images of the media presentation, wherein the selecting comprises one of fast-forwarding, slow-forwarding, or rewinding the images of the media presentation from the prior image to the presentation image;

accessing a second text associated with the presentation image using speech recognition of a second audio portion associated with the presentation image of the media presentation;

receiving a selection of a portion of the second text to produce presented text;

presenting the presentation image and the presented text at a display;

querying a first information source based on the presented text, wherein the first information source is capable of using the selection to provide a first search result;

presenting the first search result at the display;

receiving a selection of a third text from text included in the first search result;

querying one of the first information source or a second information source based on the selection of the third text to provide a second search result; and

presenting a result of the second search result at the display.

12. A system, comprising:

a memory to store instructions; and

a processor coupled to the memory, wherein responsive to executing the instructions, the processor performs comprising;

accessing a prior image of a video signal during a media presentation that includes the prior image, wherein the prior image is a portion of images of the media presentation;

accessing text associated with the prior image based on an analysis of speech of an audio portion associated with the prior image;

provide a presentation image from the video signal for presentation on a display, wherein the providing the presentation image comprises;

receiving an image selection command;

responsive to receiving the image selection command, selecting the presentation image from the portion of images of the media presentation, wherein the selecting comprises one of fast-forwarding, slow-forwarding, or rewinding the images of the media presentation from the prior image to the presentation image;

accessing a second text associated with the presentation image by analyzing speech of a second audio portion associated with the presentation image of the media presentation;

receiving a selection of a portion of the second text to produce presented text;

presenting the presentation image and the presented text;

querying a first information source based on the presented text, wherein the first information source is capable of using the selection to provide a first search result;

presenting the first search result at the display;

receiving a selection of a third text from text included in the first search result;

querying the first information source based on the selection of the third text to provide a second search result; and

presenting a result of the second search result at the display.