Displaying additional data about outputted media data by a display device for a speech search command

• US 8,521,531 B1
• Filed: 02/06/2013
• Issued: 08/27/2013
• Est. Priority Date: 08/29/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Yongsin
• Primary Examiner(s): Lerner, Martin
• Application Number:
  US13/761,102
• Time in Patent Office: 202 Days
• Field of Search: 704/251, 704/252, 704/270, 704/275, 707/725, 707/769, 725/40, 725/43, 725/51, 725/53
• US Class Current: 704/252
• CPC Class Codes: G06F 16/632 Query formulation
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/9032 Query formulation
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612

Abstract

A speech search method for a display device is discussed. The method includes the steps of outputting media data, receiving a speech search command from a user, and determining whether the speech search command includes a query term. If the speech search command does not include a query term, the method further comprises the step of extracting a query term which is full and searchable from audio data of the media data which is outputted immediately prior to the speech search command. Finally, the method includes the step of performing a speech search using the extracted query term.

Claims

1. A speech search method performed by a display device, the method comprising:

outputting media data by the display device;

receiving, by the display device, a speech search command for additional data about the outputted media data from a user;

determining, by the display device, whether the speech search command includes a query term that is immediately searchable by the display device;

if the speech search command does include the query term that is immediately searchable by the display device, performing by the display device a search for the additional data using the query term that is immediately searchable;

if the speech search command does not include the query term that is immediately searchable by the display device, matching by the display device a portion of the speech command with a query term extracted from audio data of a predetermined amount of the media data that is buffered by the display device prior to a time that the speech search command was received; and

performing, by the display device, the search for the additional data using the extracted query term.

2. The method of claim 1, wherein the determining whether the speech search command includes the query term that is immediately searchable comprises:

extracting at least one query word from the portion of the speech search command; and

determining whether the at least one query word matches the query term that is immediately searchable.

3. The method of claim 2, wherein the determining whether the at least one query word matches the query term comprises:

determining whether the at least one query word matches the query term based on at least one of pronunciation patterns of the user and context information of the media data.

4. The method of claim 3, wherein the context information comprises at least one of title information, genre information, character information, scene information, schedule information, audio related information, and image related information of the media data.

5. The method of claim 2, wherein the matching the portion of the speech command with the query term extracted from the audio data comprises:

voice-recognizing the audio data and producing a voice recognition result;

extracting at least one query term candidate from the voice recognition result; and

determining the query term matching the at least one query word from the at least one query term candidate.

6. The method of claim 5, further comprising:

if the at least one query term candidate does not match the at least one query word, providing the user with the at least one query term candidate.

7. The method of claim 1, wherein the performing the search using the extracted query term comprises:

providing the user with a confirmation request for the extracted query term; and

if the extracted query term is confirmed by the user, performing the search using the confirmed query term.

8. The method of claim 1, wherein the determining whether the speech search command includes a query term that is immediately searchable comprises:

determining whether the speech search command includes a full query term or a partial query term.

9. A display device, comprising:

a media data processing module configured to process media data;

a media data output unit configured to output the processed media data;

a buffer configured to buffer the processed media data;

an audio input unit configured to receive a speech search command for additional data about the outputted media data from a user; and

a processor configured to

determine whether the speech search command includes a query term that is immediately searchable by the display device,

if the speech search command does include the query term that is immediately searchable by the display device, perform a search for the additional data using the query term that is immediately searchable,

if the speech search command does not include the query term that is immediately searchable by the display device, match a portion of the speech command with a query term extracted from audio data of a predetermined amount of the media data that is buffered by the display device prior to a time that the speech search command was received, and

perform the search for the additional data using the extracted query term.

10. The display device of claim 9, wherein the processor is configured to

extract at least one query word from the portion of the speech search command, and

determine whether the at least one query word matches the query term that is immediately searchable.

11. The display device of claim 10, wherein the processor is configured to determine whether the at least one query word matches the query term based on at least one of pronunciation patterns of the user and context information of the media data.

12. The display device of claim 11, wherein the context information comprises at least one of title information, genre information, character information, scene information, schedule information, audio related information, and image related information of the media data.

13. The display device of claim 10, wherein the processor is configured to

voice-recognize the audio data of the media data and produce a voice recognition result,

extract at least one query term candidate from the voice recognition result, and

determine the query term matching the at least one query word from the at least one query term candidate.

14. The display device of claim 13, wherein, if the at least one query term candidate does not match the at least one query word, the display device provides the user with a display of at least one query term candidate.

15. The display device of claim 9, wherein the processor is configured to

provide the user with a confirmation request for the extracted query term, and

perform the search using the query term if the extracted query term is confirmed by the user.

16. The display device of claim 9, wherein the processor is configured to determine whether the speech search command includes a full query term or a partial query term.