SPEECH RECOGNITION FOR INTERNET VIDEO SEARCH AND NAVIGATION

• US 20160189711A1
• Filed: 03/08/2016
• Published: 06/30/2016
• Est. Priority Date: 10/31/2006
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: DACOSTA, BEHRAM MARIO
• Granted Patent: US 10,565,988 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/73 Querying
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G10L 15/10 using distance or distortion measures between unknown speech and reference templates
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/025 Phonemes, fenemes or fenones being the recognition units
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04N 21/23109 by placing content in organized collections, e.g. EPG data repository details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4332 by placing content in organized collections, e.g. local EPG data repository interfaces, Database management systems or updating for information retrieval G06F16/23; details of retrieval of video data and associated meta data in video database G06F16/739
• CPC Class Codes: H04N 21/4381 Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/4415 using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/64322 IP

Abstract

Speech representing a desired video site or video subject is detected and digitized at a TV remote, and then sent to a TV. The TV or in some embodiments an Internet server communicating with the TV use speech recognition principles to recognize the speech, enter a database using the recognized speech as entering argument, and return a link to an Internet site hosting the desired video. The link can be displayed on the TV for selection thereof by a user to retrieve the video.

Claims

1. A system, comprising:

an audio video device (AVD) configured for communicating with the Internet;

at least one computer memory comprising instructions executable by at least one processor for;

receiving speech signals of a viewer of the AVD and representing a viewer-desired video site or video subject;

implementing speech recognition on received speech signals representing a desired video site or video subject to generate recognized speech; and

accessing at least one database including at least one index derived from closed captioned text in a televised video program received by the AVD; and

correlating speech with at least one element of the index to return at least one matching index element, the matching index element useful for providing video to the AVD.

2. The system of claim 1, wherein the database includes at least one index derived from text input by a user, for at least one of:

a predetermined time, or predetermined data amount.

3. The system of claim 2, wherein the database contains only information received for a most recent predetermined time period.

4. The system of claim 2, wherein the database contains only the most recent “

X”

amount of information received, wherein “

X”

is a predetermined data amount.

5. The system of claim 1, wherein the database also includes information representing items that are initial, manufacturer-defined grammar.

6. A method for returning a desired video, comprising:

accessing closed captioned text received in video program;

providing signals representing human speech to an audio video device (AVD) the speech being related to the video;

recognizing at least phonemes in the speech; and

using the phonemes as entering argument, accessing a database including an index derived from the closed captioned text received in the video program to retrieve the desired video.

7. The method of claim 6, comprising displaying an address of the desired on the AVD for selection thereof by a user using the AVD to retrieve the desired video from the Internet.

8. The method of claim 6, wherein the database contains only information received for a most recent predetermined time period.

9. The method of claim 6, wherein the database contains only the most recent “

X”

amount of information received, wherein “

X”

is a predetermined data amount.

10. A device comprising:

a computer memory that is not a transitory signal and that comprises instructions executable by at least one processor to;

recognize a viewer'"'"'s digitized speech representing a video and generating recognized speech in response;

accessing a data structure correlating speech representing video to computer storage locations of stored video, the data structure being generated at least in past using metadata received in video presented on an audio video device (AVD) and/or closed caption text received in video presented on the AVD; and

retrieving, from the data structure, at least an identification of at one video correlated to a match of the recognized speech.

11. The device of claim 10, wherein the computer memory is contained within the AVD and/or a remote control without resorting to accessing a server to undertake the method acts.

12. The device of claim 11, wherein the computer memory is contained within the AVD.

13. The device of claim 11, wherein the computer memory is contained within the remote control.

14. The device of claim 10, wherein a limited grammar database is maintained in the AVD so that memory and processing requirements to process the limited grammar database are manageable within the confines of the processor and medium, the limited grammar database including indices derived at least from the closed captioned text received by the AVD for a past “

X”

bytes and/or a past “

Y”

hours, the limited grammar database not including indices derived from the closed captioned text received by the AVD in excess of the past “

X”

bytes and/or received earlier than the past “

Y”

hours, such that a match to the recognized speech is returned only if the recognized speech contains content that has occurred during the broadcast in the past “

Y”

hours and/or if it has occurred in the past “

X”

bytes.

15. The device of claim 10, wherein the data structure is generated at least in part using metadata received in video presented on the AVD.

16. The device of claim 10, wherein the data structure is generated at least in part using closed caption text received in video presented on the AVD.

17. The device of claim 15, wherein the data structure is generated at least in part using closed caption text received in video presented on the AVD.

18. The device of claim 10, wherein the data structure contains only information received for a most recent predetermined time period.

19. The device of claim 10, wherein the data structure contains only the most recent “

X”

amount of information received, wherein “

X”

is a predetermined data amount.