Interest messaging entertainment system

• US 8,006,268 B2
• Filed: 05/21/2002
• Issued: 08/23/2011
• Est. Priority Date: 05/21/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Sloo, David Hendler
• Primary Examiner(s): Pendleton; Brian T
• Assistant Examiner(s): Saint Cyr; Jean D
• Application Number:
  US10/153,346
• Publication Number:
  US 20030221198A1
• Time in Patent Office: 3,381 Days
• Field of Search: 725/136, 725/61
• US Class Current: 725/53
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 5/50 Tuning indicators; Automatic tuning control
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Video signals broadcast on a multiplexed channel of a broadcast network are received and there is extract therefrom a closed captioning stream of textual data that is searched for occurrences of textual data matching one or more search parameters. A partial portion of the closed captioning stream of textual data that includes each of the occurrences of textual data that matches the one or more search parameters can be directed to a television receiver.

Claims

1. A method implemented by a client device having a processor executing instructions stored in computer-readable storage media, the method comprising:

receiving video signals broadcast on a multiplexed channel of a broadcast network;

extracting from the received video signals a closed captioning stream of textual data;

creating an active list comprising a plurality of first search terms by presenting a plurality of questions at a user interface to be answered by a viewer to develop the first search terms for creating the active list;

creating a passive list comprising a plurality of second search terms by;

monitoring closed captioning textual data during receipt of one or more previously received closed captioning streams of textual data of received video signals that the viewer has viewed or recorded,

extracting words and phrases as potential search terms from the closed captioning textual data, and

automatically selecting the plurality of second search terms from the potential search terms based on a recentness and a frequency of occurrence of the extracted words and phrases;

searching the stream of textual data for occurrences of textual data matching one or more of the first search terms in the active list or one or more of the second search terms in the passive list, the searching comprising;

storing content programming corresponding to the received video signals in a buffer;

comparing, by the processor, the closed captioning stream of textual data to both the active list and the passive list;

determining whether a number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds a threshold number, wherein the number of matches is based on a combination, over a period of time, of a number of hits with respect to the first search terms in the active list and a number of hits with respect to the second search terms in the passive list; and

applying a greater weight to the first search terms in the active list than a weight applied to the second search terms in the passive list when counting the number of matches;

when the number of matches of the first search terms of the active list and the second search terms of the passive list does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed captioning stream is reached, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel; and

notifying the viewer when the number of matches exceeds the threshold number that content programming determined to be of interest to the viewer has been located.

2. The method according to claim 1, wherein creating the active list is further based on a word omission list provided by a third party.

3. The method according to claim 1, further comprising notifying the viewer by displaying a notification message to the viewer as a display line displayed in conjunction with programming that the viewer is viewing, wherein the display line specifies at least one channel currently having the content programming determined to be of interest to the viewer.

4. The method according to claim 1, further comprising:

displaying at least one occurrence of textual data matching the one or more first search terms or the one or more second search terms in context with adjacent words in the closed captioning stream of textual data such that the occurrence and respective context facilitate;

vertical scrolling between a plurality of sources of occurrences of textual data matching said one or more search terms in the closed captioning stream of the plurality of sources; and

horizontal scrolling illustrating chronological occurrences of textual data matching said one or more search terms in the closed captioning stream of a respective source.

5. The method according to claim 1, wherein:

the receiving video signals broadcast on a multiplexed channel of a broadcast network further comprises simultaneously receiving a plurality of video signals broadcast on a respective plurality of multiplexed channels of the broadcast network;

the extracting from the received video signals a closed captioning stream of textual data further comprises for each said channel, extracting from the received video signals a closed captioning stream of textual data; and

the searching said stream of textual data for occurrences of textual data matching said one or more first search terms or the one or more second search terms further comprises for each said channel, searching said stream of textual data for occurrences of textual data matching said one or more first search terms or the one or more second search terms.

6. The method according to claim 1, further comprising notifying the viewer that the content programming determined to be of interest to the viewer has been located by sending a notification message to a telephone number of the viewer, wherein the sending the notification message to the telephone number of the viewer further comprises placing a telephone call to the viewer.

7. The method according to claim 6, further comprising recording the content programming determined to be of interest to the viewer when the viewer does not respond to the telephone notification message within a predetermined period of time.

8. The method according to claim 1, wherein the notifying the viewer further comprises displaying a notification message in a manner selected from the group consisting of picture in picture, split screen, video text and selective picture.

9. The method according to claim 1, further comprising, following determining that the number of matches exceeds the threshold number, recording the content programming as a recording by moving content of the buffer to a more permanent storage location than the buffer so that a beginning of the content programming is included in the recording.

10. The method according to claim 1, further comprising:

receiving an input to display the received video signals that correspond to the content programming determined to be of interest to the viewer; and

outputting to a television receiver the received video signals that corresponds to the input.

11. The method according to claim 2, further comprising:

when a word on the word omission list is encountered, during subsequent playback of the content programming, a portion of the content programming corresponding to the word on the word omission list is omitted from playback.

12. The method according to claim 1, further comprising:

accessing an interconnected network to transmit a notification message to an address on the interconnected network;

notifying the viewer that the content programming determined to be of interest to the viewer has been located;

receiving from a viewer the address on the interconnected network;

forming the notification message addressed to the address on the interconnected network and containing data relative to the occurrence of textual data matching said one or more search terms; and

transmitting the formed notification message to the address on the interconnected network for providing the viewer notification that the content programming determined to be of interest to the viewer has been located.

13. The method according to claim 12, wherein the interconnected network and the address thereon are an email server and an email address at the email server.

14. A local client set-top box comprising:

a processor;

a plurality of tuners to receive a respective plurality of channels carrying video signals;

a closed caption decoder to extract, from the channels, at least one closed captioning stream of textual data;

a user interface to present to a viewer to develop first search terms for creating an active list, the active list including one or more predefined first character strings as the first search terms;

an application, executed on the processor, to create a passive list of second search terms, the second search terms comprising one or more character strings that have been extracted one or more times from previously received closed captioning streams of textual data of received video signals that the viewer has viewed or recorded, the one or more second character strings being extracted based on a frequency of occurrence in the previously received textual data;

the application further executed on the processor to search, for each said channel, the closed captioning stream of textual data for occurrences of textual data matching one or more search terms by comparing the at least one closed captioning stream of textual data to the active list and the passive list, the comparing including determining whether a number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds a threshold number, wherein when the number of matches of the first search terms of the active list and the second search terms of the passive list does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed captioning stream is reached, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel; and

a signal output device to output a notification when the number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds the threshold number.

15. The local client set-top box as defined in claim 14, wherein the signal output device facilitates displaying at least one occurrence of textual data matching the first or second search terms in context with adjacent words in the closed captioning stream of textual data in a presentation providing:

vertical scrolling between a plurality of sources of occurrences of textual data matching said first or second search terms in the closed captioning stream of the plurality of sources; and

horizontal scrolling illustrating chronological occurrences of textual data matching said first or second search terms in the closed captioning stream of a respective source.

16. The local client set-top box as defined in claim 15, further comprising:

a network access device to request and receive in response to the request character strings from a network resource, wherein the one or more predefined first character strings of the active list includes one or more of the character strings received by the network access device.

17. The local client set-top box as defined in claim 14, wherein the one or more second character strings of the passive list have corresponding video signals that had been previously output by the signal output device.

18. The local client set-top box as defined in claim 14, further comprising:

a storage device to store the received video signals;

wherein the passive list further includes one or more character strings from one or more previously received closed captioning streams of textual data corresponding to one or more of the received video signals that have been stored on the storage device.

19. The local client set-top box as defined in claim 14, further comprising:

an input device to receive input from a viewer of an indicator of a television program to be carried on one said multiplexed channel of the broadcast network; and

wherein the passive list further includes one or more character strings from a previously received closed captioning stream of textual data corresponding to a previously received video signal of the television program corresponding to the indicator.

20. The local client set-top box as defined in claim 14, further comprising a storage device to store the received video signals, wherein:

one said tuner receives one said multiplexed channel carrying a signal containing electronic programming guide (EPG) data that includes, for a plurality of television programs, the starting time and the stopping time thereof;

when the number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds the predetermined threshold number indicating that content programming corresponding to viewer interests has been located, the processor executes a video record application to record on the storage device the corresponding video signals of a television program from the starting time and to the stopping time thereof as determined from the EPG data.

21. The local client set-top box as defined in claim 14, further comprising a storage device to store the received video signals, wherein:

one said tuner receives one said multiplexed channel carrying a signal containing EPG data that includes, for a plurality of television program, a textual description of each said television program and the starting time and the stopping time thereof;

the processor executes an EPG application to search the textual description of each said television program received by the one said tuner for occurrences of textual data matching the first and second terms; and

for each occurrence of textual data matching the first and second search terms in the EPG application, the processor executes a video record application to record on the storage device the video signals of a television program received on one said multiplexed channel and corresponding to one or more of said matches of the EPG application.

22. The local client set-top box as defined in claim 14, further comprising:

an input device to receive input from a viewer of a first input for replacing an output to the television receiver with a different output that includes, for each said channel, a sequential output of a partial portion of the closed captioning stream of textual data that includes each occurrence of textual data matching said first or second search terms.

23. The local client set-top box as defined in claim 14, wherein the signal output device notifies the viewer that content programming corresponding to viewer interests has been located by sending a notification message to a telephone number of the viewer, wherein the sending the notification message to the telephone number of the viewer includes placing a telephone call to the viewer.

24. The local client set-top box as defined in claim 14 wherein:

content corresponding to the received video signals is stored in a buffer while searching said stream of textual data; and

following a determination that the number of matches exceeds the threshold number, the processor records content programming as a recording by moving the content of the buffer to a more permanent storage location than the buffer so that a beginning of the content programming is included in the recording.

25. The local client set-top box as defined in claim 14, wherein:

content corresponding to the received video signals is stored in a buffer while searching said stream of textual data; and

when the number of matches does not exceed the threshold number after a predetermined period of time, the processor stops searching a first closed captioning stream of textual data from a first channel, deletes the corresponding content from the buffer, and instead starts searching a second closed captioning stream of textual data from a second channel.

26. The local client set-top box as defined in claim 23, wherein the signal output device outputs the notification to the viewer by displaying a notification message as a display line displayed in conjunction with programming that the viewer is viewing, wherein the display line specifies at least one channel currently having the content programming corresponding to the viewer interests.

27. A digital video recorder comprising:

one or more tuners to receive a plurality of multiplexed channels of a broadcast network each carrying video signals;

one or more devices to obtain textual data from recorded video content on a video media device;

a decoder to extract a stream of textual data from each channel and each video media device;

a processor executing an application to compare, for each channel and each video media device, the stream of textual data with both an active list and a passive list for occurrences of textual data matching first search terms in the active list or second search terms in the passive list, wherein;

the active list includes a plurality of first character strings as the first search terms obtained from input entered by a viewer;

the passive list includes a plurality of second character strings as the second search terms, which reflect interests of the viewer, that have been extracted one or more times from one or more previously received closed captioning streams of textual data of previously received video signals that the viewer has viewed or recorded, the one or more second character strings being extracted based on a frequency of occurrence in the previously received textual data, wherein the character strings comprising the second search terms comprise only verbs, nouns or proper nouns to reduce a counting overhead associated with the passive list; and

the comparing including determining whether a number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds a threshold number, wherein when the number of matches of the first search terms of the active list and the second search terms of the passive list does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed captioning stream is reached, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel; and

a device to output to a display device a notification when the number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds the threshold number indicating that content programming corresponding to viewer interests has been located.

28. A method comprising:

receiving, by a processor, a stream of data contained in signals that are broadcast on a multiplexed channel of a broadcast network;

extracting, by the processor, a stream of textual data from the received stream of data, wherein the stream of textual data is synchronized with the received stream of data;

searching, by the processor, said stream of textual data for occurrences of textual data matching one or more search terms, wherein the searching said stream of textual data for occurrences of textual data matching one or more search terms comprises;

comparing, by the processor, the stream of textual data to both an active list and a passive list, wherein;

the active list includes a plurality of first character strings as first search terms obtained from input entered by a viewer;

the passive list includes a plurality of second character strings as second search terms that have been extracted from one or more previously received streams of textual data of the received stream of data that the viewer has viewed or recorded, the one or more second character strings being extracted based on a frequency of occurrence of the character strings in the previously received textual data; and

the comparing including determining whether a number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds a threshold number, wherein when the number of matches of the first search terms of the active list and the second search terms of the passive list does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed captioning stream is reached, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel;

applying a greater weight to the first search terms in the active list than a weight applied to the second search terms in the passive list when counting the number of matches; and

outputting a notification when the number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds the threshold number indicating that content programming corresponding to viewer interests has been located.

29. The method according to claim 28, further comprising:

sequentially outputting to a display device a partial portion of the stream of textual data that includes each occurrence of textual data matching said first or second search terms.

30. The method according to claim 28, further comprising outputting the notification as a display line displayed in conjunction with programming that the viewer is viewing, wherein the display line specifies at least one channel currently having the content programming determined to correspond to viewer interests.

31. The method according to claim 28 further comprising outputting the notification by sending a notification message to a telephone number or email address of the viewer that the content programming corresponding to viewer interests has been located.

32. An entertainment system comprising:

a broadcast network including a plurality of multiplexed channels each carrying video signals;

a content distribution system to broadcast television content in video signals carried over the broadcast network on the plurality of multiplexed channels, the video signals carried by each said channel including content programming and a closed captioning stream of textual data;

a plurality of client devices, each including one or more tuners for receiving the video signals carried on the multiplexed channels of the broadcast network; and

an interest assessment system including;

a closed caption decoder to extract, from each said channel, the closed captioning stream of textual data;

a processor executing an application to search, for each said channel, the closed captioning stream of textual data for occurrences of textual data matching first search terms of an active list and second search terms of a passive list, wherein the application comprises a component for comparing the closed captioning stream of textual data to both the active list and the passive list;

the active list comprising one or more predefined first character strings as the first search terms;

the passive list comprising one or more second character strings as the second search terms that have been extracted by the closed caption decoder from one or more previously received closed captioning streams of textual data of previously received video signals that the viewer has viewed or recorded, the one or more second character strings being extracted base on a frequency of occurrence in the previously received textual data;

the comparing including determining whether a number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds a threshold number, wherein when the number of matches of the first search terms of the active list and the second search terms of the passive list does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed captioning stream is reached, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel; and

an output device to output a notification when the number of matches of the first search terms of the active list or the second search terms of the passive list in comparison with the textual data exceeds the threshold number indicating that content programming corresponding to viewer interests has been located.

33. The entertainment system as defined in claim 32, wherein a greater weight is applied to the first search terms in the active list than a weight applied to the second search terms in the passive list when counting the number of matches.

34. The entertainment system as defined in claim 32, wherein the output device outputs the notification by sending a notification message to a telephone number or email address of the viewer that the content programming corresponding to viewer interests has been located.

35. The entertainment system as defined in claim 32, wherein the output device outputs the notification as a display line displayed in conjunction with programming that the viewer is viewing, wherein the display line specifies at least one channel currently having the content programming determined to correspond to viewer interests.

36. The entertainment system as defined in claim 32, wherein the output device facilitates displaying each occurrence of textual data matching the first or second search terms in context with adjacent words in the closed captioning stream of textual data in a presentation providing:

vertical scrolling between a plurality of sources of occurrences of textual data matching said first or second search terms in the closed captioning stream of the plurality of sources; and

horizontal scrolling illustrating chronological occurrences of textual data matching said first or second search terms in the closed captioning stream of a respective source.

37. A method of selecting content programming in video data, the method comprising:

creating an active list of first search terms by receiving input from a viewer at a user interface to develop one or more first search terms for creating the active list;

creating a passive list of second search terms by monitoring closed captioning textual data for creating the passive list of second search terms, the passive list comprising one or more character strings that have been extracted one or more times from previously received closed captioning streams of textual data of received video signals that the viewer has viewed or recorded, the one or more second character strings being extracted based on a frequency of occurrence in the previously received textual data;

extracting, from a received video signal, a closed captioning stream of textual data;

searching the stream of textual data for occurrences of textual data matching the first or second search terms by comparing the closed captioning stream of textual data to both the active list and the passive list, the comparing including determining whether a number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds a threshold number, wherein when the number of matches of the first search terms of the active list and the second search terms of the passive list does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed captioning stream is reached, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel; and

outputting a notification when the number of matches of the first search terms of the active list and/or the second search terms of the passive list in comparison with the textual data exceeds the threshold number indicating that content programming determined to be of interest to the viewer has been located.

38. The method as defined in claim 37 further comprising:

displaying each occurrence of textual data matching the first or second search terms in context with adjacent words in the closed captioning stream of textual data such that the display facilitates;

vertical scrolling between a plurality of sources of occurrences of textual data matching the first or second search terms in the closed captioning stream of the plurality of sources; and

horizontal scrolling illustrating chronological occurrences of textual data matching the first or second search terms in the closed captioning stream of a respective source.

39. The method as defined in claim 37, further comprising applying a greater weight to the first search terms in the active list than a weight applied to the second search terms in the passive list when counting the number of matches.

40. The method as defined in claim 37, further comprising outputting the notification by displaying a notification message as a display line displayed in conjunction with programming that the viewer is viewing, wherein the display line specifies at least one channel currently having the content programming determined to be of interest to the viewer.

41. The method as defined in claim 37, wherein the notification is displayed using at least one process performed on a television receiver that is selected from the group consisting of picture in picture, split screen, video text and selective picture.

42. The method as defined in claim 37, further comprising notifying the viewer that the content programming determined to be of interest to the viewer has been located by sending a notification message to a telephone number of the viewer.

43. The method as defined in claim 42, further comprising recording the content programming determined to be of interest to the viewer when the viewer does not respond to the telephone notification message within a predetermined period of time.

44. The method as defined in claim 37, further comprising:

storing the content programming corresponding to the received video signals in a buffer while searching said stream of textual data; and

following the determining that the number of matches exceeds the threshold number, recording the content programming as a recording by moving content of the buffer to a more permanent storage location than the buffer so that a beginning of the content programming is included in the recording.

45. The method as defined in claim 37, further comprising:

storing the content programming corresponding to the received video signals in a buffer while searching said stream of textual data;

when the number of matches does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed caption stream, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel.

46. The method as defined in claim 37, further comprising:

including an omission list of words as part of the first search terms in the active list; and

when a word on the word omission list is encountered, during subsequent playback of the content programming, a portion of the content programming corresponding to the word on the word omission list is omitted from playback.

47. The method as defined in claim 37, further comprising:

accessing an interconnected network to transmit the notification as a notification message to an address thereon for notifying the viewer that the content programming corresponding to viewer interests has been located;

receiving input including the address on the interconnected network;

forming the notification message addressed to the address on the interconnected network and containing data relative to the occurrence of textual data matching said one or more search terms; and

transmitting, upon each said occurrence of textual data matching said one or more search terms, the formed notification message to the address on the interconnected network for providing the viewer with notification that the content programming corresponding to viewer interests has been located.

48. The method as defined in claim 41, wherein the interconnected network and the address thereon are an email server and an email address at the email server.

49. A method comprising:

receiving a stream of data contained in signals that are broadcast on a multiplexed channel of a broadcast network;

extracting a stream of textual data from the received stream of data, wherein the stream of textual data is synchronized with the received stream of data;

searching the stream of textual data for occurrences of textual data matching one or more search terms, the searching the stream of textual data for occurrences of textual data matching one or more search terms further comprising;

comparing the stream of textual data to both an active list and a passive list,

the active list comprising one or more first character strings as first search terms obtained from input entered by a viewer;

the passive list comprising one or more second character strings as second search terms that have been extracted one or more times from one or more previously received streams of textual data of previously received streams of data that the viewer has viewed or recorded, the one or more second character strings being extracted based on a frequency of occurrence in the previously received textual data; and

the comparing including determining whether a number of matches of the first search terms of the active list and the second search terms of the passive list with the textual data exceeds a threshold number, wherein when the number of matches of the first search terms of the active list and the second search terms of the passive list does not exceed the threshold number after a predetermined period of time, ceasing to search a first closed captioning stream of textual data from a first channel before an end of the first closed captioning stream is reached, deleting the corresponding content programming from the buffer, and searching instead a second closed captioning stream of textual data from a second channel; and

outputting a notification when the number of matches of the first search terms of the active list and the second search terms of the passive list in comparison with the textual data exceeds the threshold number indicating that content programming determined to be of interest to the viewer has been located.

50. The method of claim 49 further comprising:

displaying each occurrence of textual data matching the first or second search terms in context with adjacent words in the closed captioning stream of textual data to facilitate;

vertical scrolling between a plurality of sources of occurrences of textual data matching the first or second search terms in the closed captioning stream of the plurality of sources; and

horizontal scrolling illustrating chronological occurrences of textual data matching the first or second search terms in the closed captioning stream of a respective source.

51. The method as defined in claim 49, further comprising applying a greater weight to the first search terms in the active list than a weight applied to the second search terms in the passive list when counting the number of matches.