System, method, and computer program product for selective replacement of objectionable program content with less-objectionable content

• US 8,245,252 B2
• Filed: 09/09/2003
• Issued: 08/14/2012
• Est. Priority Date: 09/10/2002
• Status: Active Grant

• Current Assignee: III Holdings 1, LLC (Intellectual Ventures LLC)
• Original Assignee: Caption TV, Inc.
• Inventors: Gee, Jeanette, Robson, Gary, Gee, James D. Jr.
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Hicks, Charles N
• Application Number:
  US10/658,344
• Publication Number:
  US 20040049780A1
• Time in Patent Office: 3,262 Days
• Field of Search: 725/20, 725/28, 725/36
• US Class Current: 725/36
• CPC Class Codes: H04N 21/4318 by altering the content in the rendering process, e.g. blanking, blurring or masking an image region image enhancement or restoration in general G06T5/00
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4751 for defining user accounts, e.g. accounts for children
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 7/088 the inserted signal being digital
• CPC Class Codes: H04N 7/17363 at or near the user terminal

Abstract

A system, method, and computer program product is provided for the selective replacement of objectionable content in a program with less-objectionable material. The selective replacement of objectionable content in a program with less-objectionable material is accomplished by applying an encoding process and a decoding process to the audio and/or video signal of the program. The encoding process includes marking potentially objectionable material in the program with replacement information that identifies the type (e.g., audio, violent content, sexual content, etc.) and intensity level (e.g., mild, graphic, extreme, etc.) of the potentially objectionable material using replacement codes. The decoding process includes comparing, during the presentation of the program to the user and prior to outputting the audio or displaying the video, the replacement information to a replacement criterion, which includes user supplied replacement settings, to determine whether replacement of the potentially objectionable content (i.e., audio and/or video) should be performed. If replacement is to be performed, the objectionable content in the program is replaced according to the replacement information which, in the preferred embodiment, identifies the start and duration of the replacement and, for replacement of the video of the program, also identifies the display area of the video to be replaced.

Claims

1. An apparatus for selectively replacing objectionable content in a video program intended for viewing on a display screen comprising a first video signal with less-objectionable content, comprising:

an extraction device receiving at least a portion of the first video signal and configured to extract information therefrom;

a replacement control device;

a processor operatively coupled to said replacement control device and communicatively coupled to said extraction device for receiving at least a portion of said extracted information therefrom;

a memory coupled to said processor and storing a replacement criterion;

said processor programmed to identify replacement information in said extracted information;

a replacement video signal including said less-objectionable content communicatively coupled to said replacement control device; and

said processor programmed to cause said replacement control device to replace a portion of the first video signal with said replacement video signal in response to identifying replacement information that satisfies said replacement criterion, wherein said less-objectionable content comprises advertising and wherein the advertising only replaces specified subregions of displayed video frames corresponding to the location of the objectionable content within the displayed video frames.

2. The apparatus of claim 1, wherein said first video signal is selected from the group consisting of:

a Digital Radio Broadcast signal, a broadcast television signal, a cable television signal, an RF signal, and an Internet signal.

3. The apparatus of claim 1, wherein said replacement information is present in a vertical blanking interval of the first video signal.

4. The apparatus of claim 1, wherein said replacement information is present in a line 21 of the first video signal.

5. The apparatus of claim 4, wherein said replacement information is present in a Text field of the first video signal.

6. The apparatus of claim 1, wherein said replacement information includes information relating to a duration the portion of said first video signal is to be replaced in response to said replacement information satisfying said replacement criterion.

7. The apparatus of claim 1, wherein said replacement information includes content selected from the group consisting of:

information identifying a portion of the first video signal having violent content, information identifying a portion of the first video signal having sexual content, and information identifying a portion of the first video signal having potentially objectionable language.

8. The apparatus of claim 1, wherein said replacement information includes information relating to a time in the first video signal at which the replacing should begin.

9. The apparatus of claim 1, wherein said replacement information includes information relating to a level of intensity of the objectionable content.

10. The apparatus of claim 1, wherein:

said memory contains a plurality of words stored therein;

said extraction device is configured to extract a closed caption signal from the first video signal;

said processor receives said extracted closed caption signal and is programmed to compare words in said extracted closed caption signal with said words stored in said memory; and

said processor causes said replacement device to replace an audio signal in response to determining that a word stored in said memory is present in said extracted closed caption signal.

11. The apparatus of claim 1, wherein said replacement criterion is received from a user.

12. A method of selectively replacing objectionable content in a first video signal intended for viewing on a display screen with less-objectionable content, said method comprising the steps of:

storing a replacement criterion in a memory;

receiving said less-objectionable content as a replacement video signal;

receiving the first video signal;

extracting replacement information from the first video signal;

determining whether the extracted replacement information satisfies said replacement criterion; and

replacing a portion of the first video signal with the replacement video signal in response to determining that said extracted replacement information satisfies said replacement criterion, wherein said less-objectionable content comprises advertising and wherein the advertising only replaces specified subregions of displayed video frames corresponding to the location of the objectionable content within the displayed video frames.

13. The method of claim 12, wherein said first video signal is selected from the group consisting of:

a Digital Radio Broadcast signal, a broadcast television signal, a an cable television signal, an RF signal, and an Internet signal.

14. The method of claim 12, wherein said replacement information is present in a vertical blanking interval of the first video signal.

15. The method of claim 12, wherein said replacement information is present in a line 21 of the first video signal.

16. The method of claim 12, wherein said replacement information is present in a Text field of the first video signal.

17. The method of claim 12, wherein said replacement information includes information relating to a duration the portion of said first video signal should be replaced in response to said replacement information satisfying said replacement criterion.

18. The method of claim 12, wherein said replacement information is selected from the group consisting of:

information identifying a portion of the first video signal having violent content, information identifying a portion of the first video signal having sexual content, and information identifying a portion of the first video signal having potentially objectionable language.

19. The method of claim 12, wherein said replacement information includes information relating to a relative time in the first video signal said replacement should begin.

20. The method of claim 12, wherein said replacement information includes information relating to the level of intensity of the objectionable content.

21. The method of claim 12, further including:

storing a plurality of words in said memory;

extracting a closed caption signal from the first video signal;

comparing said closed caption signal with said words stored in said memory; and

replacing the word in an audio signal with less-objectionable content in response to determining that a word in said memory is present in said closed caption signal.

22. The method of claim 12, further comprising the step of receiving said replacement criterion from a user.

23. A method for selectively replacing objectionable content from a signal having both audio and video signal components intended for presentation on a display screen, said method comprising:

storing replacement criteria in a memory identifying disallowed video content;

receiving the signal;

extracting information from said signal identifying objectionable content in said signal;

determining whether said extracted information satisfies said replacement criteria; and

modifying the video signal component with replacement video data in response to determining that said extracted information satisfies said replacement criteria so that only specified subregions of displayed video frames corresponding to disallowed video content are replaced with advertising.

24. The method of claim 23, wherein said extracted information includes information relating to the duration the video signal component of said signal should be modified in response to said extracted information satisfying said replacement criteria.

25. The method of claim 23, wherein said extracted information includes information relating to the level of intensity of the objectionable content.

26. The method of claim 23, further comprising the step of receiving said replacement criteria from a user.

27. The method of claim 23, wherein said extracted information is present in the vertical blanking interval of a television signal.

28. The method of claim 27, wherein said extracted information is present in line 21 of the television signal.

29. A device for selectively filtering objectionable content from a video program intended for viewing on a display screen comprising a video signal component, said device comprising:

an extraction device receiving all or part of said video signal component and configured to extract filter codes therefrom identifying potentially objectionable content in said video program;

a video control device;

a processor operatively coupled to said video control device and communicatively coupled to said extraction device for receiving extracted filter codes;

a memory coupled to said processor and storing criteria defining disallowed video content; and

said processor programmed to cause said video control device to selectively obscure only subregions of displayed video frames corresponding to disallowed video content with advertising when extracted filter codes match said criteria.

30. The device of claim 29 wherein said filter codes define the coordinates of the subregions within the video frames.

31. The device of claim 30 wherein the subregions are rectangular regions encompassing the disallowed video content.