REAL-TIME CONTENT FILTERING AND REPLACEMENT

• US 20160373814A1
• Filed: 06/19/2015
• Published: 12/22/2016
• Est. Priority Date: 06/19/2015
• Status: Abandoned Application

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Kellner, Hans
• Application Number:
  US14/744,768
• Publication Number:
  US 20160373814A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/45452 applied to an object-based stream, e.g. MPEG-4 streams
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for augmenting video streams. A video stream is received. Prior to presentation on a device, the video stream is processed to identify objects to be replaced in the video stream. A profile associated with a user who will view the video stream is identified. Preferences of the user are determined regarding subject matter embodied in objects that preferably be included or excluded from video. A determination is made whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation. If the user has indicated a replacement preference, replacement content is inserted in the video stream associated with the first objects. If the user has indicated an alteration preference for altering content, first objects are altered in accordance with the alteration preference. The updated video stream is provided.

Claims

1. A computer-implemented method comprising:

receiving a video stream; and

prior to presenting the video stream on a device to an end user, processing the video stream and identifying one or more objects to be replaced in the video stream including;

identifying a profile associated with the end user that is to view the video stream;

determining one or more preferences of the end user regarding subject matter embodied in objects that preferably be included or excluded from video presented to the end user;

determining, based on the one or more preferences, whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation to the end user;

determining when the end user has indicated a replacement preference for replacement content and when so, inserting the replacement content at a location in the video stream associated with the first objects producing an updated video stream;

determining when the end user has indicated an alteration preference for altering content and when so, altering the first objects in accordance with the alteration preference producing the updated video stream; and

providing the updated video stream to the end user.

2. The method of claim 1 wherein determining whether the video stream includes the first objects includes evaluating metadata for the video to locate objects of interest.

3. The method of claim 1 wherein determining whether the video stream includes the first objects includes buffering the video stream, evaluating individual frames of the video stream included in the buffer, locating the first objects, and replacing or altering the first objects in accordance with the replacement and alteration preferences.

4. The method of claim 3 wherein the first objects include ad slots and wherein evaluating individual frames includes locating ad slots in individual frames and replacing or altering content included in a located ad slot based on the replacement and alteration preferences.

5. The method of claim 1 wherein the first objects are related to a first subject matter and wherein determining whether the video stream includes the first objects includes evaluating individual frames of the video stream, locating features in a respective video frame, evaluating the features to determine when the features are associated with the subject matter and altering or replacing features in accordance with the alteration and replacement preferences.

6. The method of claim 1 wherein determining whether the video stream includes first objects includes determining whether a frame of the video includes a product, and when so, replacing or altering a portion of the frame to exclude or alter presentation of the product based on the alteration and replacement preferences.

7. The method of claim 1 wherein determining whether the video stream includes first objects includes determining whether each frame in the video stream includes an advertisement and when so, replacing or altering a portion of the frame that includes the advertisement in accordance with the alteration and replacement preferences.

8-21. -21. (canceled)

22. A system comprising:

one or more processors; and

one or more memory devices including instructions that, when executed, cause the one or more processors to perform operations comprising;

receiving a video stream; and

prior to presenting the video stream on a device to an end user, processing the video stream and identifying one or more objects to be replaced in the video stream including;

identifying a profile associated with the end user that is to view the video stream;

determining one or more preferences of the end user regarding subject matter embodied in objects that preferably be included or excluded from video presented to the end user;

determining, based on the one or more preferences, whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation to the end user;

determining when the end user has indicated a replacement preference for replacement content and when so, inserting the replacement content at a location in the video stream associated with the first objects producing an updated video stream;

determining when the end user has indicated an alteration preference for altering content and when so, altering the first objects in accordance with the alteration preference producing the updated video stream; and

providing the updated video stream to the end user.

23. The system of claim 22 wherein determining whether the video stream includes the first objects includes evaluating metadata for the video to locate objects of interest.

24. The system of claim 22 wherein determining whether the video stream includes the first objects includes buffering the video stream, evaluating individual frames of the video stream included in the buffer, locating the first objects, and replacing or altering the first objects in accordance with the replacement and alteration preferences.

25. The system of claim 24 wherein the first objects include ad slots and wherein evaluating individual frames includes locating ad slots in individual frames and replacing or altering content included in a located ad slot based on the replacement and alteration preferences.

26. The system of claim 22 wherein the first objects are related to a first subject matter and wherein determining whether the video stream includes the first objects includes evaluating individual frames of the video stream, locating features in a respective video frame, evaluating the features to determine when the features are associated with the subject matter and altering or replacing features in accordance with the alteration and replacement preferences.

27. The system of claim 22 wherein determining whether the video stream includes first objects includes determining whether a frame of the video includes a product, and when so, replacing or altering a portion of the frame to exclude or alter presentation of the product based on the alteration and replacement preferences.

28. The system of claim 22 wherein determining whether the video stream includes first objects includes determining whether each frame in the video stream includes an advertisement and when so, replacing or altering a portion of the frame that includes the advertisement in accordance with the alteration and replacement preferences.

29. A non-transitory computer-readable medium storing instructions, that when executed, cause one or more processors to perform operations comprising:

receiving a video stream; and

prior to presenting the video stream on a device to an end user, processing the video stream and identifying one or more objects to be replaced in the video stream including;

identifying a profile associated with the end user that is to view the video stream;

determining one or more preferences of the end user regarding subject matter embodied in objects that preferably be included or excluded from video presented to the end user;

determining, based on the one or more preferences, whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation to the end user;

determining when the end user has indicated a replacement preference for replacement content and when so, inserting the replacement content at a location in the video stream associated with the first objects producing an updated video stream;

determining when the end user has indicated an alteration preference for altering content and when so, altering the first objects in accordance with the alteration preference producing the updated video stream; and

providing the updated video stream to the end user.

30. The non-transitory computer-readable medium of claim 29 wherein determining whether the video stream includes the first objects includes evaluating metadata for the video to locate objects of interest.

31. The non-transitory computer-readable medium of claim 29 wherein determining whether the video stream includes the first objects includes buffering the video stream, evaluating individual frames of the video stream included in the buffer, locating the first objects, and replacing or altering the first objects in accordance with the replacement and alteration preferences.

32. The non-transitory computer-readable medium of claim 31 wherein the first objects include ad slots and wherein evaluating individual frames includes locating ad slots in individual frames and replacing or altering content included in a located ad slot based on the replacement and alteration preferences.

33. The non-transitory computer-readable medium of claim 29 wherein the first objects are related to a first subject matter and wherein determining whether the video stream includes the first objects includes evaluating individual frames of the video stream, locating features in a respective video frame, evaluating the features to determine when the features are associated with the subject matter and altering or replacing features in accordance with the alteration and replacement preferences.

34. The non-transitory computer-readable medium of claim 29 wherein determining whether the video stream includes first objects includes determining whether a frame of the video includes a product, and when so, replacing or altering a portion of the frame to exclude or alter presentation of the product based on the alteration and replacement preferences.

35. The non-transitory computer-readable medium of claim 29 wherein determining whether the video stream includes first objects includes determining whether each frame in the video stream includes an advertisement and when so, replacing or altering a portion of the frame that includes the advertisement in accordance with the alteration and replacement preferences.