System and method for annotating a video with advertising information

• US 9,930,311 B2
• Filed: 04/22/2013
• Issued: 03/27/2018
• Est. Priority Date: 10/20/2011
• Status: Active Grant

• Current Assignee: Geun-Sik Jo
• Original Assignee: Geun-Sik Jo
• Inventors: Jo, Geun Sik
• Primary Examiner(s): Gee, Alexander
• Application Number:
  US13/867,489
• Publication Number:
  US 20140140680A1
• Time in Patent Office: 1,800 Days
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 9/8715 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Abstract

Embodiments of the present invention provide a client terminal (e.g., user terminal or advertiser terminal) for displaying a video annotated with advertisement information. Specifically, among other things, embodiments of the present invention provide a client terminal including a video player module configured to receive video based on a user request. The client terminal also further includes an advertising information search module configured to receive an advertising information overlay. The client terminal further includes an advertising information display module configured to simultaneously display the requested video and the advertising information overlay on a display of the user terminal.

Claims

1. A system for displaying a video augmented with advertisement information, comprising:

an advertiser device comprising one or more processors, memory, and a set of instructions that cause the one or more processors to perform the following;

generate an advertising information overlay based on display data from an advertiser comprising product information and an identification of one or more visual objects which, when the advertising information overlay is imposed over a displayed video comprising a visual object of the one or more visual objects, the advertising information overlay tracks with from one frame of the displayed video to a second frame of the displayed video;

receive a request for a video from a display device;

determine whether an object visually displayed within the requested video is one of the identified visual objects of the generated advertising information overlay;

capture, in response to a positive determination, a movement route of the visually displayed object within the requested video by sampling frames of the requested video;

configure, in response to the positive determination, the advertising information overlay to track with the captured movement route of the visually displayed object in the requested video; and

transmit the requested video and, in response to the positive determination, the configured overlay to the display device;

the display device comprising a display, one or more processors, memory, and a set of instructions that cause the one or more processors to perform the following;

play the requested video on the display;

receive a request from a user to transmit the playing the requested video to a personal device associated with the user;

determine, based on an identity of the user, whether the user is in a target user group;

apply, in response to a determination that the user is in the target user group, the advertising information overlay comprising the product information to the video; and

transmit, in response to the user request, the video to the personal device, wherein the advertising information overlay is transmitted with the video in the case that the user is in the target group and wherein the video continues to play on the display; and

the personal device, for displaying the video augmented with the advertisement information overlay, comprising one or more processors, memory, a display, and a set of instructions that cause the one or more processors to perform the following;

receive the video from the display device based on the user request;

receive, in response to the determination that the user is in the target user group, the advertising information overlay, product information of the advertising information overlay comprising at least one item of information selected from the group consisting of;

a product name, a product description, a product advertiser, and a product price, the product information presented as at least one of;

text, video, an image, sound, and a three-dimensional (3D) object;

play, based on the determination that the user is in the target user group, the advertising information overlay with the requested video, wherein the overlay tracks with the visually displayed object from a first location to a second location over a first frame and a second frame of the requested video;

play, based on a determination that the user is not in the target user group, the requested video absent the advertising information overlay; and

permit user interaction, through the advertising information overlay displayed on the personal device, between the user and the display device, wherein the display device and the user device simultaneously play the video, by transmitting a user input associated with the object to the display device and, in response, receiving a personalized advertisement, based on at least one of;

the user input and a user profile, associated with the advertising information overlay displayed with the requested video, the personal advertisement presenting at least one vendor associated with the object in the video.

2. The personal device of claim 1, the personal device being associated with the user wherein, in response to a selection from the advertising information overlay by the user, the personalized advertisement comprises additional advertising information displayed on the personal device of the user as the requested video is being displayed on the display.

3. The system of claim 1, wherein the advertising information overlay is related to at least one of the requested video, a video scene of the requested video, a video frame of the requested video, or a visual object in the requested video.

4. The display device of claim 1, further comprising an advertising information manager module configured to manage the overlay and the retrieved video as a composite, the managing comprising receiving:

video recognition information, a video start time, a video run time, a website address related to the advertising information overlay, advertising information, and a scene relating to the advertising information overlay.

5. The personal device of claim 1, further comprising a video player module configured to display the requested video on the display.

6. The personal device of claim 1, the receiving of the advertising information overlay further comprising searching the display device for an advertised information overlay based on at least one of the requested video, a video scene of the requested video, a video frame of the requested video, or a visual object in the requested video.

7. The display device of claim 1, wherein the advertising information overlay includes at least one of advertising information related to a product, data related to a visual object associated with the overlay, overlay display time, overlay display location, or overlay display criteria.

8. The display device of claim 1, the set of instructions further causing the one or more processors to:

determine the presence and location of a visual object within a frame of the requested video based on an appearance of the visual object within the frame;

identify the visual object as being associated with the advertising information overlay; and

display the advertising information overlay based on the location of the visual object.

9. The personal device of claim 1, the set of instructions further causing the one or more processors to receive a message from the display device and extract the advertising information overlay and video information from the message.

10. The personal device of claim 9, the receiving of the video further comprising displaying the requested video based on the video information.

11. The display device of claim 1, the set of instructions further causing the one or more processors to generate the advertising information overlay and synchronize the advertising information overlay and the requested video.

12. The display device of claim 1, the set of instructions further causing the one or more processors to define the target user group, wherein the advertising information overlay is displayed when the user is a member of the target user group.

13. The personal device of claim 9, the set of instructions further causing the one or more processors to transmit the message to the display device.

14. A method for displaying a video augmented with advertisement information on a personal device, comprising:

generating an advertising information overlay based on display data from an advertiser comprising product information and an identification of one or more visual objects which, when the advertising information overlay is imposed over a displayed video comprising a visual object of the one or more visual objects, the advertising information overlay tracks with from one frame of the displayed video to a second frame of the displayed video;

receiving a request for a video from a display device;

determining whether an object visually displayed within the requested video is one of the identified visual objects of the generated advertising information overlay;

capturing, in response to a positive determination, a movement route of the visually displayed object within the requested video by sampling frames of the requested video;

configuring, in response to the positive determination, the advertising information overlay to track with the captured movement route of the visually displayed object in the requested video; and

transmitting the requested video and, in response to the positive determination, the configured overlay to the display device;

receiving a user request from a personal device associated with the user for the requested video playing on the display device;

determining, based on an identity of the user associated with the personal device, whether the user issuing the user request is in a target user group;

apply, in response to a determination that the user is in the target user group, the advertising information overlay to the video, wherein the overlay comprises the product information comprising at least one of;

a product name, a product description, a product advertiser, and a product price, the product information presented as at least one of;

text, video, an image, sound, and a three-dimensional (3D) object;

transmitting, in response to the user request, the video to the personal device, wherein the advertising information overlay is transmitted with the video in the case that the user is in the target group and wherein the video continues to play on the display;

playing, at the personal device, based on the determination that the user is in the target user group, the advertising information overlay with the requested video on a display of the personal device, wherein the overlay tracks with the visually displayed object from a first location to a second location over a first frame and a second frame of the requested video;

playing, at the personal device, based on a determination that the user is not in the target user group, the requested video absent the advertising information overlay; and

permitting user interaction through the advertising information overlay displayed on the personal device, between the user and the display device, wherein the display device and the user device simultaneously play the video, by transmitting a user input associated with the object to the display device and, in response, receiving a personalized advertisement, based on at least one of;

the user input and a user profile, associated with the advertising information overlay displayed with the requested video, the personal advertisement presenting at least one vendor associated with the object in the video.

15. The method of claim 14, the personal device being associated with the user, further comprising displaying, in response to a selection from the advertising information overlay by the user, the personalized advertisement comprising additional advertising information on a personal device of the user as the requested video is being displayed on the display.

16. The method of claim 14, further comprising:

identifying an object within a frame of the requested video based on an appearance of the object within the frame;

identifying the object as being associated with the advertising information overlay; and

displaying the advertising information overlay based on the identification.

17. The method of claim 14, further comprising selecting a visual object in the requested video, confirming the visual object is associated with the advertising information overlay and object, and displaying the advertising information overlay based on the confirmation.

18. The method of claim 14, further comprising generating the advertising information overlay and synchronizing the advertising information overlay with the requested video, the synchronizing comprising receiving:

video recognition information, a video start time, a video run time, a website address related to the advertising information overlay, advertising information, and a scene relating to the advertising information overlay.

19. The method of claim 14, further comprising defining a target user group and displaying the advertising information overlay when the user is a member of the target user group.

20. The method of claim 16, further comprising determining a first location of the object, displaying the advertising information overlay based on the first location, determining a second location of the object when the object moves, and displaying the advertising information overlay based on the second location.