CAPTION REPLACEMENT SERVICE SYSTEM AND METHOD FOR INTERACTIVE SERVICE IN VIDEO ON DEMAND

• US 20150189350A1
• Filed: 02/12/2014
• Published: 07/02/2015
• Est. Priority Date: 12/27/2013
• Status: Active Grant

• Current Assignee: INHA University
• Original Assignee: INHA Industry Partnership Institute
• Inventors: JO, Geun Sik
• Granted Patent: US 9,794,638 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 5/2723 Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement data processing systems or methods specially adapted for marketing G06Q30/02

Abstract

Provided is a caption replacement service system and method for servicing an interactive advertisement on a video on demand (VOD). A system for making an annotation may include an annotation creator configured to create annotation information on a moving object included in a video and an annotation player configured to play a preview on the annotation information based on a frame unit or a shot unit of the video. The video and the annotation information may be used to provide an interactive advertisement by replacing a caption system of the video with a meaningful annotation.

Claims

1. A caption replacement service method performed by a computer system, the method comprising:

loading a video to be annotated;

adding a virtual object area at a location of at least one caption among captions included in the video;

adding an interactive advertisement to the virtual object area; and

storing information on the added virtual object area.

2. The method of claim 1, wherein the loading of the video to be annotated comprises loading the video to be annotated to an annotation tool using a uniform resource locator (URL) of a video present on a web, or selecting a video present in a local computer of a user and loading the selected video to the annotation tool.

3. The method of claim 1, wherein the adding of the virtual object area comprises adding the virtual object area by, in response to a selection of a user on a temporal location and a spatial location indicated by the at least one caption, locating the virtual object area to be above the at least one caption based on the temporal location and the spatial location.

4. The method of claim 1, wherein the adding of the virtual object area comprises generating an information list by extracting information on at least one of a frame, a temporal location, and a spatial location associated with a caption present on the video using an image text cognition technology, and adding the virtual object area at the location of the at least one caption based on information selected by a user from the information list.

5. The method of claim 1, wherein the interactive advertisement comprises at least one of an advertisement image selected by a user and an image extracted from a predetermined advertisement pool.

6. The method of claim 5, wherein the image extracted from the advertisement pool is extracted based on a propensity of the user and a matter of interest of the viewer.

7. The method of claim 1, wherein information on the virtual object area comprises information on at least one of a start time and an end time for displaying the virtual object area, a size of the virtual object area, a display location of the virtual object area, content of the interactive advertisement to be added to the virtual object area, a URL address of the interactive advertisement, and an event address generated in response to a click on the virtual object area.

8. The method of claim 1, wherein the storing of the information on the added virtual object area comprises storing information on the virtual object area in a server in a structuralized form or in an ontology-based semantic form.

9. A caption replacement service method performed by a computer system, the method comprising:

playing a video present on a web;

searching for information on a virtual object area corresponding to the video from metadata associated with the video;

augmenting interactive advertisement information to the virtual object area using the found information on the virtual object area; and

providing an interactive service about an event occurring in the virtual object area by a viewer.

10. The method of claim 9, wherein the playing of the video comprises playing a video selected by the viewer on the web.

11. The method of claim 9, wherein the searching for information on the virtual object area comprises searching for information on the virtual object area corresponding to a video selected by the viewer at a first time when the selected video is played, or at predetermined time intervals, and determining whether a time at which the selected video is to be played and a start time for displaying the virtual object area match.

12. The method of claim 9, wherein the augmenting of the interactive advertisement information comprises disposing and thereby displaying the interactive advertisement information within the video, based on information on a temporal location and a spatial location of the virtual object area in the found information on the virtual object area.

13. The method of claim 9, wherein the event occurs in response to at least one of a click and a mouse over on the interactive advertisement information.

14. The method of claim 9, wherein the providing of the interactive service comprises providing additional information associated with the interactive advertisement information as the interactive service, in response to the occurrence of the event.

15. A caption replacement service system configured in a computer, the caption replacement service system comprising:

at least one storage unit configured to store at least one program;

at least one processor configured to process execution of a video loader, a virtual object area adder, an interactive advertisement adder, and an information storage according to a control of the at least one program;

the video loader configured to load a video to be annotated;

the virtual object area adder configured to add a virtual object area at a location of at least one caption among captions included in the video;

the interactive advertisement adder configured to add an interactive advertisement to the virtual object area; and

the information storage configured to store information on the added virtual object area.

16. The caption replacement service system of claim 15, wherein the virtual object area adder is configured to add the virtual object area by, in response to a selection of a user on a temporal location and a spatial location indicated by the at least one caption, locating the virtual object area to be above the at least one caption based on the temporal location and the spatial location.

17. The caption replacement service system of claim 15, wherein the virtual object area adder is configured to generate an information list by extracting information on at least one of a frame, a temporal location, and a spatial location associated with a caption present on the video using an image text cognition technology, and to add the virtual object area at the location of the at least one caption based on information selected by a user from the information list.

18. The caption replacement service system of claim 15, wherein information on the virtual object area comprises information on at least one of a start time and an end time for displaying the virtual object area, a size of the virtual object area, a display location of the virtual object area, content of the interactive advertisement to be added to the virtual object area, a URL address of the interactive advertisement, and an event address generated in response to a click on the virtual object area.