SYSTEM AND METHOD FOR MAKING SEMANTIC ANNOTATION FOR OBJECTS IN INTERACTIVE VIDEO AND INTERFACE FOR THE SYSTEM

• US 20150229996A1
• Filed: 12/15/2014
• Published: 08/13/2015
• Est. Priority Date: 02/12/2014
• Status: Active Grant

• Current Assignee: Geun-Sik Jo
• Original Assignee: INHA Industry Partnership Institute
• Inventors: JO, Geun Sik
• Granted Patent: US 9,706,256 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/70 Labelling scene content, e.g. deriving syntactic or semantic representations
• CPC Class Codes: H04N 21/234309 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

A system and method for making a semantic annotation for a moving object in an interactive video and an interface for the system is described. The annotation creating system may include an annotation creating unit adapted to create annotation information on a moving object contained in a video, and an annotation replaying unit adapted to execute a preview of the annotation information by the video frame or shot. The video and the annotation information may be registered in a platform for sharing the video.

Claims

1. An video annotation creating system, comprising:

an annotation creating unit adapted to create annotation information on an object contained in a video; and

an annotation replaying unit adapted to execute a preview of the annotation information by the video frame or shot,

wherein the video and the annotation information are registered in a platform for sharing the video.

2. The video annotation creating system of claim 1, further comprising a video management unit adapted to register a video to be annotated, and

wherein the video is a video uploaded on an internet or stored in a user terminal.

3. The video annotation creating system of claim 1, further comprising a video management unit adapted to register a video to be annotated, and

wherein the video management unit is adapted to convert a format of the video to a compatible format and register the converted video.

4. The video annotation creating system of claim 1, further comprising a tool structured to create an annotation, and

wherein the tool is adapted to include functions for selecting a video, selecting an object in a video, inputting an image or text to be annotated in an object, tracking an object in a video, aligning frames or shots of a video, reviewing or modifying an annotation by an object, and executing a preview of annotation.

5. The video annotation creating system of claim 1, wherein the annotation creating unit is adapted to create the annotation information by means of an image input for the object, and

wherein the image is an image uploaded on an internet or registered in the platform.

6. The video annotation creating system of claim 1, wherein the annotation creating unit is adapted to track the object in the video and accumulate path data of the object by a frame or time.

7. The video annotation creating system of claim 1, wherein the annotation creating unit is adapted to define a function to be performed when the object is selected, with respect to the annotation information.

8. The video annotation creating system of claim 1, wherein the annotation replaying unit is adapted to dispose the annotation information on a video screen, the annotation information being overlaid based on a frame or time corresponding to a path of the object.

16. The video annotation creating system of claim 1, wherein unification of video with the annotation information on an internet is achieved.

17. The video annotation creating system of claim 1, wherein the annotation information is overlaid as the video frame displays on a video screen and the annotation information makes the video interactive.

18. The video annotation creating system of claim 1, wherein the annotation information is managed to be separated from the video.

9. A knowledge sharing system, comprising:

a video management unit adapted to register a video selected by an annotation creating tool;

an annotation management unit adapted to register annotation information created on an object in the video by the annotation creating tool; and

a video replaying unit adapted to apply the annotation information to the video when the video is selected and replay the video including the annotation information thus applied,

wherein a web service is provided to exchange information with the annotation creating tool and to search and watch the video.

10. The knowledge sharing system of claim 9, wherein the video management unit is adapted to convert a format of the video to one video format supported by a user terminal and register the converted video.

11. The video with knowledge sharing system of claim 9, wherein the annotation management unit is adapted to manage an image to be annotated and provide the image to the annotation creating tool.

12. The video with knowledge sharing system of claim 9, wherein the video replaying unit is adapted to dispose the annotation information on a video screen, the annotation information being overlaid based on a frame or time corresponding to a path of the object.

13. The video with knowledge sharing system of claim 9, wherein the annotation management unit is adapted to register a function, which is defined on the annotation information by the annotation creating tool, as a function to be performed when the object is selected, and

wherein the video replaying unit is adapted to overlay the function defined on the annotation information with the object when the video is replayed.

19. The knowledge sharing system of claim 9, wherein a semantic web and social network service (SNS) are provided to exchange information with the annotation creating tool and to implement information push while watching the video.

14. A method for sharing a video with knowledge for a computer, comprising:

registering a video selected by an annotation creating tool;

registering annotation information created on a moving object in the video by the annotation creating tool; and

applying the annotation information to the video when the video is selected and replaying the video including the annotation information thus applied,

wherein a web service is provided to exchange information with the annotation creating tool and to search and watch the video.

15. The method of claim 14, further comprising, before the video and the annotation information are registered,

creating annotation information on a moving object in the video;

and

executing a preview on the annotation information by a video frame or shot,

wherein the video and the annotation information are registered in a platform for sharing the video by the annotation creating tool.

20. The method of claim 14, wherein a semantic web is provided to exchange information with the annotation creating tool and to implement information push while watching the video.