APPARATUS FOR TRANSMITTING AUGMENTED BROADCAST METADATA, USER TERMINAL, METHOD FOR TRANSMITTING AUGMENTED BROADCAST METADATA, AND REPRODUCING AUGMENTED BROADCAST METADATA

• US 20150156560A1
• Filed: 08/09/2013
• Published: 06/04/2015
• Est. Priority Date: 08/09/2012
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Choi, Bum Suk, Kim, Soon Choul, Kim, Seung Chul, Kim, Jung Hak, Ha, Jeoung Lak, Jeong, Young Ho, Hong, Jin Woo
• Application Number:
  US14/418,795
• Publication Number:
  US 20150156560A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04H 60/73 using meta-information
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

An augmented broadcasting metadata (ABM) transmission apparatus is provided, which includes a metadata generation unit to generate ABM which is necessary for augmented content to be overlapped with broadcasting content; and a metadata transmission unit to transmit the ABM to a user terminal.

Claims

1. An augmented broadcasting metadata (ABM) transmission apparatus comprising:

a metadata generation unit to generate ABM related to an augmented content to be overlapped with broadcasting content; and

a metadata transmission unit to transmit the ABM to a user terminal.

2. The ABM transmission apparatus of claim 1, wherein the metadata generation unit generates instruction unit data by dividing the ABM by time units.

3. The ABM transmission apparatus of claim 2, wherein the instruction unit data comprises at least one selected from augmented region data related to an augmented region in which the augmented content is to be displayed in an overlapping manner, reference region data related to a position of the augmented region, augmented object data related to attributes of the augmented content, environment data necessary for overlap between the broadcasting content and the augmented content, user interaction data related to the augmented content, and instruction time data necessary for synchronization between the broadcasting content and the augmented content, and instruction setting data for setting of the instruction unit data.

4. The ABM transmission apparatus of claim 3, wherein the augmented region data comprises at least one of augmented region shape data indicating a shape of the augmented region, mask image data for expressing the augmented region, and global positioning system (GPS) data of the augmented region.

5. The ABM transmission apparatus of claim 3, wherein the reference region data comprises at least one of coordinate data of the augmented region, displacement data of the augmented region, and boundary data indicating a boundary of a mask image included in the augmented region.

6. The ABM transmission apparatus of claim 3, wherein the augmented object data comprises at least one of augmented content data embedded in the ABM, uniform resource locator (URL) data corresponding to a location of the augmented content, service type data of the augmented object, emotion data of the augmented object, and clear data related to deletion of an augmented object.

7. The ABM transmission apparatus of claim 3, wherein the environment data comprises at least one of lighting data for image matching of the augmented object, field of view data related to the augmented object, and GPS setting data,

wherein the lighting data comprises at least one of lighting position data, lighting direction data, lighting type data, lighting color data, and lighting intensity data.

8. The ABM transmission apparatus of claim 3, wherein the interaction data comprises interaction type data representing a type of a user interaction and interaction event data representing an event according to the type of the user interaction.

9. The ABM transmission apparatus of claim 3, wherein the instruction time data comprises at least one of overlap time data representing a time to display the augmented content on the broadcasting content, life cycle time data of a unit augmented region, a number data representing a number of the instruction unit data that may appear during a life cycle time of the unit augmented region, scale data of the overlap time data, and scale data of the life cycle time data.

10. The ABM transmission apparatus of claim 3, wherein the instruction setting data comprises at least one of flag data representing first instruction unit data of a new augmented region, identification data identifying a unit augmented region, and instruction priority data representing priority of the instruction unit data appearing during same time.

11. The ABM transmission apparatus of claim 2, wherein the metadata generation unit generates next instruction unit data from changed data of previous instruction unit data.

12. The ABM transmission apparatus of claim 2, wherein the metadata generation unit generates next instruction unit data from changed data of key instruction unit data that includes all necessary data related to a new augmented region.

13. The ABM transmission apparatus of claim 1, wherein the metadata transmission unit multiplexes the broadcasting content and the ABM and transmits the broadcasting content and the ABM by one broadcasting stream.

14. A user terminal comprising:

a metadata receiving unit to receive augmented broadcasting metadata (ABM) from an ABM transmission apparatus;

a metadata analysis unit to analyze instruction unit data in the ABM; and

an augmented content reproduction unit to synchronize the broadcasting content with the augmented content based on the analyzed instruction unit data and reproduce the broadcasting content and the augmented content.

15. The user terminal of claim 14, wherein the instruction unit data is data formed by dividing the ABM based on time units.

16. The user terminal of claim 14, wherein the instruction unit data comprises at least one selected from augmented region data related to an augmented region in which the augmented content is to be displayed in an overlapping manner, reference region data related to a position of the augmented region, augmented object data related to attributes of the augmented content, environment data necessary for overlap between the broadcasting content and the augmented content, user interaction data related to the augmented content, and instruction time data necessary for synchronization between the broadcasting content and the augmented content, and instruction setting data for setting of the instruction unit data.

17. The user terminal of claim 14, wherein the metadata analysis unit analyzes a display method for the augmented region and the augmented content by analyzing the instruction unit data based on time units.

18. The user terminal of claim 14, wherein the metadata analysis unit analyzes the ABM by separating the ABM and the broadcasting content from a broadcasting stream when the ABM and the broadcasting content are transmitted by one broadcasting stream.

19. An augmented broadcasting metadata (ABM) transmission method comprising:

generating ABM related to augmented content to be overlapped with broadcasting content; and

transmitting the ABM to a user terminal.

20. An augmented broadcasting metadata (ABM) reproduction method comprising:

receiving ABM from an ABM transmission apparatus;

analyzing instruction unit data in the ABM; and

synchronizing the broadcasting content with the augmented content based on the analyzed instruction unit data and reproducing the broadcasting content and the augmented content.