Method and apparatus for providing additional information of video using visible light communication

• US 20090175594A1
• Filed: 01/07/2009
• Published: 07/09/2009
• Est. Priority Date: 01/07/2008
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Son, Jae-Seung, Won, Eun-Tae, Ann, Jong-Hoon
• Granted Patent: US 9,031,376 B2
• Time in Patent Office: Days
• US Class Current: 386/357
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/8583 by creating hot-spots
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/025 Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame transmission of digital non-picture data during the vertical blanking interval only H04N7/088
• CPC Class Codes: H04N 7/08 Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band , e.g. by time division H04N7/007 takes precedence

Abstract

A method and apparatus for providing additional information included in a video displayed on a display device using visible light communication (VLC). A data packet including video data and additional information for an object included in the video data is received. The video data is extracted from the data packet, and the video data is decoded. The additional information from the data packet is extracted, and the additional information decoded. The decoded video data is output through the display device, and at the same time, the additional information is transmitted for a particular object included in a video based on a VLC protocol using a light emitting device prepared in the display device. The additional information providing apparatus includes an image sensor module, a display module, a visible light receiving module, an additional information manager and a controller.

Claims

1. A method for providing additional information included in a video displayed on a display device using visible light communication (VLC), the method comprising:

(a) receiving a data packet including video data and additional information for an object included in the video data;

(b) extracting the video data from the data packet, and decoding the video data;

(c) extracting the additional information from the data packet, and decoding the additional information; and

(d) outputting the decoded video data through the display device, and at the same time, transmitting additional information for a particular object included in a video based on a VLC protocol using a light emitting device prepared in the display device.

2. The method of claim 1, wherein the additional information comprises an identifier indicating a video frame where an object is included, information on a location where the object is prepared in the video frame, and an identifier of the object.

3. The method of claim 1, wherein the additional information is decoded and transmitted in response to receiving an input request via an input device.

4. The method of claim 1, wherein the light emitting device comprises a light emitting device prepared in a region where a particular object included in a video is placed, and the additional information comprises additional information associated with the particular object.

5. The method according to claim 4, wherein a visible light communication (VLC) device delivers a signal VLC-modulated by a VLC protocol to the light emitting devices prepared in regions placed in a video frame.

6. The method according to claim 5, wherein the light emitting devices in the regions where more than one particular object are placed transmits additional information associated with the objects.

7. The method of claim 1, further comprising:

extracting audio data from the data packet and decoding the audio data.

8. The method of claim 1, further comprising:

(e) receiving a visible light signal emitted from a light emitting device in a region where the particular object is situated;

(f) displaying an optical signal in a wavelength band, emitted by a light emitting device prepared in a region where the object is located, using a display of a reception apparatus; and

(g) extracting the additional information transmitted from the light emitting device in the region where the particular object is placed, and providing the extracted additional information.

9. The method of claim 8, wherein the step (g) further comprises:

storing the extracted additional information in a memory.

10. The method of claim 8, wherein the step (g) comprises:

generating a list of a plurality of the extracted additional information;

displaying the additional information list;

receiving selected additional information included in the additional information list; and

displaying detailed information included in the selected additional information.

11. The method of claim 1, wherein the step (c) further comprises:

requesting and acquiring the additional information selectively.

12. A method for providing additional information included in a video by a mobile terminal supporting visible light communication (VLC), the method comprising:

(a) displaying video data, and at the same time, receiving a visible light signal emitted from a display device that transmits additional information for a particular object included in a video based on a VLC protocol;

(b) displaying an optical signal in a wavelength band, emitted by a light emitting device prepared in a region where the object is placed, by a display of the mobile terminal; and

(c) extracting the additional information transmitted from the light emitting device in the region where the particular object is located, and providing the extracted additional information.

13. The method of claim 12, wherein step (c) further comprises:

storing the extracted additional information in a memory.

14. The method of claim 13, wherein step (c) comprises:

(i) generating a list of a plurality of the extracted additional information;

(ii) displaying the additional information list;

(iii) receiving selected additional information included in the additional information list; and

(iv) displaying detailed information included in the selected additional information.

15. An apparatus for transmitting additional information included in a video using visible light communication (VLC), the apparatus comprising:

a demultiplexer for separating from a data packet received from an exterior both video data and data including additional information associated with a particular object included in the video data,;

a video decoder for restoring a video by decoding the video data;

a display device for displaying the restored video through a plurality of light emitting devices;

a data decoder for restoring the data including the additional information; and

a visible light communication device for transmitting visible light comprising the additional information associated with the particular object using a light emitting device prepared in the display device based on a VLC protocol.

16. The apparatus of claim 15, wherein the visible light communication device transmits the additional information associated with the particular object using a light emitting device prepared in a region where the particular object is included in the video data.

17. The apparatus of claim 15, further comprising:

an audio decoder for restoring an audio signal by decoding audio data; and

a speaker for outputting the restored audio signal.

18. An apparatus for receiving additional information included in a video from a display device for displaying the video using a plurality of light emitting devices, and providing the received additional information, the apparatus comprising:

an image sensor for sensing a visible light signal emitted from a light emitting device prepared in the display device, and for converting the received visible light signal into an electric signal;

a visible light receiving module for acquiring data from a signal output from the image sensor based on a visible light communication (VLC) protocol;

an additional information manager for extracting additional information associated with a particular object of the video data from the data acquired by the visible light receiving module; and

a display module for displaying a color-difference signal in a wavelength band corresponding to a visible light signal received from the image sensor and information provided from the additional information manager.

19. The apparatus of claim 18, further comprising:

a memory for storing the extracted additional information.

20. The apparatus of claim 18, wherein the additional information manager generates a list of a plurality of the extracted additional information, and displays the generated additional information list.

21. The apparatus of claim 18, further comprising:

an external input interface for receiving selected additional information from the plurality of the extracted additional information included in the additional information list.