Method and apparatus for providing additional information of video using visible light communication

• US 9,031,376 B2
• Filed: 01/07/2009
• Issued: 05/12/2015
• Est. Priority Date: 01/07/2008
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Ann, Jong-Hoon, Won, Eun-Tae, Son, Jae-Seung
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): MESA, JOSE M
• Application Number:
  US12/319,441
• Publication Number:
  US 20090175594A1
• Time in Patent Office: 2,316 Days
• Field of Search: 386/230, 386/239, 386/241, 386/326, 386/329, 386/330, 386/357
• US Class Current: 386/230
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/8583 by creating hot-spots
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/025 Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame transmission of digital non-picture data during the vertical blanking interval only H04N7/088
• CPC Class Codes: H04N 7/08 Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band , e.g. by time division H04N7/007 takes precedence

Abstract

A method and apparatus for providing additional information included in a video displayed on a display device using visible light communication (VLC). A data packet including video data and additional information for an object included in the video data is received. The video data is extracted from the data packet, and the video data is decoded. The additional information from the data packet is extracted, and the additional information decoded. The decoded video data is output through the display device, and at the same time, the additional information is transmitted for a particular object included in a video based on a VLC protocol using a light emitting device prepared in the display device. The additional information providing apparatus includes an image sensor module, a display module, a visible light receiving module, an additional information manager and a controller.

Claims

1. A method for providing additional information included in a video displayed on a display device having a plurality of light emitting diodes (LEDs) using a visible light communication (VLC) protocol, the method comprising:

receiving a data packet including video data of the video and additional information associated with a particular object;

extracting the video data from the data packet, and decoding the video data;

extracting the additional information from the data packet, and decoding the additional information; and

generating visible light signals from the plurality of LEDs to output the video displaying the video data and the extracted additional information to at least one further device based on the VLC protocol, wherein first LEDs of the plurality of LEDs are provided within a first region of the display device corresponding to a location of a first object in the video, and

the first LEDs transmitting a first data packet of the VLC protocol, the first data packet representing the extracted additional information associated with the first object.

2. The method of claim 1, wherein the additional information comprises an identifier indicating a video frame where an object is included, information on a location where the object is provided within the video frame, and an identifier of the object, a name of the object, and detailed information of the object.

3. The method of claim 1, wherein the additional information is decoded and transmitted in response to receiving an input request via an input device.

4. The method of claim 1, further comprising:

extracting audio data for the data packet and decoding the audio data.

5. The method of claim 1, further comprising:

receiving, by the further device, the first or second data packet; and

extracting, by the further device, the additional information from the first or second data packet, and displaying the extracted additional information on a display of the further device.

6. The method of claim 5, further comprising storing the extracted additional information at the further device in a memory.

7. The method of claim 5, wherein extracting the additional information by the further device comprises:

generating a list of a plurality of the extracted additional information;

displaying the additional information list;

receiving selected additional information included in the additional information list; and

displaying detailed information included in the selected additional information.

8. The method of claim 1, wherein the extracting of the additional information transmitted from the display device further comprises:

requesting and acquiring the additional information selectively.

9. The method of claim 1, wherein the second LEDs of the plurality of LEDs are provided within a second region of the display device corresponding to a location of a second object in the video data,

and wherein the second LEDs transmitting a second data packet of the VLC protocol, the second data packet representing the extracted additional information associated with the second object.

10. The method of claim 9, wherein the additional information of the first and second objects are transmitted via the respective first and second data packets regardless of interaction between the display device and the at least one further device.

11. The method according to claim 9, wherein a visible light communication (VLC) device delivers signals VLC-modulated to the first or second LEDs.

12. A method performed at a mobile terminal, for providing additional information included in a video displayed at another device, the method comprising:

receiving a first data packets of a visible light communication (VLC) protocol transmitted from the another device, the first data packet being transmitted by first light emitting diodes-(LEDs) provided within a first display region of the another device corresponding to a location of a first object in the video, and representing additional information associated with the first object; and

extracting the additional information associated with the first object and represented in the first data packet, and outputting the extracted additional information to a display the mobile terminal.

13. The method of claim 12, further comprising storing the extracted additional information in a memory.

14. The method of claim 13, wherein the extracting of the additional information comprises:

generating a list of a plurality of the extracted additional information;

displaying the additional information list;

receiving selected additional information included in the additional information list; and

displaying detailed information included in the selected additional information.

15. The method of claim 12, further comprising:

receiving a second data packet of the VLC protocol transmitted from the another device; and

extracting the additional information associated with a second object and represented in the second data packet, and outputting the extracted additional information to a display the mobile terminal,

wherein the second data packet being transmitted by second LEDs provided within a second display region of the another device corresponding to a location of the second object in the video, and representing additional information associated with the second object.

16. An apparatus for transmitting additional information included in a video using visible light communication (VLC), the apparatus comprising:

an interface unit which receives a data packet including video data of the video and additional information associated with a particular object; and

a controller which extracts the video data from the data packet and the additional information from the data packet for decoding the video data and the additional information and generates visible light signals from the plurality of light emitting diodes (LEDs) to output the video displaying the video data and the extracted additional information to at least one further device based on the VLC protocol,

wherein first LEDs of the plurality of LEDs are provided within a first region of the display device corresponding to a location of a first object in the video, and wherein the first LEDs transmitting a first data packet of the VLC protocol, the first data packet representing the extracted additional information associated with the first object.

17. The apparatus of claim 16, further comprising:

an audio decoder for restoring an audio signal by decoding audio data; and

a speaker for outputting the restored audio signal.

18. The method of claim 16, wherein second LEDs of the plurality of LEDs are provided within a second region of the display device corresponding to a location of a second object in the video, and wherein the second LEDs transmitting a second data packet of the VLC protocol, the second data packet representing the extracted additional information associated with the second object.

19. A mobile terminal for receiving additional information included in a video from another device that displays the video using a plurality of light emitting devices, mobile terminal comprising:

a transceiver which receives a first data packet a visible light communication (VLC) protocol transmitted from the another device, the first data packet being transmitted by first light emitting diodes (LEDs) provided within a first display region of the another device corresponding to a location of a first object in the video, and representing additional information associated with the first object; and

a controller which extracts the additional information associated with the first object and represented in the first data packet, and outputs the extracted additional information to a display of the mobile terminal.

20. The mobile terminal of claim 19, further comprising:

a memory for storing the extracted additional information.

21. The mobile terminal of claim 19, wherein the additional information manager generates a list of a plurality of the extracted additional information, and displays the generated additional information list.

22. The mobile terminal of claim 19, comprising:

an external input interface for receiving selected additional information from the plurality of the extracted additional information included in the additional information list.

23. The method of claim 19, wherein the transceiver which receives a second data packet of the VLC protocol transmitted from the another device,

wherein the controller which extracts the additional information associated with a second object and represented in the second data packet, and outputs the extracted additional information to a display of the mobile terminal, and wherein the second data packet being transmitted by second LEDs provided within a second display region of the another device corresponding to a location of the second object in the video, and representing additional information associated with the second object.