METHOD AND APPARATUS FOR PROVIDING ADDITIONAL INFORMATION OF VIDEO USING VISIBLE LIGHT COMMUNICATION

• US 20150124173A1
• Filed: 01/16/2015
• Published: 05/07/2015
• Est. Priority Date: 01/07/2008
• Status: Active Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: WON, Eun-Tae, SON, Jae-Seung, ANN, Jong-Hoon
• Granted Patent: US 10,271,009 B2
• Time in Patent Office: Days
• US Class Current: 348/726
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/8583 by creating hot-spots
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/025 Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame transmission of digital non-picture data during the vertical blanking interval only H04N7/088
• CPC Class Codes: H04N 7/08 Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band , e.g. by time division H04N7/007 takes precedence

Abstract

A method and apparatus for providing additional information included in a video displayed on a display device using visible light communication (VLC). A data packet including video data and additional information for an object included in the video data is received. The video data is extracted from the data packet, and the video data is decoded. The additional information from the data packet is extracted, and the additional information decoded. The decoded video data is output through the display device, and at the same time, the additional information is transmitted for a particular object included in a video based on a VLC protocol using a light emitting device prepared in the display device. The additional information providing apparatus includes an image sensor module, a display module, a visible light receiving module, an additional information manager and a controller.

Claims

1. A method for providing additional information included in a video displayed on a display device, the method comprising:

receiving a data packet including video data of the video and additional information associated with a particular object;

extracting the video data from the data packet, and decoding the video data;

extracting the additional information from the data packet, and decoding the additional information;

generating visible light signals to output the video displaying the video data and the extracted additional information to at least one further device, wherein the extracted additional information is provided within a first region of the display device corresponding to a location of a first object in the video; and

transmitting a first data packet on the first region, the first data packet representing the extracted additional information associated with the first object.

2. The method of claim 1, wherein the additional information comprises an identifier indicating a video frame where an object is included, information on a location where the object is provided within the video frame, and an identifier of the object, a name of the object, and detailed information of the object.

3. The method of claim 1, wherein the additional information is decoded and transmitted in response to receiving an input request via an input device.

4. The method of claim 1, wherein the extracted additional information is provided within a second region of the display device corresponding to a location of a second object in the video data.

5. The method of claim 4, further comprising transmitting a second data packed on the second region, the second data packet representing the extracted additional information associated with the second object.

6. The method of claim 5, wherein the additional information of the first and second objects are transmitted via the respective first and second data packets regardless of interaction between the display device and the at least one further device.

7. The method according to claim 5, wherein the display device delivers signals VLC-modulated to the first region or the second region.

8. The method of claim 1, further comprising:

extracting audio data from the data packet and decoding the audio data.

9. The method of claim 5, further comprising:

receiving, by the further device, the first or second data packet;

extracting, by the further device, the additional information from the first or second data packet; and

displaying, by the further device, the extracted additional information on a display of the further device.

10. The method of claim 9, further comprising:

storing the extracted additional information at the further device in a memory.

11. The method of claim 9, wherein displaying the extracted additional information by the further device comprises:

generating an additional information list of a plurality of the extracted additional information;

displaying the additional information list;

receiving selected additional information included in the additional information list; and

displaying detailed information included in the selected additional information.

12. The method of claim 1, further comprises:

requesting and acquiring the additional information selectively.

13. A method performed at a mobile terminal, for providing additional information included in a video displayed at another device, the method comprising:

receiving a first data packet transmitted from the another device, the first data packet being transmitted on a first display region of the another device corresponding to a location of a first object in the video, and representing additional information associated with the first object; and

extracting the additional information associated with the first object and represented in the first data packet, and outputting the extracted additional information to a display the mobile terminal.

14. The method of claim 13, further comprising:

receiving a second data packet transmitted from the another device, the second data packet being transmitted on a second display region of the another device corresponding to a location of a second object in the video, and representing additional information associated with the second object; and

extracting the additional information associated with the second object and represented in the second data packet, and outputting the extracted additional information associated with the second object to the display the mobile terminal.

15. The method of claim 14, further comprising:

storing the extracted additional information in a memory.

16. The method of claim 15, wherein the extracting of the additional information comprises:

generating a additional information list of a plurality of the extracted additional information;

displaying the additional information list;

receiving selected additional information included in the additional information list; and

displaying detailed information included in the selected additional information.

17. An apparatus for transmitting additional information included in a video, the apparatus comprising:

an interface unit which receives a data packet including video data of the video and additional information associated with a particular object; and

a controller which extracts the video data from the data packet and the additional information from the data packet for decoding the video data and the additional information, generates visible light signals to output the video displaying the video data and the extracted additional information to at least one further device, and performs control for transmitting a first data packet on a first region of the display device,

wherein the extracted additional information is provided within the first region of the display device corresponding to a location of a first object in the video, the first data packet representing the extracted additional information associated with the first object.

18. The apparatus of claim 17, wherein the controller performs control for extracting audio data from the data packet, restoring an audio signal by decoding audio data, and outputting the restored audio signal.

19. The apparatus of claim 17, wherein the controller performs control for transmitting a second data packet on a second region of the display device,

wherein the extracted additional information is provided within the second region of the display device corresponding to a location of a second object in the video, the second data packet representing the extracted additional information associated with the second object.

20. A mobile terminal for receiving additional information included in a video from another device that displays the video, mobile terminal comprising:

a transceiver which receives a first data packet transmitted from the another device, the first data packet being transmitted on a first display region of the another device corresponding to a location of a first object in the video, and representing additional information associated with the first object; and

a controller which extracts the additional information associated with the first object and represented in the first data packet, and outputs the extracted additional information to a display of the mobile terminal.

21. The mobile terminal of claim 20, wherein the transceiver receives a second data packet transmitted from the another device, the second data packet being transmitted on a second display region of the another device corresponding to a location of a second object in the video, and representing additional information associated with the second object.

22. The mobile terminal of claim 21, wherein the controller extracts the additional information associated with the second object and represented in the second data packet, and outputs the extracted additional information associated with the second object to a display of the mobile terminal.

23. The mobile terminal of claim 21, further comprising:

a memory for storing the extracted additional information associated with the first or second object.

24. The mobile terminal of claim 21, wherein the controller generates a additional information list of a plurality of the extracted additional information associated with the first or second object, and displays the generated additional information list.

25. The mobile terminal of claim 24, further comprising:

an external input interface for receiving selected additional information from the plurality of the extracted additional information included in the additional information list.