Tangible multimedia content playback method and apparatus

• US 9,865,273 B2
• Filed: 01/13/2015
• Issued: 01/09/2018
• Est. Priority Date: 01/13/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Won, Sungjoon, Han, Sehee
• Primary Examiner(s): Pullias, Jesse
• Application Number:
  US14/595,705
• Publication Number:
  US 20150199975A1
• Time in Patent Office: 1,092 Days
• Field of Search: 704275
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A tangible multimedia content playback method and apparatus is provided. The tangible multimedia content playback method includes extracting effect data from multimedia content, mapping the extracted effect data to a timeline of the multimedia content, establishing, when the multimedia content is played, a connection to at least one peripheral device pertaining to the effect data, and controlling the at least one peripheral device pertaining to the effect data to match with the timeline.

Claims

1. A tangible multimedia content playback method comprising:

extracting real environmental effect data from multimedia content;

mapping the extracted real environmental effect data to a timeline of the multimedia content;

establishing, when the multimedia content is played, a connection to at least one peripheral device pertaining to the real environmental effect data; and

controlling the at least one peripheral device pertaining to the real environmental effect data to match with the timeline,

wherein controlling the at least one peripheral device comprises;

configuring control priorities of the at least one peripheral device based on at least one of a characteristic of the real environmental effect data and a location of the at least one peripheral device; and

transmitting control commands corresponding to the real environmental effect data to the at least one peripheral device in order of the control priorities.

2. The tangible multimedia content playback method of claim 1, wherein extracting the real environmental effect data comprises extracting the real environmental effect data from at least one of an image, a sound, a sound effect, a subtitle, a speech, and metadata.

3. The tangible multimedia content playback method of claim 1, wherein extracting the real environmental effect data comprises generating the real environmental effect data using at least one of an image, a sound, a sound effect, a subtitle, a speech, and metadata included in the multimedia content.

4. The tangible multimedia content playback method of claim 1, wherein extracting the real environmental effect data comprises:

recommending an effect scene, which is selected from the multimedia content; and

receiving an input of the real environmental effect data related to the recommended effect scene.

5. The tangible multimedia content playback method of claim 1, wherein establishing the connection comprises:

receiving device information from the at least one peripheral device; and

configuring a communication scheme with the at least one peripheral device based on the device information.

6. The tangible multimedia content playback method of claim 5, wherein establishing the connection further comprises:

controlling peripheral devices to exchange the device information; and

establishing connections among the peripheral devices.

7. The tangible multimedia content playback method of claim 1, wherein controlling the at least one peripheral device comprises:

creating an environment corresponding to the real environmental effect data in cooperation with the at least one peripheral device.

8. The tangible multimedia content playback method of claim 1, wherein controlling the at least one peripheral device comprises playing the multimedia content based on at least one of a predetermined event, a user'"'"'s line of sight, device information of the at least one peripheral device, and a characteristic of a display unit.

9. The tangible multimedia content playback method of claim 1, wherein controlling the at least one peripheral device comprises:

transmitting a message to the at least one peripheral device preconfigured based on at least one of characters, scenes, and events included in the multimedia content; and

controlling playback of the multimedia content depending on whether the message is acknowledged.

10. A tangible multimedia content playback apparatus comprising:

an input unit configured to receive an input of multimedia content;

a communication unit configured to establish a connection with peripheral devices providing effects corresponding to the real environmental effect data mapped to a selected multimedia content; and

a control unit configured to establish connections among the peripheral devices and control the peripheral devices corresponding to the real environmental effect data to match with a timeline of the multimedia content,

wherein the control unit is further configured to configure control priorities of the peripheral devices based on at least one of characteristics of the real environmental effect data and locations of the peripheral devices, and to control the communication unit to transmit control commands corresponding to the real environmental effect data to the peripheral devices in order of the control priorities.

11. The apparatus of claim 10, wherein the input unit is further configured to receive an input of the real environmental effect data pertaining to an effect scene, which is selected from the multimedia content.

12. The apparatus of claim 10, wherein the control unit is further configured to extract the real environmental effect data from at least one of an image, a sound, a sound effect, a subtitle, a speech, and metadata included in the multimedia content.

13. The apparatus of claim 10, wherein the communication unit is further configured to receive device information from the peripheral devices and configure communication schemes with the peripheral devices based on the received device information.

14. The apparatus of claim 13, wherein the control unit is further configured to control a display unit to display the device information, and to control the communication unit to establish connections with the peripheral devices through the communication schemes according to a user'"'"'s selection through the input unit.

15. The apparatus of claim 10, wherein the control unit is further configured to create an environment corresponding to the real environmental effect data in cooperation with the peripheral devices.

16. The apparatus of claim 10, wherein the control unit is further configured to play the multimedia content based on at least one of a predetermined event, a user'"'"'s line of sight, device information of the peripheral devices, and a characteristic of a display unit.

17. The apparatus of claim 10, wherein the control unit is further configured to control the communication unit to transmit a message to the peripheral devices preconfigured based on at least one of characters, scenes, and events, included in the multimedia content, and to control playback of the multimedia content depending on whether the message is acknowledged.