Method, apparatus, and medium controlling and playing sound effect by motion detection

• US 20070013539A1
• Filed: 06/09/2006
• Published: 01/18/2007
• Est. Priority Date: 07/15/2005
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Cho, Joon-kee, Bang, Won-chul, Cho, Sung-jung, Choi, Eun-seok, Kim, Dong-yoon, Hwang, Kwang-il
• Application Number:
  US11/449,611
• Publication Number:
  US 20070013539A1
• Time in Patent Office: Days
• US Class Current: 340/671
• CPC Class Codes: G10H 1/0091 Means for obtaining special acoustic effects combined with modulation G10H1/043
• CPC Class Codes: G10H 1/366 with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice
• CPC Class Codes: G10H 2210/155 Musical effects
• CPC Class Codes: G10H 2210/241 Scratch effects, i.e. emulating playback velocity or pitch manipulation effects normally obtained by a disc-jockey manually rotating a LP record forward and backward
• CPC Class Codes: G10H 2220/206 Conductor baton movement detection used to adjust rhythm, tempo or expressivity of, e.g. the playback of musical pieces
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing. conductor baton movement sensing G10H2220/206, angle sensing without reference to gravity G10H2220/391; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2220/401 3D sensing, i.e. three-dimensional (x, y, z) position or movement sensing. movement pattern or gesture sensing G10H2220/201; geolocation sensing G10H2220/355, 3D sensing with accelerometer G10H2220/395

Abstract

A method, apparatus, and medium for outputting multimedia data such as music is disclosed, which can recognize motion of a specified device using an inertial sensor, and mix sound that corresponds to the recognized motion with multimedia data in order to output the multimedia data mixed with the sound. The apparatus for controlling and playing a sound effect by motion detection includes a media playback unit for reading multimedia data and playing a sound signal; a motion sensor for detecting motion of the apparatus and generating a sensor signal that corresponds to the detected motion; a pattern recognition unit for receiving the generated sensor signal and recognizing motion of the apparatus based using a specified standard of judgment; a sound-effect-playback unit for playing the sound effect based on the result of recognition; and an output unit for outputting the played sound signal and the sound effect.

Claims

1. An apparatus for controlling and playing a sound effect by motion detection, the apparatus comprising:

a media playback unit reading multimedia data and playing a sound signal;

a motion sensor for detecting motion of the apparatus and generating a sensor signal that corresponds to the detected motion;

a pattern recognition unit receiving the generated sensor signal and recognizing motion of the apparatus;

a sound-effect-playback unit playing the sound effect based on the recognized motion; and

an output unit outputting the sound signal and the sound effect.

2. The apparatus as claimed in claim 1, further comprising a mixer for mixing the sound effect with the sound signal, and providing the mixed sound signal to the output unit.

3. The apparatus as claimed in claim 2, wherein the output unit comprises:

an amplifier controlling a gain of the mixed sound signal according to a main gain-control signal; and

a speaker converting the gain-controlled mixed sound signal into actual sound.

4. The apparatus as claimed in claim 1 further comprising:

a microphone converting an input voice into an analog sound signal; and

a mixer for mixing the sound signal, the sound effect, and the converted sound signal and providing the mixed sound to the output unit.

5. The apparatus as claimed in claim 1, wherein the media playback unit comprises:

a first-in first-out (FIFO) type buffer receiving and temporarily storing multimedia data stored in a memory; and

a decoder decompressing the multimedia data temporarily stored in the buffer in order to restore to the original sound signal.

6. The apparatus as claimed in claim 5, wherein the multimedia data is in the MPEG Layer-3 (MP3) format.

7. The apparatus as claimed in claim 1, wherein the sound-effect-playback unit comprises:

a first-in first-out (FIFO) type buffer receiving and temporarily storing sound-effect data stored in a memory; and

a decoder decompressing the sound effect data temporarily stored in the buffer to restore to the original sound effect.

8. The apparatus as claimed in claim 7, wherein the sound-effect data is in the MPEG Layer-3 (MP3) format.

9. The apparatus as claimed in claim 1, wherein the motion sensor is an acceleration sensor, an angular velocity sensor, or a combination thereof.

10. The apparatus as claimed in claim 9, wherein the pattern-recognition unit recognizes the occurrence of motion at a point when the sensor signal exceeds a specified critical value.

11. The apparatus as claimed in claim 10, wherein if plural points recognized as points where separate motion has occurred are within a specified time period, the pattern-recognition unit considers them as a single motion.

12. The apparatus as claimed in claim 9, further comprising a playback controller controlling the playback of the sound effect according to a specified sound-effect-playback setup if the motion occurrence is recognized.

13. The apparatus as claimed in claim 12, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, the sound effect of sound data is played, and if motion is recognized during the playback of the sound effect, the sound effect is played again starting from its initial point.

14. The apparatus as claimed in claim 12, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, a sound signal different from the played sound signal is played.

15. The apparatus as claimed in claim 12, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, a corresponding sound signal according to an axes indicated by the motion is played.

16. The apparatus as claimed in claim 12, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, the magnitude of the sound signal increases according to the size of the motion.

17. A method for controlling and playing a sound effect by motion detection, comprising:

(a) reading multimedia data and playing a sound signal;

(b) detecting motion of a device that controls and plays sound effects, and generates a sensor signal that corresponds to the detected motion;

(c) receiving the generated sensor signal and recognizing motion of the device;

(d) playing the sound effect based on the recognized motion; and

(e) outputting the played sound signal and the sound effect.

18. The method as claimed in claim 17, further comprising the step of mixing the sound effect with the played sound signal, and providing the mixed sound signal to an output unit.

19. The method as claimed in claim 18, wherein the step (e) comprises:

controlling a gain of the mixed sound signal according to a main gain-control signal; and

converting the gain-controlled, mixed sound signal into actual sound.

20. The method as claimed in claim 17, further comprising:

converting an input voice into an analog sound signal; and

mixing the played sound signal, the sound effect, and the converted sound signal, and providing the mixed sound to an output unit.

21. The method as claimed in claim 20, wherein the step (a) comprises:

receiving and temporarily storing multimedia data stored in a memory; and

decompressing the multimedia data temporarily stored in a buffer in order to restore to the original sound signal.

22. The method as claimed in claim 21, wherein the multimedia data is in MPEG Layer-3 (MP3) format.

23. The method as claimed in claim 17, wherein the step (d) comprises:

receiving and temporarily storing sound-effect data stored in a memory; and

decompressing the sound-effect data temporarily stored in a buffer in order to restore to the original sound effect.

24. The method as claimed in claim 23, wherein the sound-effect data is in MPEG Layer-3 (MP3) format.

25. The method as claimed in claim 17, wherein the motion is detected by an acceleration sensor, an angular velocity sensor, or a combination thereof.

26. The method as claimed in claim 25, wherein the step (c) comprises recognizing the occurrence of motion at a point when the sensor signal exceeds a specified critical value.

27. The method as claimed in claim 26, wherein the step (c) further comprises recognizing that only a single motion has occurred if plural points recognized as points of motion are within a specified time period.

28. The method as claimed in claim 25, further comprising controlling the playback of the sound effect according to a specified sound-effect-playback setup if motion is recognized.

29. The method as claimed in claim 28, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, the sound effect is played, and if motion is recognized during the playback of the sound effect, the sound effect is played again starting from its initial point.

30. The method as claimed in claim 28, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, a sound signal different from the played sound signal is played.

31. The method as claimed in claim 28, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, a corresponding sound signal according to an axes indicated by the motion is played.

32. The method as claimed in claim 28, wherein the sound-effect-playback setup is conducted such that if motion is recognized during the playback of the sound signal, the magnitude of the sound signal increases according to the size of the motion.

33. At least one computer readable medium storing instructions that control at least one processor to perform a method for controlling and playing a sound effect by motion detection, the method comprising:

(a) reading multimedia data and playing a sound signal;

(b) detecting motion of an apparatus that controls and plays sound effects, and generates a sensor signal that corresponds to the detected motion;

(c) receiving the generated sensor signal and recognizing motion of the apparatus;

(d) playing the sound effect based on the recognized motion; and

(e) outputting the played sound signal and the sound effect.