SIGNAL PROCESSING DEVICE, SIGNAL PROCESSING METHOD, AND COMPUTER PROGRAM

• US 20180357988A1
• Filed: 11/01/2016
• Published: 12/13/2018
• Est. Priority Date: 11/26/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: KIM, HEESOON, INAMI, MASAHIKO, MINAMIZAWA, KOUTA, SUGIURA, YUTA, YAMAMOTO, MIO
• Granted Patent: US 10,607,585 B2
• Time in Patent Office: Days
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/0091 Means for obtaining special acoustic effects combined with modulation G10H1/043
• CPC Class Codes: G10H 1/02 Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
• CPC Class Codes: G10H 1/06 Circuits for establishing the harmonic content of tones , or other arrangements for changing the tone colour
• CPC Class Codes: G10H 2220/201 for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
• CPC Class Codes: G10H 2220/391 Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device angles measured by an accelerometer or gravimeter G10H2220/395; angles calculated from 3D position sensing G10H2220/401; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing. conductor baton movement sensing G10H2220/206, angle sensing without reference to gravity G10H2220/391; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2220/401 3D sensing, i.e. three-dimensional (x, y, z) position or movement sensing. movement pattern or gesture sensing G10H2220/201; geolocation sensing G10H2220/355, 3D sensing with accelerometer G10H2220/395
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
• CPC Class Codes: G10H 3/14 using mechanically actuated vibrators with pick-up means G10H3/24 takes precedence
• CPC Class Codes: G10H 7/008 Means for controlling the transition from one tone waveform to another
• CPC Class Codes: G10K 15/04 Sound-producing devices G10K15/02 takes precedence
• CPC Class Codes: G10L 21/003 Changing voice quality, e.g. pitch or formants

Abstract

[Object] To provide a signal processing device capable of aurally-exaggerating movement of an object itself and providing the aurally-exaggerated movement of the object. [Solution] Provided is a signal processing device including a control unit configured to perform a sound signal process on a waveform of a signal generated on a basis of movement of an object, and cause sound corresponding to a signal generated on a basis of the sound signal process to be output within a predetermined period of time. The signal processing device is capable of aurally-exaggerating movement of an object itself and providing the aurally-exaggerated movement of the object by performing a sound signal process on a waveform of a signal generated on the basis of the movement of the object.

Claims

1. A signal processing device comprising

a control unit configured to perform a sound signal process on a waveform of a signal generated on a basis of movement of an object, and cause sound corresponding to a signal generated on a basis of the sound signal process to be output within a predetermined period of time.

2. The signal processing device according to claim 1,

wherein the control unit changes content of the sound signal process in accordance with a characteristic of the object.

3. The signal processing device according to claim 2,

wherein the control unit estimates the characteristic of the object by using a recognition result of the object.

4. The signal processing device according to claim 3,

wherein the control unit learns the recognition result of the object, and changes the content of the sound signal process in accordance with the learning.

5. The signal processing device according to claim 3,

wherein the control unit estimates the characteristic of the object by using an image recognition result of the object.

6. The signal processing device according to claim 5,

wherein the control unit changes the content of the sound signal process in accordance with mass of the object as the characteristic of the object.

7. The signal processing device according to claim 5,

wherein the control unit changes the content of the sound signal process in accordance with a size of the object as the characteristic of the object.

8. The signal processing device according to claim 5,

wherein the control unit changes the content of the sound signal process in accordance with a frequency characteristic of the signal generated on the basis of the movement of the object as the characteristic of the object.

9. The signal processing device according to claim 5,

wherein the control unit changes the content of the sound signal process in accordance with a color of the object as the characteristic of the object.

10. The signal processing device according to claim 1,

wherein the control unit learns the signal generated on the basis of the movement of the object, and changes content of the sound signal process in accordance with the learning.

11. The signal processing device according to claim 1,

wherein the control unit performs the sound signal process on a waveform of a signal generated from contact of the object with another object.

12. The signal processing device according to claim 1,

wherein the control unit performs the sound signal process on a waveform of a signal generated from transfer of the object on a surface of another object.

13. The signal processing device according to claim 1,

wherein the control unit acquires the signal generated on the basis of the movement of the object as a sound signal collected through a microphone.

14. The signal processing device according to claim 1,

wherein the control unit acquires the signal generated on the basis of the movement of the object as a waveform signal acquired through a sensor.

15. A signal processing method comprising

performing a sound signal process on a waveform of a signal generated on a basis of movement of an object, and causing sound corresponding to a signal generated on a basis of the sound signal process to be output within a predetermined period of time.

16. A computer program causing a computer to

perform a sound signal process on a waveform of a signal generated on a basis of movement of an object, and cause sound corresponding to a signal generated on a basis of the sound signal process to be output within a predetermined period of time.