Storage medium recorded with program for musical performance, apparatus, system and method

• US 8,586,852 B2
• Filed: 08/31/2011
• Issued: 11/19/2013
• Est. Priority Date: 04/22/2011
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Tsuji, Yuki
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US13/222,428
• Publication Number:
  US 20120266739A1
• Time in Patent Office: 811 Days
• Field of Search: None
• US Class Current: 84/741
• CPC Class Codes: G10H 1/14 during execution voice controlled instruments G10H5/005
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2220/201 for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
• CPC Class Codes: G10H 2220/391 Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Abstract

Provided is a program for musical performance which causes a computer of a musical performance apparatus to function as a posture variation acquisition unit 101 for acquiring the posture variation of a controller 5 per frame based on the angular velocity with respect to the posture or movement of the controller 5, a volume parameter setting unit 102 for setting a volume parameter for deciding the volume according to the posture variation, and a sound signal output unit 106 for outputting a sound signal of the volume according to the volume parameter.

Claims

1. A computer-readable non-transitory medium storing program instructions for musical performance that are executable by a computer of a musical performance apparatus which simulates a stringed instrument having a plurality of strings stretched in substantially the same direction and outputs sound based on movement of a predetermined target, the program instructions causing the computer to perform operations comprising:

acquiring posture variation of the predetermined target in a predetermined interval based on measurement information concerning a posture or movement of the predetermined target;

setting a volume parameter for deciding a volume according to an acquired posture variation; and

outputting a sound signal of a volume according to the volume parameter;

retaining string designation information which designates a string that is currently a target to be sounded among the plurality of strings; and

changing a string designation upon a determination, based on the measurement information, that angular acceleration in a circumferential direction centered about a direction in which the plurality of strings are stretched has exceeded a predetermined threshold.

2. The computer-readable non-transitory medium according to claim 1,

wherein the posture variation is acquired as a result of calculating a posture variation of the predetermined target in a predetermined interval relative to a coordinate system defined in a real space based on the measurement information.

3. The computer-readable non-transitory medium according to claim 2,

wherein acquiring posture variation further includes acquiring a plurality of posture variations of the predetermined target relative to axes of the coordinate system defined in the real space, and

the volume parameter is set based on the first two or more but not all of the acquired posture variations in descending order of value among a plurality of acquired posture variations.

4. The computer-readable non-transitory medium according to claim 3,

wherein acquiring posture variation further includes acquiring four posture variations of two axes for defining the posture of the predetermined target relative to two axes in the coordinate system defined in the real space, for each combination of axes, and

wherein the volume parameter is set based on two posture variations in a descending order of value among the four posture variations.

5. The computer-readable non-transitory medium according to claim 1,

wherein acquiring posture variation includes determining, as a posture variation, an average value of posture variations acquired a plurality of times within a predetermined period.

6. The computer-readable non-transitory medium according to claim 1, which causes the computer to perform further operations including:

control of output volume by stopping the output of the sound signal for a predetermined time or lowering the output volume of the sound signal when it is determined, based on the measurement information, that a positive or negative value of angular acceleration in a predetermined direction has inverted.

7. The computer-readable non-transitory medium according to claim 1,

wherein the volume parameter is set based on information prescribing a correspondence of the posture variation and the volume parameter, and

in the information prescribing the correspondence of the posture variation and the volume parameter, tendency of inclination of change of the volume parameter relative to change of the posture variation differs for each range of posture variation.

8. The computer-readable non-transitory medium according to claim 1,

wherein the predetermined target is a controller with a built-in gyro sensor to be operated by a user, and

the measurement information is angular velocity or angular acceleration measured by the gyro sensor.

9. A musical performance apparatus simulates a stringed instrument having a plurality of strings stretched in substantially the same direction for outputting sound based on movement of a predetermined target, comprising:

posture variation acquirer that determines a posture variation of the predetermined target in a predetermined interval based on measurement information concerning the posture or movement of the predetermined target;

sound output volume controller that sets a volume parameter for deciding a volume according to the posture variation;

sound signal output generator that outputs a sound signal having a volume according to the volume parameter;

string designation information retaining unit that retains string designation information which designates a string that is currently a target to be sounded among the plurality of strings; and

string changer that changes the string designation upon a determination, based on the measurement information, that angular acceleration in a circumferential direction centered about a direction in which the plurality of strings are stretched has exceeded a predetermined threshold.

10. A computer-readable non-transitory medium storing program instructions executable by a computer, the program instructions causing the computer to perform operations comprising:

acquiring posture variation of a predetermined target in a predetermined interval based on measurement information concerning a posture or movement of the predetermined target;

setting a parameter according to an acquired posture variation; and

outputting a signal according to the parameter,

wherein the posture variation is acquired as a result of calculating a posture variation of the predetermined target in a predetermined interval relative to a coordinate system defined in a real space based on the measurement information, and

wherein acquiring posture variation further includes acquiring a plurality of posture variations of the predetermined target relative to axes of the coordinate system defined in the real space, and

the parameter is set based on the first two or more but not all of the acquired posture variations in a descending order of value.

11. The computer-readable non-transitory medium according to claim 10,

wherein acquiring posture variation further includes acquiring four posture variations of two axes for defining the posture of the predetermined target relative to two axes in the coordinate system defined in the real space, for each combination of axes, and

wherein the parameter is set based on the first two posture variations in a descending order of value among the four posture variations.

12. The computer-readable non-transitory medium according to claim 10,

wherein acquiring posture variation includes determining, as a posture variation, an average value of posture variations acquired a plurality of times within a predetermined period.

13. The computer-readable non-transitory medium according to claim 10, which causes the computer to perform further operations including:

stopping the output of the signal for a predetermined time or lowering the output of the signal when it is determined, based on the measurement information, that a positive or negative value of angular acceleration in a predetermined direction has inverted.

14. The computer-readable non-transitory medium according to claim 10,

wherein the parameter is set based on information prescribing a correspondence of the posture variation and the parameter, and

in the information prescribing the correspondence of the posture variation and the parameter, tendency of inclination of change of the parameter relative to change of the posture variation differs for each range of posture variation.

15. An apparatus, comprising:

posture variation acquirer that determines a posture variation of a predetermined target in a predetermined interval based on measurement information concerning a posture or movement of the predetermined target;

parameter controller that sets a parameter valve for deciding an output according to the posture variation; and

signal generator that outputs a signal according to the parameter,

wherein the posture variation is acquired as a result of calculating a posture variation of the predetermined target in a predetermined interval relative to a coordinate system defined in a real space based on the measurement information, and

wherein the posture variation acquirer acquires a plurality of posture variations of the predetermined target relative to axes of the coordinate system defined in the real space, and

the parameter is set based on the first two or more but not all of the acquired posture variations in a descending order of value.

16. A computer-readable non-transitory medium storing program instructions executable by a computer, the program instructions causing the computer to perform operations comprising:

acquiring posture variation of a predetermined target in a predetermined interval based on measurement information concerning a posture or movement of the predetermined target;

setting a parameter for deciding an output according to an acquired posture variation;

outputting a signal according to the parameter; and

stopping the output of the signal for a predetermined time or lowering the output of the signal when it is determined, based on the measurement information, that a positive or negative value of angular acceleration in a predetermined direction has inverted.

17. The computer-readable non-transitory medium according to claim 16,

wherein acquiring posture variation further includes acquiring four posture variations of two axes for defining the posture of the predetermined target in a predetermined interval relative to two axes in the coordinate system defined in the real space, for each combination of axes, and

wherein the parameter is set based on the first two posture variations in a descending order of value among the four posture variations.

18. The computer-readable non-transitory medium according to claim 16,

wherein acquiring posture variation includes determining, as a posture variation, an average value of posture variations acquired a plurality of times within a predetermined period.

19. The computer-readable non-transitory medium according to claim 16,

wherein the parameter is set based on information prescribing a correspondence of the posture variation and the acquired parameter, and

in the information prescribing the correspondence of the posture variation and the parameter, tendency of inclination of change of the parameter relative to change of the posture variation differs for each range of posture variation.

20. An apparatus, comprising:

posture variation acquirer that determines a posture variation of a predetermined target in a predetermined interval based on measurement information concerning a posture or movement of the predetermined target;

parameter controller that sets a parameter for deciding an output according to the posture variation;

signal generator that outputs a signal according to the parameter; and

output signal controller that stops the output of the signal by the signal generator for a predetermined time or lowers the output of the signal by the signal generator when it is determined, based on the measurement information, that a positive or negative value of angular acceleration in a predetermined direction has inverted.