Determining the characteristic of a played note on a virtual instrument

• US 8,937,237 B2
• Filed: 03/06/2013
• Issued: 01/20/2015
• Est. Priority Date: 03/06/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Little, Alec H., Manjarrez, Eli T.
• Primary Examiner(s): Donels, Jeffrey
• Application Number:
  US13/787,738
• Publication Number:
  US 20140083280A1
• Time in Patent Office: 685 Days
• Field of Search: 846/09
• US Class Current: 84/609
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/0066 using a MIDI interface
• CPC Class Codes: G10H 1/02 Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
• CPC Class Codes: G10H 1/0575 using a data store from which the envelope is synthesized tones synthesized from a data store G10H7/00
• CPC Class Codes: G10H 1/28 to produce arpeggios
• CPC Class Codes: G10H 1/34 Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
• CPC Class Codes: G10H 1/38 Chord
• CPC Class Codes: G10H 1/386 One-finger or one-key chord systems
• CPC Class Codes: G10H 2210/095 Inter-note articulation aspects, e.g. legato or staccato
• CPC Class Codes: G10H 2220/096 using a touch screen
• CPC Class Codes: G10H 2220/106 using icons, e.g. selecting, moving or linking icons, on-screen symbols, screen regions or segments representing musical elements or parameters
• CPC Class Codes: G10H 2220/201 for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
• CPC Class Codes: G10H 2220/241 on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes
• CPC Class Codes: G10H 2230/015 PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used
• CPC Class Codes: G10H 2230/021 Mobile ringtone, i.e. generation, transmission, conversion or downloading of ringing tones or other sounds for mobile telephony; Special musical data formats or protocols therefor
• CPC Class Codes: G10H 7/00 Instruments in which the tones are synthesised from a data store, e.g. computer organs
• CPC Class Codes: G10H 7/008 Means for controlling the transition from one tone waveform to another

Abstract

A user interface implemented on a touch-sensitive display for a virtual musical instrument comprising a plurality of chord touch regions configured in a predetermined sequence, each chord touch region corresponding to a chord in a musical key and being divided into a plurality of separate touch zones, the plurality of chord touch regions defining a predetermined set of chords, where each of the plurality of separate touch zones in each region is associated with one or more preselected MIDI files stored in a computer-readable medium. Each of the plurality of touch zones is configured to detect one or more of a plurality of touch gesture articulations including at least one of a legato articulation, a pizzicato articulation, or a staccato articulation. The one or more of the plurality of touch gesture articulations determines the preselected MIDI file associated with each of the plurality of separate touch zones.

Claims

1. A user interface implemented on a touch-sensitive display for a virtual musical instrument comprising:

a plurality of chord touch regions, each chord touch region corresponding to a chord in a musical key and being divided into a plurality of separate touch zones, the plurality of chord touch regions defining a predetermined set of chords,

wherein each of the plurality of separate touch zones in each region is associated with one or more preselected audio signals stored in a computer-readable medium, and

wherein each of the plurality of touch zones is configured to detect and distinguish between a plurality of touch gesture articulations, wherein a detected touch gesture articulation determines the preselected audio signals associated with each of the plurality of separate touch zones.

2. The user interface of claim 1 wherein the one or more of the plurality of touch gesture articulations includes at least one of a legato gesture articulation, a pizzicato gesture articulation, or a staccato gesture articulation.

3. The user interface of claim 2 wherein the legato articulation includes a tap to swipe gesture, wherein the legato articulation triggers playback of a first corresponding audio signal that simulates the sound of a bowing action on a stringed instrument.

4. The user interface of claim 3 wherein a velocity of the legato articulation controls an expression value of the first corresponding audio signal.

5. The user interface of claim 4 wherein the expression value of the first corresponding audio signal is an amplitude.

6. The user interface of claim 3 wherein playback of the first corresponding audio signal stops when the legato articulation is no longer detected or a second touch gesture articulation is simultaneously detected on the user interface.

7. The user interface of claim 3 wherein a sustained legato articulation includes a tap to continuous up-and-down swipe gesture on the user interface.

8. The user interface of claim 2 wherein the pizzicato articulation includes a quick tap gesture comprising an initial tap in one of the plurality of separate touch zones and a release prior to a predetermined period, wherein the pizzicato articulation triggers playback of a second corresponding audio signal that simulates the sound of a plucking action on a stringed instrument.

9. The user interface of claim 8 wherein a velocity of the pizzicato articulation controls an expression value of the second corresponding audio signal.

10. The user interface of claim 9 wherein the expression value of the second corresponding audio signal is an amplitude.

11. The user interface of claim 2 wherein the staccato articulation includes an in-motion swipe gesture upon contact with the touch zone, wherein the staccato articulation triggers playback of a third corresponding audio signal that simulates the sound of a short burst of a bowing action on a stringed instrument.

12. The user interface of claim 11 wherein a velocity of the staccato articulation controls an expression value of the third corresponding audio signal.

13. The user interface of claim 12 wherein the expression value of the third corresponding audio signal is an amplitude.

14. A computer program product stored on a non-transitory computer-readable storage medium comprising computer-executable instructions causing a processor to:

in response to input from a user interface implemented on a touch-sensitive display for a virtual musical instrument, comprising a plurality of chord touch regions configured in a predetermined sequence, each chord touch region corresponding to a chord in a musical key and being divided into a number of separate touch zones, the plurality of chord regions defining a predetermined set of chords, cause a preselected audio signal to be played on an output device, wherein said input from a user comprises one of a plurality of touch gesture articulations on a touch zone associated with said preselected audio signal stored in a computer-readable medium.

15. The computer program product of claim 14 wherein the one of a plurality of touch gesture articulations includes at least one of a legato articulation, a pizzicato articulation, or a staccato articulation.

16. The computer program product of claim 15 wherein the legato articulation includes a tap to swipe gesture, wherein the legato articulation triggers playback of a first preselected audio signal that simulates the sound of a bowing action on a stringed instrument,

wherein the pizzicato articulation includes a quick tap gesture comprising an initial tap in one of the plurality of separate touch zones and a release prior to a predetermined period, wherein the pizzicato articulation triggers playback of a second preselected audio signal that simulates the sound of a plucking action on the stringed instrument, and

wherein the staccato articulation includes an in-motion swipe gesture upon contact with the touch zone, wherein the staccato articulation triggers playback of a third preselected audio signal that simulates the sound of a short burst of a bowing action on the stringed instrument.

17. The computer program product of claim 16 wherein a velocity of the legato articulation controls an expression value of the first preselected audio signal, a velocity of a pizzicato articulation controls an expression value of the second preselected audio signal, and a velocity of the staccato articulation controls an expression value of the third preselected audio signal.

18. A method of determining a characteristic of a note played on a virtual stringed instrument, the method comprising:

receiving, from a user interface on a touch sensitive display for the virtual instrument, a user input comprising one of a plurality of touch gesture articulations performed on a touch zone of the user interface;

determining if the one of a plurality of touch gesture articulations includes one of a legato articulation, and a staccato articulation; and

playing one of a plurality of preselected audio signals on an output device corresponding to both the touch region and the one of a plurality of gesture articulations.

19. The method of claim 18 further comprising determining if the one or a plurality of touch gesture articulations includes a pizzicato articulation,

wherein the legato articulation includes a tap to swipe gesture on the touch zone, wherein the legato articulation triggers playback of a first audio signal of the plurality of preselected audio signals that simulates the sound of a bowing action on a stringed instrument,

wherein the pizzicato articulation includes a quick tap gesture comprising an initial tap in the touch zone and a release prior to a predetermined period, wherein the pizzicato articulation triggers playback of a second audio signal of the plurality of preselected audio signals that simulates the sound of a plucking action on the stringed instrument, and

wherein the staccato articulation includes an in-motion swipe gesture upon contact with the touch zone, wherein the staccato articulation triggers playback of a third audio signal of the plurality of preselected audio signals that simulates the sound of a short burst of a bowing action on the stringed instrument.

20. The method of claim 19 wherein a velocity of the legato articulation controls an expression value of the first audio signal, wherein a velocity of the pizzicato articulation controls an expression value of the second audio signal, and wherein a velocity of the staccato articulation controls an expression value of the third audio signal.