Method and apparatus for inputting musical data without requiring selection of a displayed icon

• US 5,665,927 A
• Filed: 06/24/1994
• Issued: 09/09/1997
• Est. Priority Date: 06/30/1993
• Status: Expired due to Term

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Taki, Masahide, Manabe, Hajime
• Primary Examiner(s): Shoop, Jr., William M.
• Assistant Examiner(s): Fletcher, Marlon T.
• Application Number:
  US08/265,731
• Time in Patent Office: 1,173 Days
• Field of Search: 84/462, 84/471 R, 84/477 R, 84/483.1, 84/483.2, 84/609, 84/478
• US Class Current: 84/609
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/32 Constructional details
• CPC Class Codes: G10H 2210/105 Composing aid, e.g. for supporting creation, edition or modification of a piece of music
• CPC Class Codes: G10H 2220/121 for graphical editing of a musical score, staff or tablature
• CPC Class Codes: G10H 2220/241 on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes

Abstract

A musical data inputting apparatus comprising a touch panel for receiving a hand-writing operation thereon detects a figure and/or a symbol drawn on the touch panel by the hand-writing operation, and further recognizes intensity of depression or the number of depressions applied on the touch panel by the hand-writing operation. The apparatus recognizes musical data such as pitches and lengths of notes, a tonality and/or a time of music based on the detected figure and symbol and the recognized intensity and number of depressions of the hand writing operation. Musical data can be input without precisely writing the whole of the musical data themselves on the touch panel.

Claims

1. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving a hand-writing operation on said surface, said hand-writing operation being performed without requiring selection of an icon from a list of visible icons;

horizontal line means for providing said two-dimensional surface of said operation-receiving means with a plurality of horizontal lines vertically spaced from one another;

position detecting means for detecting a vertical position of said hand-writing operation on said two-dimensional surface of said operation-receiving means relative to said horizontal lines to obtain pitch data representative of a pitch of a musical note based on said detected vertical position;

operation recognizing means for recognizing said hand-writing operation performed on said two-dimensional surface of said operation-receiving means to obtain time data representative of a length of said musical note based on said recognized hand-writing operation; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data obtained by said position detecting means and the time data obtained by said operation recognizing means.

2. Musical data inputting apparatus according to claim 1, wherein said operation recognizing means includes means for detecting the number of presses applied onto said two-dimensional surface of said operation receiving means during the hand-writing operation to obtain time data representative of a length of a musical note based on said detected number of presses.

3. Musical data inputting apparatus according to claim 1, wherein said operation recognizing means includes means for measuring a time duration of said hand-writing operation during which said operation receiving means is pressed to obtain time data representative of a length of a musical note based on said measured time duration.

4. Musical data inputting apparatus according to claim 1, wherein said operation recognizing means includes means for detecting intensity of pressure applied by said hand-writing operation onto said two-dimensional surface of said operation receiving means to obtain time data representative of a length of a musical note based on the detected intensity of pressure.

5. Musical data inputting apparatus according to claim 1, further comprising:

clef recognizing means for detecting a figure drawn on said two-dimensional surface of said operation receiving means by the hand-writing operation to recognize a clef based on the detected figure;

and wherein musical-sound recognizing means recognizes musical-sound data based on the pitch data obtained by said position detecting means, the time data obtained by said operation recognizing means and the clef recognized by said clef recognizing means.

6. Musical data inputting apparatus according to claim 1, further comprising:

tonality recognizing means for detecting a numeral drawn on said two-dimensional surface of said operation receiving means by the hand-writing operation to recognize a tonality based on the detected numeral;

and wherein musical-sound recognizing means recognizes musical-sound data based on the pitch data obtained by said position detecting means, the time data obtained by said operation recognizing means and the tonality recognized by said tonality recognizing means.

7. Musical data inputting apparatus according to claim 1, further comprising:

display means for displaying a musical note corresponding to the musical-sound data recognized by said musical-sound recognizing means.

8. Musical data inputting apparatus according to claim 7, wherein said operation receiving means comprises a transparent member, and said operation receiving means is stacked on said display, whereby the musical-sound data displayed on said display can be seen through said operation receiving means.

9. Musical data inputting apparatus according to claim 8, further comprising:

position judging means for judging whether a new hand-writing operation is performed at a position on said two-dimension surface of said operation receiving means, said position corresponding to a blank position on said display means, next to a first musical note displayed thereon;

next means responsive to an affirmative judging result from said position judging means for activating said position detecting means, said operation recognizing means and said musical-sound recognizing means to thereby obtain data representative of a second musical note with respect to said new hand-writing operation; and

display control means responsive to said next means for controlling said display means to display said second musical note at a position next to said first musical note.

10. Musical data inputting apparatus according to claim 8, further comprising:

position judging means for judging whether a new hand-writing operation is performed on said surface at a position corresponding to or near a musical note displayed on said display means;

note updating means responsive to an affirmative judging result from said position judging means for activating said position detecting means, said operation recognizing means and said musical-sound recognizing means to thereby obtain data representative of an updated musical note with respect to said new hand-writing operation; and

display control means responsive to said note updating means for controlling said display means to display said updated musical note in place of said musical note previously displayed.

11. Musical data inputting apparatus according to claim 10, further comprising:

note-length comparing means for judging whether a time length of a measure in which a musical note included therein is replaced with a new musical note is equivalent to a predetermined time length of a measure, when said display control means controls said display means to display a new musical note corresponding to musical sound data newly recognized by said musical-sound recognizing means in place of the previously displayed musical note to replace the previously displayed musical note with the new musical note, and said display control means controls said display means to display the measure in which the musical note included therein is replaced with the new musical note in a different color from an original color, when said note-length comparing means determines that the time length of the measure in which the musical note included therein is replaced with the new musical note is not equivalent to the predetermined time length of a measure.

12. Musical data inputting apparatus according to claim 8, further comprising:

memory means for storing musical-sound data recognized by said musical-sound recognizing means;

range detecting means responsive to said operation-receiving means when said operation-receiving means receives a hand-writing operation thereon that spans musical notes displayed on said display means to thereby define a range for detecting said range;

figure detecting means responsive to said operation receiving means when said operation receiving means receives a hand-writing operation that draws a predetermined figure thereon for detecting said drawn figure; and

deleting means responsive to said range detecting means and said figure detecting means for deleting from said memory means musical-sound data corresponding to the musical notes falling within said detected range.

13. Musical data inputting apparatus according to claim 8, further comprising:

range detecting means responsive to said operation-receiving means when said operation-receiving means receives a hand-writing operation thereon that spans musical notes displayed on said display means to thereby define a range for detecting said range;

numeral detecting means responsive to said operation-receiving means when said operation-receiving means receives a hand-writing operation that draws a numeral thereon for detecting said drawn numeral; and

changing means responsive to said range detecting means and said numeral detecting means for changing pitches of musical-sound data based on the numeral detected by said numeral detecting means, the musical-sound data corresponding to the musical notes falling within said detected range.

14. Musical data inputting apparatus according to claim 8, further comprising:

symbol detecting means for detecting a symbol drawn on said two-dimensional surface of said operation receiving means by another hand-writing operation; and

display control means for controlling said display means to display musical notes with a space therebetween based on the symbol detected by said symbol detecting means.

15. Musical data inputting apparatus according to claim 1, further comprising:

memory means for storing musical-sound data recognized by said musical-sound recognizing means;

and wherein said musical-sound recognizing means recognizes musical-sound data based on the pitch data obtained by said position detecting means and the time data used for recognizing the musical-sound data last stored in said memory means, when no time data is obtained by said operation recognizing means.

16. Musical data inputting apparatus according to claim 1, further comprising:

character detecting means for detecting characters drawn on said two-dimensional surface of said operation-receiving means by the handwriting operation; and

tempo determining means for determining a tempo of music based on the characters detected by said character detecting means; and

wherein said musical-sound recognizing means recognizes musical-sound data based on the pitch data obtained by said position detecting means, the time data obtained by said operation recognizing means and the tempo of music determined by said tempo determining means.

17. Musical data inputting apparatus according to claim 1, further comprising:

numeral detecting means for detecting a numeral drawn on said two-dimensional surface of said operation-receiving means by the hand-writing operation;

time determining means for determining time of music based on the numeral detected by said numeral detecting means; and

wherein said musical-sound recognizing means recognizes musical-sound data based on the pitch data obtained by said position detecting means, the time data obtained by said operation recognizing means and the time of music determined by said time determining means.

18. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving a handwriting operation on said surface, said hand-writing operation being performed without requiring selection of an icon from a list of visible icons;

horizontal line means for providing said two-dimensional surface of said operation-receiving means with a plurality of horizontal lines vertically spaced from one another;

position detecting means for detecting a vertical position of a first hand-writing operation on said two-dimensional surface of said operation-receiving means relative to said horizontal lines to obtain pitch data representative of a pitch of a musical note based on said detected vertical position;

numeral detecting means for detecting a numeral drawn on said two-dimensional surface of said operation-receiving means by a second handwriting operation, and for obtaining time data representative of a length of a musical note based on the detected numeral; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data obtained by said position detecting means and the time data obtained by said numeral detecting means.

19. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving a handwriting operation on said surface, said hand-writing operation being performed without requiring selection of an icon from a list of visible icons;

horizontal line means for providing said two-dimensional surface of said operation-receiving means with a plurality of horizontal lines vertically spaced from one another;

position detecting means for detecting a vertical position of a first hand-writing operation on said two-dimensional surface of said operation-receiving means relative to said horizontal lines to obtain pitch data representative of a pitch of a musical note based on said detected vertical position;

line detecting means for detecting a length of a line drawn on said two-dimensional surface of said operation-receiving means by a second hand-writing operation, and for obtaining time data representative of a length of a musical note based on the detected length of the line; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data obtained by said position detecting means and the time data obtained by said line detecting means.

20. In a musical data inputting apparatus having operation receiving means of a non-keyboard type having a two-dimensional surface for receiving a hand-writing operation on said surface, said hand-writing operation being performed without requiring selection of an icon from a list of visible icons, a method of inputting musical data comprising the steps of:

providing said two-dimensional surface of said operation receiving means with a plurality of horizontal lines vertically spaced from one another;

receiving a hand-writing operation on said two-dimensional surface of said operation receiving means;

detecting a vertical position of said hand-writing operation on said two-dimensional surface of said operation-receiving means relative to said horizontal lines to obtain pitch data representative of a pitch of a musical note based on said detected vertical position;

recognizing the hand-writing operation performed on said operation receiving means to obtain time data representative of a length of said musical note based on said recognized hand-writing operation; and

recognizing musical-sound data based on the obtained pitch data and the obtained time data.

21. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving a hand-writing operation on said surface, said hand-writing operation being performed at least once by pressing a point on said surface without requiring selection of an icon from a list of visible icons;

position detecting means for detecting said point of said hand-writing operation on said two-dimensional surface of said operation-receiving means to obtain pitch data representative of a pitch of a musical note based on said detected point;

counting means for counting a number of presses of said hand-writing operation at said point on said two-dimensional surface of said operation-receiving means to obtain time data representative of a length of said musical note based on said counted number of presses; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data obtained by said position detecting means and the time data obtained by said counting means.

22. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving a hand-writing operation on said surface, said hand-writing operation being performed by pressing a point on said surface for a time duration without requiring selection of an icon from a list of visible icons;

detecting means for;

detecting the position of said pressed point on said two-dimensional surface of said operation-receiving means to obtain pitch data representative of a pitch of a musical note based on said detected position of said pressed point, and

measuring said time duration for which said point was pressed on said two-dimensional surface of said operation-receiving means to obtain time data representative of a length of said musical note based on said measured time duration; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data and the time data obtained by said detecting means.

23. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving a hand-writing operation on said surface, said hand-writing operation being performed by pressing a point on said surface with a pressure without requiring selection of an icon from a list of visible icons;

detecting means for;

detecting the position of said pressed point on said two-dimensional surface of said operation-receiving means to obtain pitch data representative of a pitch of a musical note based on said detected position of said pressed point, and

detecting the strength of said pressure with which said point was pressed on said two-dimensional surface of said operation-receiving means to obtain time data representative of a length of said musical note based on said detected strength of said pressure; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data and the time data obtained by said detecting means.

24. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving hand-writing operations on said surface one at a time, said hand-writing operations being performed without requiring selection of an icon from a list of visible icons and including a first hand-writing operation which is performed by pressing a point on said two-dimensional surface and a second hand-writing operation which is performed by drawing a numeral with writing means on said two-dimensional surface while pressing the writing means against said two-dimensional surface;

detecting means for;

detecting the position of said pressed point on said two-dimensional surface of said operation-receiving means to obtain pitch data representative of a pitch of a musical note based on said detected position of said pressed point, and

detecting said numeral drawn by said second hand-writing operation on said two-dimensional surface of said operation-receiving means to obtain time data representative of a length of said musical note based on said detected numeral; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data and the time data obtained by said detecting means.

25. Musical data inputting apparatus comprising:

operation-receiving means of a non-keyboard type having a two-dimensional surface for receiving hand-writing operations on said surface one at a time, said hand-writing operations being performed without requiring selection of an icon from a list of visible icons and including a first hand-writing operation which is performed by pressing a point on said two-dimensional surface and a second hand-writing operation which is performed by drawing a line with writing means on said two-dimensional surface while pressing the writing means against said two-dimensional surface;

detecting means for;

detecting the position of said pressed point on said two-dimensional surface of said operation-receiving means to obtain pitch data representative of a pitch of a musical note based on said detected position of said pressed point, and

detecting a length of said line drawn by said second hand-writing operation on said two-dimensional surface of said operation-receiving means to obtain time data representative of a length of said musical note based on said detected length of said line; and

musical-sound recognizing means for recognizing musical-sound data based on the pitch data and the time data obtained by said detecting means.