Generation and transmission of musical performance data

• US 10,482,858 B2
• Filed: 01/23/2018
• Issued: 11/19/2019
• Est. Priority Date: 01/23/2018
• Status: Active Grant

• Current Assignee: Roland Corporation (Taiyo Pacific Partners LP)
• Original Assignee: Roland VS, LLC
• Inventors: Stroh, Seth M, Yazawa, Ichiro, Soule, Jeremy R, Soule, Julian C.
• Primary Examiner(s): Warren, David S
• Application Number:
  US15/878,251
• Publication Number:
  US 20190228754A1
• Time in Patent Office: 665 Days
• Field of Search: 84609
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/0041 in coded form
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 1/14 during execution voice controlled instruments G10H5/005
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/095 Inter-note articulation aspects, e.g. legato or staccato
• CPC Class Codes: G10H 2220/165 for string input, i.e. special characteristics in string composition or use for sensing purposes, e.g. causing the string to become its own sensor transducers, e.g. piezoelectric or magnetic G10H2220/461; plectrum sensors G10H2220/191; guitar neck sensors or fret switches G10H2220/301
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/325 Synchronizing two or more audio tracks or files according to musical features or musical timings synchronised lyrics, e.g. for karaoke G10H2220/011
• CPC Class Codes: G10H 3/188 for converting the signal to digital format transmission using a MIDI interface G10H1/0066

Abstract

Systems and methods are generally described for generation and transmission of musical performance data. In some examples, the musical input device may generate a first command encoding a first musical event. In various further examples, the musical input device may generate a first message corresponding to the first command, the first message encoding a first acoustic attribute type of the first musical event. In some examples, the musical input device may generate a second message corresponding to the first command, the second message encoding a second acoustic attribute type of the first musical event. In various examples, the musical input device may generate timestamp data denoting a time of an occurrence of the first musical event. In some examples, the musical input device may send the timestamp data, the first command, the first message and the second message to a computing device.

Claims

1. A method of capturing musical performance data, the method comprising:

generating, by a musical input device comprising a processor, a first command encoding a first musical event;

generating, by the musical input device, a first message corresponding to the first command, wherein the first message encodes a first acoustic attribute type of the first musical event and a first acoustic attribute value, wherein the first acoustic attribute value specifies a first value of the first acoustic attribute type;

generating, by the musical input device, a second message corresponding to the first command, wherein the second message encodes a second acoustic attribute type of the first musical event and a second acoustic attribute value, wherein the second acoustic attribute value specifies a second value of the second acoustic attribute type;

generating, by the musical input device, timestamp data denoting a time of an occurrence of the first musical event, the timestamp data corresponding to the first message and the second message; and

sending the timestamp data, the first command, the first message, and the second message to a computing device.

2. The method of claim 1, wherein the first command comprises first chain data comprising an indication of a number of messages corresponding to the first command.

3. The method of claim 1, wherein the first command comprises a “

note on”

command, which when received by an external sound generator, causes the external sound generator to play a musical note.

4. The method of claim 3, wherein the first message comprises articulation instructions encoding an articulation of the musical note.

5. The method of claim 1, wherein the timestamp data comprises a first data word encoding seconds and a second data word encoding fractions of seconds.

6. The method of claim 1, wherein the musical input device comprises a musical instrument.

7. The method of claim 1, wherein the musical input device comprises a stringed instrument, the method further comprising:

generating the first command for a first sub-channel of the musical performance data, wherein the first musical event comprises a first note played on a first string of the stringed instrument; and

generating a second command for a second sub-channel of the musical performance data, the second command encoding a second musical event, wherein the second musical event comprises a second note played on a second string of the stringed instrument.

8. The method of claim 7, wherein:

the musical performance data of the stringed instrument is generated for a first channel;

the first channel comprises the first sub-channel and the second sub-channel; and

the timestamp data associates the second musical event with the time of the occurrence of the first musical event.

9. The method of claim 1, further comprising:

generating, by the musical input device, a second command, the second command encoding a second musical event, wherein the timestamp data associates the second command with the time of the occurrence of the first musical event.

10. The method of claim 9, further comprising:

generating, by the musical input device, a third message corresponding to the second command, wherein the third message encodes a third acoustic attribute type of the second musical event and a third acoustic attribute value, wherein the third acoustic attribute value specifies a third value of the third acoustic attribute type, and wherein the third message uses a first number of bits to encode the third acoustic attribute type and a second number of bits to encode the third acoustic attribute value associated with the third acoustic attribute type.

11. A musical instrument comprising:

at least one processor; and

at least one sensor effective to detect an input representing a musical event;

the at least one processor effective to;

generate a command comprising a digital representation of the musical event based on the input, the digital representation comprising;

a first message encoding a first acoustic attribute type and a first acoustic attribute value, wherein the first acoustic attribute value specifies a first value of the first acoustic attribute type; and

a second message encoding a second acoustic attribute type and a second acoustic attribute value, wherein the second acoustic attribute value specifies a second value of the second acoustic attribute type;

generate timestamp data associated with a timing of the digital representation of the musical event; and

send the digital representation and the timestamp data to a computing device, wherein the computing device is effective to store and edit the digital representation of the musical event.

12. The musical instrument of claim 11, wherein the digital representation comprises a “

note on”

command, which when received by an external sound generator, causes the external sound generator to play a musical note at the timing associated with the timestamp data.

13. The musical instrument of claim 12, wherein the first message corresponds to the “

note on”

command and the second message corresponds to the “

note on”

command.

14. The musical instrument of claim 13, wherein the first message and the second message are associated with the timing of the timestamp data.

15. The musical instrument of claim 11, wherein the timestamp data comprises a first data word encoding seconds and a second data word encoding fractions of seconds.

16. The musical instrument of claim 11, wherein the at least one processor is further effective to synchronize a first clock of the at least one processor with a second clock of the computing device.

17. A computing device comprising:

at least one processor;

a sensor effective to detect a performance action;

a non-transitory computer-readable medium storing instructions that, when executed by the at least one processor are effective to perform a method comprising;

generating a first command, the first command encoding a first musical event associated with the performance action;

generating a first message corresponding to the first command, wherein the first message encodes a first acoustic attribute type of the first musical event;

generating a second message corresponding to the first command, wherein the second message encodes a second acoustic attribute type of the first musical event;

generating timestamp data denoting a time of an occurrence of the first musical event, the timestamp data corresponding to the first message and the second message; and

sending the timestamp data, the first command, the first message, and the second message to a second computing device.

18. The computing device of claim 17, wherein the timestamp data comprises a first data word encoding seconds and a second data word encoding fractions of seconds.

19. The computing device of claim 17, wherein the first command comprises first chain data comprising an indication of a number of messages corresponding to the first command.

20. The computing device of claim 17, wherein:

the first command comprises a “

note on”

command, which when received by an external sound generator, causes the external sound generator to play a musical note; and

the first acoustic attribute type comprises a command specifying an initial pitch of the musical note.