Systems and methods for automatic calibration of musical devices

• US 10,636,402 B2
• Filed: 08/14/2018
• Issued: 04/28/2020
• Est. Priority Date: 01/15/2016
• Status: Active Grant

• Current Assignee: Sunland Information Technology Co., Ltd.
• Original Assignee: Sunland Information Technology Co., Ltd.
• Inventors: Liu, Xiaolu, Yan, Zhengjun, Yan, Bin, Deng, Zhihong, Yang, Shaolin
• Primary Examiner(s): Donels, Jeffrey
• Application Number:
  US16/102,820
• Publication Number:
  US 20180366093A1
• Time in Patent Office: 623 Days
• Field of Search: 84453, 84745
• CPC Class Codes: G01P 13/00 Indicating or recording presence, absence, or direction, of movement electric switches H01H; counting moving objects G06M7/00
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G10C 1/02 of upright pianos
• CPC Class Codes: G10C 1/04 of grand pianos
• CPC Class Codes: G10C 3/00 Details or accessories
• CPC Class Codes: G10C 3/12 Keyboards; Keys
• CPC Class Codes: G10C 3/26 Pedals or pedal mechanisms G10C3/14 takes precedence; Manually operated sound modification means
• CPC Class Codes: G10F 1/02 Pianofortes with keyboard
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/0016 Means for indicating which keys, frets or strings are to be actuated, e.g. using lights or leds
• CPC Class Codes: G10H 1/344 Structural association with individual keys electrically operated wind-actuated organs G10B3/22
• CPC Class Codes: G10H 1/44 Tuning means
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance. graphical musical score editing G10H2220/121; musical score displays resulting from a transcription G10H2210/086
• CPC Class Codes: G10H 2220/091 Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith GUI in general G06F3/048
• CPC Class Codes: G10H 2220/201 for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
• CPC Class Codes: G10H 2220/221 Keyboards, i.e. configuration of several keys or key-like input devices relative to one another details of individual keys or key-like devices G10H2220/265; continuous keyboards or keyboards implementing specific musical scales, e.g. quartertone G10H2210/395; switch matrix keyboards, e.g. on guitar necks G10H2220/295
• CPC Class Codes: G10H 2220/275 Switching mechanism or sensor details of individual keys, e.g. details of key contacts, hall effect or piezoelectric sensors used for key position or movement sensing purposes; Mounting thereof
• CPC Class Codes: G10H 2220/305 using a light beam to detect key, pedal or note actuation light beams in general G10H2220/411
• CPC Class Codes: G10H 2230/011 Hybrid piano, e.g. combined acoustic and electronic piano with complete hammer mechanism as well as key-action sensors coupled to an electronic sound generator

Abstract

The present disclosure relates to a method and system for calibrating a musical device. In some embodiments, a method for calibrating a musical device includes: determining a first time corresponding to a first instruction that instructs a driving device to actuate a first component of a musical device using a first force; receiving first sensor data relating to motion information of the first component; determining a second time based on the first sensor data; determining, by a hardware processor, a first time deviation based on the first time and the second time; and calibrating the musical device based on the first time deviation.

Claims

1. A method implemented on a digital instrument having at least one processor and at least one computer-readable storage medium, comprising:

determining a first time corresponding to a first instruction that instructs a driving device to actuate a first component of a musical device using a first force;

receiving first sensor data relating to motion information of the first component;

determining a second time based on the first sensor data;

determining, by a hardware processor, a first time deviation based on the first time and the second time;

identifying a second force to be applied to the first component of the musical device;

sending a second instruction to actuate the first component of the musical device using the second force;

determining a second time deviation based on the second instruction; and

calibrating the musical device based on the first time deviation and the second time deviation.

2. The method of claim 1, wherein calibrating the musical device based on the first time deviation comprises associating the first time deviation with the first force and the first component.

3. The method of claim 1, wherein determining the first time deviation based on the first time and the second time comprises determining a difference between the first time and the second time.

4. The method of claim 1, wherein determining the first time deviation based on the first time and the second time further comprises updating mapping information related to a plurality of intensity levels and a plurality of time deviations.

5. The method of claim 1, wherein the second time comprises a time instant corresponding to an operation of the first component of the musical device.

6. The method of claim 2, further comprising:

receiving a performance instruction corresponding to the musical device;

identifying the first component based on the performance instruction;

determining the first force corresponding to the first component based on the performance instruction;

acquiring the first time deviation associated with the first force; and

generating an action instruction to the first component based on the first time deviation.

7. The method of claim 1, further comprising:

identifying a second component of the musical device to be calibrated;

sending a third instruction to actuate the second component of the musical device using the first force;

determining a third time deviation based on the third instruction; and

calibrating the musical device based on the third time deviation.

8. The method of claim 1, wherein the first sensor data is generated by a sensor that is configured to detect motion information related to the first component of the musical device.

9. A system, comprising:

at least one processing device to;

determine a first time corresponding to a first instruction that instructs a driving device to actuate a first component of a musical device using a first force;

receive first sensor data relating to motion information of the first component;

determine a second time based on the first sensor data;

determine a first time deviation based on the first time and the second time;

identify a second force to be applied to the first component of the musical device;

send a second instruction to actuate the first component of the musical device using the second force;

determine a second time deviation based on the second instruction;

and

calibrate the musical device based on the first time deviation and the second time deviation.

10. The system of claim 9, wherein to calibrate the musical device based on the first time deviation, the processing device is further to associate the first time deviation with the first force and the first component.

11. The system of claim 9, wherein to determine the first time deviation based on the first time and the second time, the processing device is further to determine a difference between the first time and the second time.

12. The system of claim 9, wherein to determine the first time deviation based on the first time and the second time, the processing device is further to update mapping information related to a plurality of intensity levels and a plurality of time deviations.

13. The system of claim 9, wherein the second time comprises a time instant corresponding to an operation of the first component of the musical device.

14. The system of claim 10, wherein the processing device is further to:

receive a performance instruction corresponding to the musical device;

identify the first component based on the performance instruction;

determine the first force corresponding to the first component based on the performance instruction;

acquire the first time deviation associated with the first force; and

generate an action instruction to the first component based on the first time deviation.

15. The system of claim 9, wherein the processing device is further to:

identify a second component of the musical device to be calibrated;

send a third instruction to actuate the second component of the musical device using the first force;

determine a third time deviation based on the third instruction; and

calibrate the musical device based on the third time deviation.

16. The system of claim 9, wherein the first sensor data is generated by a sensor that is configured to detect motion information related to the first component of the musical device.

17. The system of claim 16, wherein the sensor comprises at least one of an optoelectronic sensor, a conductive rubber sensor, a conductive silicone rubber sensor, an accelerometer, a magneto-electric sensor, a piezo-electric sensor, or an angle sensor.

18. A non-transitory machine-readable storage medium including instructions that, when accessed by a processing device, cause the processing device to:

determine a first time corresponding to a first instruction that instructs a driving device to actuate a first component of a musical device using a first force;

receive first sensor data relating to motion information of the first component;

determine a second time based on the first sensor data;

determine a first time deviation based on the first time and the second time;

identify a second force to be applied to the first component of the musical device;

send a second instruction to actuate the first component of the musical device using the second force;

determine a second time deviation based on the second instruction;

and

calibrate the musical device based on the first time deviation and the second time deviation.