COMMUNICATING DATA WITH AUDIBLE HARMONIES

• US 20160379672A1
• Filed: 06/24/2015
• Published: 12/29/2016
• Est. Priority Date: 06/24/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Smus, Boris, Getreuer, Pascal Tom
• Granted Patent: US 9,755,764 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 1/26 for automatically producing a series of tones
• CPC Class Codes: G10H 1/38 Chord
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/086 for transcription of raw audio or music data to a displayed or printed staff representation or to displayable MIDI-like note-oriented data, e.g. in pianoroll format
• CPC Class Codes: G10H 2240/251 Mobile telephone transmission, i.e. transmitting, accessing or controlling music data wirelessly via a wireless or mobile telephone receiver, analog or digital, e.g. DECT GSM, UMTS smartphone, PDA or palmtop used for musical purposes G10H2230/015; mobile ringtone G10H2230/021
• CPC Class Codes: H04B 11/00 Transmission systems employing sonic, ultrasonic or infrasonic waves

Abstract

In some implementations, a process for communicating data over audio is performed. In one aspect, one or more ordered sequences of audio attribute values that are selected based on a musical relationship between the audio attribute values and associated with data values may be played by a first device and received by a second device. This technique may allow for sound-based communications to take place between devices that listeners may find pleasant.

Claims

1. A computer-implemented method executed by one or more processors, the method comprising:

determining a set of audio attribute values to be modulated to transfer a data set between devices, wherein the set of audio attributes values are selected based on a musical relationship between the audio attribute values;

determining a symbol map associating each possible data value for the data set with an ordered sequence of audio attribute values from the set of audio attribute values; and

sending the data set to one or more receiving devices, including for each data value in the data set;

determining the ordered sequence of audio attribute values associated with the data value from the symbol map; and

playing an ordered sequence of one or more sounds representing the data value, each sound having an audio attribute value in the determined ordered sequence of audio attribute values.

2. The method of claim 1, wherein each of the one or more sounds in the ordered sequence includes a plurality pitches played substantially simultaneously.

3. The method of claim 1, wherein the set of audio attributes values are pitch values and the musical relationship is a chordal relationship between the pitches.

4. The method of claim 3, wherein the chordal relationship is a major chord relationship, a minor chord relationship, a major seventh chord relationship, or a minor seventh chord relationship.

5. The method of claim 1, wherein the symbol map includes a chord progression including a plurality of sets of pitch values, and timing information indicating when each set of pitch values will be used to send associated data values, wherein each set of pitch values are selected based on a chord relationship between the pitch values in the set.

6. The method of claim 1, wherein the set of audio attributes are duration values and the musical relationship is a rhythmic relationship between the durations.

7. The method of claim 1, wherein the set of audio attributes values are envelope shape parameter values.

8. The method of claim 1, wherein the symbol map is stored by the one or more receiving devices before the data set is sent.

9. The method of claim 8, wherein the one or more receiving device store a plurality of different symbol maps, and sending the data set includes sending a header including an identifier of a particular symbol map to be used when transferring the data set.

10. The method of claim 1, wherein sending the data set includes sending a header between the sending device and the receiving devices including the symbol map.

11. The method of claim 10, wherein sending the header including the symbol map includes playing an ordered sequence of sounds representing each data value in the symbol map based on a default symbol map.

12. A computer-implemented method executed by one or more processors, the method comprising:

identifying a symbol map associating each possible data value for the data set with an ordered sequence of audio attribute values from a set of audio attribute values selected based on a musical relationship between the audio attribute values;

receiving a plurality of sounds from a sending device;

identifying ordered sequences of the received sounds having audio attribute values associated with data values in the symbol map; and

assembling the data values according to an order in which the identified sequences were received to form the data set.

13. The method of claim 12, wherein the set of audio attributes values are pitch values and the musical relationship is a chordal relationship between the pitches.

14. The method of claim 13, wherein the chordal relationship is a major chord relationship, a minor chord relationship, a major seventh chord relationship, or a minor seventh chord relationship.

15. The method of claim 12, wherein the symbol map includes a chord progression including a plurality of sets of pitch values, and timing information indicating when each set of pitch values will be used to send associated data values, wherein each set of pitch values are selected based on a chord relationship between the pitch values in the set.

16. The method of claim 12, wherein the set of audio attributes are duration values and the musical relationship is a rhythmic relationship between the durations.

17. The method of claim 12, wherein the set of audio attributes values are envelope shape parameter values.

18. The method of claim 12, wherein identifying the symbol map includes receiving a header from the sending device including an identifier of a particular symbol map to be used when transferring the data set.

19. The method of claim 12, wherein identifying the symbol map includes receiving a header from the sending device including the symbol map.

20. A system comprising:

memory for storing data; and

one or more processors operable to perform operations comprising;

determining a set of audio attribute values to be modulated to transfer a data set between devices, wherein the set of audio attributes values are selected based on a musical relationship between the audio attribute values;

determining a symbol map associating each possible data value for the data set with an ordered sequence of audio attribute values from the set of audio attribute values; and

sending the data set to one or more receiving devices, including for each data value in the data set;

determining the ordered sequence of audio attribute values associated with the data value from the symbol map; and

playing an ordered sequence of sounds representing the data value, each sound having an audio attribute value in the determined ordered sequence of audio attribute values.