Periodic ambient waveform analysis for dynamic device configuration

• US 10,219,123 B2
• Filed: 02/17/2016
• Issued: 02/26/2019
• Est. Priority Date: 10/19/2011
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Papakipos, Matthew Nicholas, Garcia, David Harry
• Primary Examiner(s): Recek, Jason D
• Assistant Examiner(s): Naoreen, Nazia
• Application Number:
  US15/045,734
• Publication Number:
  US 20160165421A1
• Time in Patent Office: 1,105 Days
• Field of Search: 709221
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04W 4/025 using location based information parameters
• CPC Class Codes: H04W 4/16 Communication-related supplementary services, e.g. call-transfer or call-hold

Abstract

In one embodiment, a method includes generating a waveform fingerprint based on captured ambient audio data; calculating a location of the computing system; sending the generated waveform fingerprint and the location to a server; and receiving instructions from the server to adjust one or more device settings of an output device of the computing system. The instructions being based at least in part on identifying one or more audio fingerprints that match the generated waveform fingerprint and correlating one or more of the identified audio fingerprints to a physical environment of the computing system. The method also includes adjusting one or more of the device settings of the output device of the computing system in accordance with the received instructions.

Claims

1. A method comprising:

by a computing system, generating a waveform fingerprint based on captured ambient audio data;

by the computing system, calculating a location of the computing system;

by the computing system, sending the generated waveform fingerprint and the location to a server;

by the computing system, receiving instructions from the server to adjust one or more device settings of an output device of the computing system, the instructions being based at least in part on identifying one or more audio fingerprints that match the generated waveform fingerprint and correlating one or more of the identified audio fingerprints to a physical environment of the computing system; and

by the computing system, adjusting one or more of the device settings of the output device of the computing system in accordance with the received instructions.

2. The method of claim 1, wherein the identified audio fingerprints are correlated to the physical environment based at least in part on matching information associated with identified audio fingerprints to information associated with the location.

3. The method of claim 1, wherein the received instructions are based at least in part on an updated location determined at least in part on location information of the identified audio fingerprints.

4. The method of claim 1, wherein the received instructions comprise adjusting a volume of a ringer, enabling vibration, adjusting a brightness of a screen, enabling a wireless connection, or locking the computing system.

5. The method of claim 1, wherein the received instructions are based at least in part on a characteristic of the generated waveform fingerprint.

6. The method of claim 1, wherein the location is calculated based at least in part on cell tower triangulation, Wi-Fi positioning, or global positioning system (GPS) positioning.

7. The method of claim 1, wherein the location is calculated based at least in part on information of a user of a social-networking system.

8. The method of claim 7, wherein the information of the user comprise a check-in, tag of the user on a photo, comment, or RSVP associated with the location.

9. The method of claim 1, wherein the location is calculated based at least in part on querying a social graph for location information associated with one or more nodes of the social graph, wherein one or more of the nodes corresponds to one or more users that uploaded one of the identified audio fingerprints.

10. The method of claim 1, wherein the identified audio fingerprints correspond to a song, TV show, soundtrack, movie, or performance.

11. The method of claim 10, wherein one or more of the identified audio fingerprints is correlated to the physical environment based at least in part on identifying a venue associated with the identified audio fingerprints, wherein the identification is based at least in part on information provided by an online database.

12. The method of claim 1, wherein the generated waveform fingerprint is searched against of the audio fingerprints associated with a search space of the calculated location.

13. The method of claim 1, wherein the ambient audio data is captured in response to a sound level of the ambient audio data being higher than a pre-determined level or detecting a change in the calculated location.

14. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

generate a waveform fingerprint based on captured ambient audio data;

calculate a location of a client system;

send the generated waveform fingerprint and the location to a server;

receive instructions from the server to adjust one or more device settings of an output device of the client system, the instructions being based at least in part on identifying one or more audio fingerprints that match the generated waveform fingerprint and correlating one or more of the identified audio fingerprints to a physical environment of the client system; and

adjust one or more of the device settings of the output device of the client system in accordance with the received instructions.

15. The media of claim 14, wherein the identified audio fingerprints are correlated to the physical environment based at least in part on matching information associated with identified audio fingerprints to information associated with the location.

16. The media of claim 14, wherein the received instructions are based at least in part on an updated location determined at least in part on location information of the identified audio fingerprints.

17. The media of claim 14, wherein the received instructions comprise adjusting a volume of a ringer, enabling vibration, adjusting a brightness of a screen, enabling a wireless connection, or locking the computing system.

18. The media of claim 14, wherein the received instructions are based at least in part on a characteristic of the generated waveform fingerprint.

19. The media of claim 14, wherein the location is calculated based at least in part on cell tower triangulation, Wi-Fi positioning, or global positioning system (GPS) positioning.

20. The media of claim 14, wherein the location is calculated based at least in part on information of a user of a social-networking system.

21. The media of claim 20, wherein the information of the user comprise a check-in, tag of the user on a photo, comment, or RSVP associated with the location.

22. The media of claim 14, wherein the location is calculated based at least in part on querying a social graph for location information associated with one or more nodes of the social graph, wherein one or more of the nodes corresponds to one or more users that uploaded one of the identified audio fingerprints.

23. The media of claim 14, wherein the identified audio fingerprints correspond to a song, TV show, soundtrack, movie, or performance.

24. The media of claim 23, wherein one or more of the identified audio fingerprints is correlated to the physical environment based at least in part on identifying a venue associated with the identified audio fingerprints, wherein the identification is based at least in part on information provided by an online database.

25. The media of claim 14, wherein the generated waveform fingerprint is searched against of the audio fingerprints associated with a search space of the calculated location.

26. The media of claim 14, wherein the ambient audio data is captured in response to a sound level of the ambient audio data being higher than a pre-determined level or detecting a change in the calculated location.

27. A computing device comprising:

a processor; and

a memory coupled to the processor comprising instructions executable by the processor, the processor being operable when executing the instructions to;

generate a waveform fingerprint based on captured ambient audio data;

calculate a location of the computing device;

send the generated waveform fingerprint and the location to a server;

receive instructions from the server to adjust one or more device settings of an output device of the computing device, the instructions being based at least in part on identifying one or more audio fingerprints that match the generated waveform fingerprint and correlating one or more of the identified audio fingerprints to a physical environment of the computing device; and

adjust one or more of the device settings of the output device of the computing device in accordance with the received instructions.

28. The computing device of claim 27, wherein the identified audio fingerprints are correlated to the physical environment based at least in part on matching information associated with identified audio fingerprints to information associated with the location.

29. The computing device of claim 27, wherein the received instructions are based at least in part on an updated location determined at least in part on location information of the identified audio fingerprints.

30. The computing device of claim 27, wherein the received instructions comprise adjusting a volume of a ringer, enabling vibration, adjusting a brightness of a screen, enabling a wireless connection, or locking the computing system.

31. The computing device of claim 27, wherein the received instructions are based at least in part on a characteristic of the generated waveform fingerprint.

32. The computing device of claim 27, wherein the location is calculated based at least in part on cell tower triangulation, Wi-Fi positioning, or global positioning system (GPS) positioning.

33. The computing device of claim 27, wherein the location is calculated based at least in part on information of a user of a social-networking system.

34. The computing device of claim 33, wherein the information of the user comprise a check-in, tag of the user on a photo, comment, or RSVP associated with the location.

35. The computing device of claim 27, wherein the location is calculated based at least in part on querying a social graph for location information associated with one or more nodes of the social graph, wherein one or more of the nodes corresponds to one or more users that uploaded one of the identified audio fingerprints.

36. The computing device of claim 27, wherein the identified audio fingerprints correspond to a song, TV show, soundtrack, movie, or performance.

37. The computing device of claim 36, wherein one or more of the identified audio fingerprints is correlated to the physical environment based at least in part on identifying a venue associated with the identified audio fingerprints, wherein the identification is based at least in part on information provided by an online database.

38. The computing device of claim 27, wherein the generated waveform fingerprint is searched against of the audio fingerprints associated with a search space of the calculated location.

39. The computing device of claim 27, wherein the ambient audio data is captured in response to a sound level of the ambient audio data being higher than a pre-determined level or detecting a change in the calculated location.