Periodic ambient waveform analysis for enhanced social functions

• US 9,275,647 B2
• Filed: 04/18/2014
• Issued: 03/01/2016
• Est. Priority Date: 08/16/2011
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Papakipos, Matthew Nicholas, Garcia, David Harry
• Primary Examiner(s): Desir, Pierre-Louis
• Assistant Examiner(s): Thomas-Homescu, Anne
• Application Number:
  US14/256,787
• Publication Number:
  US 20140358555A1
• Time in Patent Office: 683 Days
• Field of Search: 704/243, 704/249, 704/273, 704235-236, 704/275, 704/246, 707/751, 707/724, 707/748, 707769-770, 707/722, 707/739, 701/410, 701/469, 701/31.5, 701/455, 715/745
• US Class Current: 1/1
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: G10L 25/54 for retrieval
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/306 User profiles

Abstract

In particular embodiments, one or more computer-readable non-transitory storage media embody software that is operable when executed to receive an audio waveform fingerprint and a client-determined location from a client device. The received audio waveform fingerprint may be compared to a database of stored audio waveform fingerprints, each stored audio waveform fingerprint associated with an object in an object database. One or more matching audio waveform fingerprints may be found from a comparison set of audio waveform fingerprints obtained from the audio waveform fingerprint database. Location information associated with a location of the client device may be determined, and the location information may be sent to the client device. The client device may be operable to update the client-determined location based at least in part on the location information.

Claims

1. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

receive an audio waveform fingerprint and a client-determined location from a client device;

compare the received audio waveform fingerprint to a database of stored audio waveform fingerprints, each stored audio waveform fingerprint associated with an object in an object database;

find one or more matching audio waveform fingerprints from a comparison set of audio waveform fingerprints obtained from the audio waveform fingerprint database;

determine, based at least in part on the matching audio waveform fingerprints, location information associated with a location of the client device; and

send the location information to the client device, wherein the client device is operable to update the client-determined location based at least in part on the location information;

wherein;

the database of stored audio waveform fingerprints comprises uploaded audio waveform fingerprints from one or more other client devices; and

the comparison set of audio waveform fingerprints is determined based at least in part on the received client-determined location.

2. The media of claim 1, the software further operable when executed to:

send content from an object associated with one or more of the matching audio waveform fingerprints to the client device.

3. The media of claim 2, wherein the object is a song and the content from the song comprises information about the song.

4. The media of claim 1, wherein the one or more other client devices are associated with one or more users of a social-networking system.

5. The media of claim 4, wherein the matching audio waveform fingerprints comprise uploaded audio waveform fingerprints from one or more of the users.

6. The media of claim 5, wherein the location information is determined based at least in part on information associated with one or more of the users in the social-networking system.

7. The media of claim 4, wherein the objects comprise voices of one or more of the users.

8. The media of claim 4, wherein the comparison set of audio waveform fingerprints from the audio waveform fingerprint database is based at least in part on social factors between a user of the client device and one or more of the users of the social-networking system.

9. A system comprising:

one or more processors; and

a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to;

receive an audio waveform fingerprint and a client-determined location from a client device;

compare the received audio waveform fingerprint to a database of stored audio waveform fingerprints, each stored audio waveform fingerprint associated with an object in an object database;

find one or more matching audio waveform fingerprints from a comparison set of audio waveform fingerprints obtained from the audio waveform fingerprint database;

determine, based at least in part on the matching audio waveform fingerprints, location information associated with a location of the client device; and

send the location information to the client device, wherein the client device is operable to update the client-determined location based at least in part on the location information;

wherein;

the database of stored audio waveform fingerprints comprises uploaded audio waveform fingerprints from one or more other client devices; and

the comparison set of audio waveform fingerprints is determined based at least in part on the received client-determined location.

10. The system of claim 9, the processors further operable when executing the instructions to:

send content from an object associated with one or more of the matching audio waveform fingerprints to the client device.

11. The system of claim 10, wherein the object is a song and the content from the song comprises information about the song.

12. The system of claim 9, wherein the one or more other client devices are associated with one or more users of a social-networking system.

13. The system of claim 12, wherein the matching audio waveform fingerprints comprise uploaded audio waveform fingerprints from one or more of the users.

14. The system of claim 13, wherein the location information is determined based at least in part on information associated with one or more of the users in the social-networking system.

15. The system of claim 12, wherein the objects comprise voices of one or more of the users.

16. The system of claim 12, wherein the comparison set of audio waveform fingerprints from the audio waveform fingerprint database is based at least in part on social factors between a user of the client device and one or more of the users of the social-networking system.

17. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

receive a first audio waveform fingerprint and a client-determined location from a first client device;

compare the received first audio waveform fingerprint to a database of stored audio waveform fingerprints, each stored audio waveform fingerprint being uploaded from one of a plurality of second client devices;

find one or more matching audio waveform fingerprints from a comparison set of audio waveform fingerprints obtained from the audio waveform fingerprint database, the comparison set being determined based at least in part on the received client-determined location;

classify each matching audio waveform fingerprint as a high-confidence or low-confidence match; and

for each high-confidence match;

determine, based at least in part on the matching audio waveform fingerprints, location information associated with a location of the first client device; and

send the location information to the first client device, wherein the first client device is operable to update the client-determined location based at least in part on the location information;

for each low confidence match, send an instruction to the first client device and the one or more second client devices whose uploaded audio waveform fingerprints match the received first audio waveform fingerprint to capture audio data at a particular time and for a particular duration.

18. The media of claim 17, the software further operable when executed to:

receive in response to the instruction a plurality of second audio waveform fingerprints from the first client device and the one or more second client devices;

determine whether the received second audio waveform fingerprint from the first client device matches any of the one or more received second audio waveform fingerprints from the one or more second client devices; and

in response to a positive determination, determine that the first client device is in the same location as the second client devices whose received second audio waveform fingerprints match the received second audio waveform fingerprint from the first client device.

19. The media of claim 18, the software further operable when executed to:

in response to a positive determination, determine that the first client device and the second client devices whose received second audio waveform fingerprints match the received second audio waveform fingerprint from the first client device are in the same location as a particular user whose voice is associated with the matching received second audio waveform fingerprints; and

store the location of the particular user.

20. The media of claim 17, wherein the comparison set of audio waveform fingerprints from the audio waveform fingerprint database is based at least in part on social factors between a user of the first client device and one or more users of the second client devices.

21. A system comprising:

one or more processors; and

a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to;

receive a first audio waveform fingerprint and a client-determined location from a first client device;

compare the received first audio waveform fingerprint to a database of stored audio waveform fingerprints, each stored audio waveform fingerprint being uploaded from one of a plurality of second client devices;

find one or more matching audio waveform fingerprints from a comparison set of audio waveform fingerprints obtained from the audio waveform fingerprint database, the comparison set being determined based at least in part on the received client-determined location;

classify each matching audio waveform fingerprint as a high-confidence or low-confidence match; and

for each high-confidence match;

determine, based at least in part on the matching audio waveform fingerprints, location information associated with a location of the first client device; and

send the location information to the first client device, wherein the first client device is operable to update the client-determined location based at least in part on the location information;

for each low confidence match, send an instruction to the first client device and the one or more second client devices whose uploaded audio waveform fingerprints match the received first audio waveform fingerprint to capture audio data at a particular time and for a particular duration.

22. The system of claim 21, the software further operable when executed to:

receive in response to the instruction a plurality of second audio waveform fingerprints from the first client device and the one or more second client devices;

determine whether the received second audio waveform fingerprint from the first client device matches any of the one or more received second audio waveform fingerprints from the one or more second client devices; and

in response to a positive determination, determine that the first client device is in the same location as the second client devices whose received second audio waveform fingerprints match the received second audio waveform fingerprint from the first client device.

23. The system of claim 21, the software further operable when executed to:

in response to a positive determination, determine that the first client device and the second client devices whose received second audio waveform fingerprints match the received second audio waveform fingerprint from the first client device are in the same location as a particular user whose voice is associated with the matching received second audio waveform fingerprints; and

store the location of the particular user.

24. The system of claim 21, wherein the comparison set of audio waveform fingerprints from the audio waveform fingerprint database is based at least in part on social factors between a user of the first client device and one or more users of the second client devices.