Apparatus and method for determining co-location of services using a device that generates an audio signal

• US 9,641,980 B2
• Filed: 07/29/2016
• Issued: 05/02/2017
• Est. Priority Date: 05/16/2014
• Status: Active Grant

• Current Assignee: Alphonso, Inc. (LG Corporation)
• Original Assignee: Alphonso, Inc. (LG Corporation)
• Inventors: Kalampoukas, Lampros, Chordia, Ashish, Kodige, Raghu Srinivas
• Primary Examiner(s): HUBER, PAUL W
• Application Number:
  US15/224,108
• Publication Number:
  US 20160337803A1
• Time in Patent Office: 277 Days
• Field of Search: None
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: G10L 25/03 characterised by the type of extracted parameters
• CPC Class Codes: G10L 25/18 the extracted parameters being spectral information of each sub-band
• CPC Class Codes: G10L 25/27 characterised by the analysis technique
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00
• CPC Class Codes: H04R 29/004 for microphones H04R29/007 takes precedence
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

An audio signature is generated by a user device by generating an audio signal indicative of the user device, outputting the audio signal indicative of the user device through a speaker of the user device, using a microphone of the user device to sense audio, generating an audio signature of the audio sensed by the microphone in the user device, and transmitting the audio signature from the user device to a communication channel. The audio signal may be used by another user device which generates its own audio signature, and which can be compared to the audio signature of the user device that originally generated the audio signal to determine if the user devices are co-located.

Claims

1. An apparatus for generating an audio signature comprising:

a probe including a microphone;

an audio signal generator configured to generate an audio signal indicative of said apparatus;

a speaker responsive to said audio signal generator that outputs the generated audio signal;

an audio signature generator connected to said microphone configured to generate an audio signature from a sampled audio signal detected by the microphone, wherein the audio signature generator generates the audio signature without requiring detection of any additional audio signal; and

a transmitter connected to said audio signature generator configured to transmit the audio signature to a communications channel.

2. An apparatus according to claim 1 wherein said audio signal generator is configured to generate an inaudible audio signal.

3. An apparatus according to claim 1 wherein said audio signal generator is an audio identification signal generator.

4. An apparatus according to claim 1 wherein said audio signal is an inaudible audio signal which is an audio identification signal.

5. An apparatus according to claim 3 wherein the audio identification signal generator generates a unique identification for the apparatus.

6. An apparatus according to claim 1 wherein the apparatus is a smartphone or a tablet.

7. An apparatus according to claim 1 wherein the probe provides a timestamp corresponding to the sampled audio signal, the timestamp being transmitted with the audio signature.

8. An apparatus according to claim 1 wherein the probe provides location data corresponding to the sampled audio signal, the location data being transmitted with the audio signature.

9. A method for generating an audio signature by a user device comprising the steps of:

generating an audio signal indicative of the user device;

outputting said audio signal indicative of the user device through a speaker of the user device;

using a microphone of the user device to sense audio;

generating an audio signature of the audio sensed by the microphone in the user device, wherein the audio signature is generated without requiring detection of any additional audio signal; and

transmitting said audio signature from the user device to a communication channel.

10. A method according to claim 9 wherein said step of generating an audio signal, generates an inaudible audio signal.

11. A method according to claim 9 wherein the audio signal indicative of the user device is a unique identification of the user device.

12. A method according to claim 9 wherein the user device is a smartphone or a tablet.

13. A method according to claim 9 further comprising the step of:

providing by the user device a timestamp corresponding to the sensed audio signal, the timestamp being transmitted with the audio signature.

14. A method according to claim 9 further comprising the step of:

providing by the user device location data corresponding to the sensed audio signal, the location data being transmitted with the audio signature.

15. A method for determining co-location of multiple devices, a first device including an audio signal generator and a speaker responsive to the audio signal generator that outputs the generated audio signal, the first device and a second device each including a probe having a microphone that receives the audio signal, an audio signature generator responsive to the microphone, and a transmitter connected to the audio signature generator, the method comprising:

(a) the first device outputting the generated audio signal;

(b) the first and second device performing the steps of;

(i) generating by the audio signature generator of the respective device an audio signature from the audio signal received by the microphone of the respective device, wherein the audio signature generator of the respective devices generates the audio signature without requiring detection of any additional audio signal, and

(ii) transmitting by the transmitter of the respective device the generated audio signature and device identification of the respective device to a communication channel;

(c) receiving at a remote server connected to the communication channel the audio signatures of the respective devices and the device identification of the respective devices;

(d) comparing the audio signatures of the respective devices and determining whether the audio signatures match one another within a threshold level of confidence; and

(e) reporting the device identification of devices having matching audio signatures,

wherein the matching audio signatures identify likely co-located devices.

16. The method of claim 15 wherein the audio signal generator of the first device is configured to generate an inaudible audio signal, wherein steps (b)-(d) are performed using the audio signature of the inaudible audio signal.

17. The method of claim 15 wherein the first device is a smartphone or tablet.

18. The method of claim 15 wherein the first and second devices are both either smartphones or tablets.

19. The method of claim 15 wherein the probe of each device further provides a timestamp corresponding to the audio signal received by the microphone of the respective device, the timestamp being transmitted with the audio signature, the method further comprising:

(f) comparing the timestamps from the respective devices,

wherein the comparison step (d) is performed only for audio signatures that have timestamps within a predefined proximity of time.

20. The method of claim 15 wherein the probe of each device further provides location data corresponding to the audio signal received by the microphone of the respective device, the location data being transmitted with the audio signature, the method further comprising:

(f) comparing the location data from the respective devices,

wherein the comparison step (d) is performed only for audio signatures that have the same location data.

21. The method of claim 20 wherein the location data is based on one of GPS, Wi-Fi, cellular facilities, or indoor location tracking services.

22. The method of claim 15 wherein the generated audio signal does not uniquely identify the first device.