Proximity detection of internet of things (IoT) devices using sound chirps

• US 9,438,440 B2
• Filed: 07/24/2014
• Issued: 09/06/2016
• Est. Priority Date: 07/29/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Lioy, Marcello, Rongo, Eric, Burns, Gregory
• Primary Examiner(s): Ferris, Derrick
• Assistant Examiner(s): Vogel, Jay
• Application Number:
  US14/339,919
• Publication Number:
  US 20150029880A1
• Time in Patent Office: 775 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G01S 11/16 using difference in transit time between electrical and acoustic signals
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 41/0876 Aspects of the degree of configuration automation
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 84/00 Network topologies
• CPC Class Codes: H04W 84/18 Self-organising networks, e.g. ad-hoc networks or sensor networks

Abstract

In an embodiment, a connection is established between first and second Internet of Things (IoT) devices. After a determination is made to execute a proximity detection procedure, the second IoT device outputs an audio emission and a data packet at substantially the same time. The first IoT device detects the audio emission via a microphone and receives the data packet. The first IoT device uses correlation information to correlate the detected audio emission with the data packet, whereby the correlation information is contained in the detected audio emission, the data packet or both. The first IoT device uses the correlation between the detected audio emission and the data packet to calculate a distance estimate between the first and second IoT devices.

Claims

1. A method of operating a first Internet of Things (IoT) device that is configured to determine a proximity to a second IoT device, comprising:

establishing a connection with the second IoT device;

determining to execute a proximity detection procedure with the second IoT device;

monitoring, via a microphone coupled to the first IoT device, for an audio emission over a first communication path from the second IoT device in response to the determination;

receiving, at a first time point, a data packet that is transmitted by the second IoT device over a second communication path at substantially the same time as the audio emission is emitted by the second IoT device over the first communication path;

detecting, at a second time point, the audio emission based on the monitoring;

correlating the detected audio emission with the data packet based upon first correlation information that is embedded within the detected audio emission and configured to help identify a header field of the data packet; and

calculating a distance estimate between the first and second IoT devices based at least in part upon the second time point.

2. The method of claim 1, wherein the calculating computes a time differential between the first time point and the second time point and generates the distance estimate based on the time differential.

3. The method of claim 1, further comprising:

obtaining an estimate of network propagation latency associated with a communication path through which the second IoT device transmitted the data packet to the first IoT device; and

adjusting the first time point based on the estimate of network propagation latency,

wherein the calculating computes a time differential between the adjusted first time point and the second time point and generates the distance estimate based on the time differential.

4. The method of claim 3,

wherein the estimate of network propagation latency is conveyed via another data packet that is exchanged between the first and second IoT devices, or

wherein clocks at the first and second IoT devices are unsynchronized, and the estimate of network propagation latency is obtained by exchanging a series of corresponding audio emissions and data packets in accordance with a fixed transmission schedule and then averaging differences between arrival times of the series of corresponding audio emissions and data packets.

5. The method of claim 1,

wherein a first clock running on the first IoT device is synchronized with a second clock running on the second IoT device,

wherein the data packet includes an indication of a third time point at which the second IoT device transmitted the data packet according to the second clock,

wherein the second time point is determined according to the first clock, and

wherein the calculating computes a time differential between the second time point and the third time point from the data packet and generates the distance estimate based on the time differential.

6. The method of claim 1,

wherein the data packet further includes second correlation information that is configured to help identify the detected audio emission, and

wherein the detecting is based upon a comparison between the second correlation information and audio data being monitored by the monitoring.

7. The method of claim 6, wherein the second correlation information includes a dual-tone multi-frequency (DTMF) signature that characterizes the detected audio emission and/or a pulse-code modulation (PCM) signature that characterizes the detected audio emission.

8. The method of claim 1,

wherein the first correlation information includes a sequence number of the data packet, and

wherein the header field of the data packet is a sequence field of a header of the data packet.

9. The method of claim 1, wherein the second communication path over which the data packet is received corresponds to a direct communication path that includes a Bluetooth connection and/or a line-of-sight (LoS) light emission sequence.

10. The method of claim 1, wherein the second communication path over which the data packet is received corresponds to an indirect communication path that includes an Internet Protocol (IP) connection via an access point.

11. The method of claim 10, wherein the IP connection is based on a user datagram protocol (UDP).

12. The method of claim 1, further comprising:

executing at least two more proximity detection procedures with at least two more IoT devices to calculate at least two more distance estimates to the at least two more IoT devices; and

computing a position of the first IoT device via trilateration based on the distance estimate and the at least two more distance estimates.

13. The method of claim 1, wherein the first communication path over which the audio emission is output is a sound propagation medium.

14. The method of claim 1,

wherein the determination to execute the proximity detection procedure is initiated by the first IoT device, or

wherein the determination to execute the proximity detection procedure is initiated by the second IoT device.

15. The method of claim 1,

wherein a first clock running on the first IoT device is synchronized with a second clock running on the second IoT device,

wherein the data packet includes an indication of a time point at which the second IoT device transmitted the data packet according to the second clock.

16. A method of facilitating proximity detection between a first Internet of Things (IoT) device and a second IoT device at the second IoT device, comprising:

establishing a connection with the first IoT device;

determining to execute a proximity detection procedure with the first IoT device;

outputting, via an audio output device coupled to the second IoT device, an audio emission from the second IoT device over a first communication path in response to the determination; and

transmitting, at substantially the same time as the outputting of the audio emission over the first communication path, a data packet to the first IoT device over a second communication path, wherein the audio emission and the data packet are configured to be correlated with each other at the first IoT device in conjunction with the proximity detection procedure for calculation of a distance estimate between the first and second IoT devices based upon correlation information, and

wherein the correlation information includes first correlation information that is embedded within the audio emission and configured to help identify a header field of the data packet.

17. The method of claim 16, wherein the data packet further includes second correlation information that is configured to help identify the audio emission.

18. The method of claim 17, wherein the second correlation information includes a dual-tone multi-frequency (DTMF) signature that characterizes the audio emission and/or a pulse-code modulation (PCM) signature that characterizes the audio emission.

19. The method of claim 16,

wherein the first correlation information includes a sequence number of the data packet, and

wherein the header field of the data packet is a sequence field of a header of the data packet.

20. The method of claim 16, wherein the second communication path over which the data packet is transmitted corresponds to a direct communication path includes a Bluetooth connection and/or a line-of-sight (LoS) light emission sequence.

21. The method of claim 16, wherein the second communication path over which the data packet is transmitted corresponds to an indirect communication path includes an Internet Protocol (IP) connection via an access point.

22. The method of claim 21, wherein the IP connection is based on a user datagram protocol (UDP).

23. The method of claim 16, wherein the first communication path over which the audio emission is output is a sound propagation medium.

24. The method of claim 16,

wherein the determination to execute the proximity detection procedure is initiated by the first IoT device, or

wherein the determination to execute the proximity detection procedure is initiated by the second IoT device.

25. The method of claim 16,

wherein the proximity detection procedure is implemented in parallel with the first IoT device and at least one other IoT device by coordinating the audio emission to be output to both the first IoT device and the at least one other IoT device, and transmitting at least one other data packet to the at least one other IoT device at substantially the same time as the outputting of the audio emission.

26. The method of claim 16,

wherein a first clock running on the first IoT device is synchronized with a second clock running on the second IoT device,

wherein the data packet includes an indication of a time point at which the second IoT device transmitted the data packet according to the second clock.

27. A first Internet of Things (IoT) device that is configured to determine a proximity to a second IoT device, comprising:

means for establishing a connection with the second IoT device;

means for determining to execute a proximity detection procedure with the second IoT device;

means for monitoring, via a microphone coupled to the first IoT device, for an audio emission over a first communication path from the second IoT device in response to the determination;

means for receiving, at a first time point, a data packet that is transmitted by the second IoT device over a second communication path at substantially the same time as the audio emission is emitted by the second IoT device over the first communication path;

means for detecting, at a second time point, the audio emission based on the monitoring;

means for correlating the detected audio emission with the data packet based upon first correlation information that is embedded within the detected audio emission and configured to help identify a header field of the data packet; and

means for calculating a distance estimate between the first and second IoT devices based at least in part upon the second time point.

28. A second Internet of Things (IoT) device configured to facilitate proximity detection between a first IoT device and the second IoT device, comprising:

means for establishing a connection with the first IoT device;

means for determining to execute a proximity detection procedure with the first IoT device;

means for outputting, via an audio output device coupled to the second IoT device, an audio emission from the second IoT device over a first communication path in response to the determination; and

means for transmitting, at substantially the same time as the outputting of the audio emission over the first communication path, a data packet to the first IoT device over a second communication path, wherein the audio emission and the data packet are configured to be correlated with each other at the first IoT device in conjunction with the proximity detection procedure for calculation of a distance estimate between the first and second IoT devices based upon correlation information, and

wherein the correlation information includes first correlation information that is embedded within the audio emission and configured to help identify a header field of the data packet.

29. A first Internet of Things (IoT) device that is configured to determine a proximity to a second IoT device, comprising:

a processor, a memory and/or a transceiver configured to;

establish a connection with the second IoT device;

determine to execute a proximity detection procedure with the second IoT device;

monitor, via a microphone coupled to the first IoT device, for an audio emission over a first communication path from the second IoT device in response to the determination;

receive, at a first time point, a data packet that is transmitted by the second IoT device over a second communication path at substantially the same time as the audio emission is emitted by the second IoT device over the first communication path;

detect, at a second time point, the audio emission based on the monitoring;

correlate the detected audio emission with the data packet based upon first correlation information that is embedded within the detected audio emission and configured to help identify a header field of the data packet; and

calculate a distance estimate between the first and second IoT devices based at least in part upon the second time point.

30. A second Internet of Things (IoT) device configured to facilitate proximity detection between a first IoT device and the second IoT device, comprising:

a processor, a memory and/or a transceiver configured to;

establish a connection with the first IoT device;

determine to execute a proximity detection procedure with the first IoT device;

output, via an audio output device coupled to the second IoT device, an audio emission from the second IoT device over a first communication path in response to the determination;

and transmit, at substantially the same time as the outputting of the audio emission over the first communication path, a data packet to the first IoT device over a second communication path, wherein the audio emission and the data packet are configured to be correlated with each other at the first IoT device in conjunction with the proximity detection procedure for calculation of a distance estimate between the first and second IoT devices based upon correlation information, and

wherein the correlation information includes first correlation information that is embedded within the audio emission and configured to help identify a header field of the data packet.

31. A non-transitory computer-readable medium containing instructions stored thereon, which, when executed by a first Internet of Things (IoT) device that is configured to determine a proximity to a second IoT device, causes the first IoT device to perform operations, the instructions comprising:

at least one instruction to cause the first IoT device to establish a connection with the second IoT device;

at least one instruction to cause the first IoT device to determine to execute a proximity detection procedure with the second IoT device;

at least one instruction to cause the first IoT device to monitor, via a microphone coupled to the first IoT device, for an audio emission over a first communication path from the second IoT device in response to the determination;

at least one instruction to cause the first IoT device to receive, at a first time point, a data packet that is transmitted by the second IoT device over a second communication path at substantially the same time as the audio emission is emitted by the second IoT device over the first communication path;

at least one instruction to cause the first IoT device to detect, at a second time point, the audio emission based on the monitoring;

at least one instruction to cause the first IoT device to correlate the detected audio emission with the data packet based upon first correlation information that is embedded within the detected audio emission and configured to help identify a header field of the data packet; and

at least one instruction to cause the first IoT device to calculate a distance estimate between the first and second IoT devices based at least in part upon the second time point.

32. A non-transitory computer-readable medium containing instructions stored thereon, which, when executed by a second Internet of Things (IoT) device configured to facilitate proximity detection between a first IoT device and the second IoT device, causes the second IoT device to perform operations, the instructions comprising:

at least one instruction to cause the second IoT device to establish a connection with the first IoT device;

at least one instruction to cause the second IoT device to determine to execute a proximity detection procedure with the first IoT device;

at least one instruction to cause the second IoT device to output, via an audio output device coupled to the second IoT device, an audio emission from the second IoT device over a first communication path in response to the determination; and

at least one instruction to cause the second IoT device to transmit, at substantially the same time as the outputting of the audio emission over the first communication path, a data packet to the first IoT device over a second communication path, wherein the audio emission and the data packet are configured to be correlated with each other at the first IoT device in conjunction with the proximity detection procedure for calculation of a distance estimate between the first and second IoT devices based upon correlation information, and

wherein the correlation information includes first correlation information that is embedded within the audio emission and configured to help identify a header field of the data packet.