ACOUSTIC GESTURE RECOGNITION SYSTEMS AND METHODS

• US 20170041127A1
• Filed: 10/21/2016
• Published: 02/09/2017
• Est. Priority Date: 07/20/2015
• Status: Active Grant

• Current Assignee: Lattice Semiconductor Corporation
• Original Assignee: Lattice Semiconductor Corporation
• Inventors: Sharpe-Geisler, Bradley
• Granted Patent: US 10,764,026 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 15/46 Indirect determination of position data
• CPC Class Codes: G01S 15/87 Combinations of sonar systems
• CPC Class Codes: G01S 15/89 for mapping or imaging
• CPC Class Codes: G06F 13/4291 using a clocked protocol
• CPC Class Codes: H04J 3/0638 Clock or time synchronisation among nodes; Internode synchronisation synchronization for ring networks H04L12/422; data switching networks with synchronous transmission H04L12/43
• CPC Class Codes: H04J 3/0655 using timestamps
• CPC Class Codes: H04L 7/0008 Synchronisation information channels, e.g. clock distribution lines
• CPC Class Codes: H04L 7/0012 by comparing receiver clock with transmitter clock
• CPC Class Codes: H04L 7/0033 Correction by delay

Abstract

Methods and circuitry for relatively low-speed bus time stamping and triggering for use in acoustic object and gesture detection and recognition are presented in this disclosure. A master device and slave devices can be interfaced via a communication link that includes a data line and a clock line. The master device generates and controls a clock signal on the clock line and sends a synchronization command over the data line to the slave devices. The master device receives timestamp and/or other information corresponding to events detected at each slave device, such as a detected acoustic wave reflected from an object. The master device tracks transitions and frequencies of the clock signal, and determines a time of the event based on the timestamp information, the tracked transitions and the frequencies. The master device can use the event times to derive positions and gestures associated with detected objects.

Claims

1. A system comprising:

a slave device comprising an acoustic transducer and configured to receive a clock signal and a synchronization command over a communication link, wherein the communication link comprises a single clock line that carries the clock signal and a single data line that carries the synchronization command, and wherein the slave device is configured to;

detect a reflected acoustic wave reflected from an object using the acoustic transducer,

generate information about an elapsed time between the synchronization command and the detected reflected acoustic wave based, at least in part, on a number of selected transitions of the clock signal between the synchronization command and the detected reflected acoustic wave, and

transmit the information about the elapsed time over the single data line to a master device coupled to the communication link.

2. The system of claim 1, wherein:

the slave device comprises an oscillator circuit configured to generate an oscillator signal having an oscillator frequency higher than a clock frequency of the clock signal, and

the slave device is configured to count a number of selected transitions of the oscillator signal occurring after the detected reflected acoustic wave is detected at the slave device and to generate the information about the elapsed time based, at least in part, on the number of selected transitions of the oscillator signal.

3. The system of claim 1, wherein the slave device is configured to:

receive a first delay setting information via the communication link;

track a number of selected transitions of the clock signal after the synchronization command;

generate an emitted acoustic wave emitted at least partially towards the object responsive to the number of selected transitions reaching a first delay setting indicated by the first delay setting information.

4. The system of claim 3, wherein the slave device comprises an oscillator circuit configured to generate an oscillator signal having an oscillator frequency higher than a clock frequency of the clock signal, and wherein the slave device is configured to:

receive a second delay setting information via the communication link;

generate the oscillator signal using the oscillator circuit;

track a number of selected transitions of the oscillator signal that occur after the number of selected transitions of the clock signal reach the first delay setting; and

generating the emitted acoustic wave further responsive to the number of selected transitions of the oscillator signal reaching a second delay setting indicated by the second delay setting information.

5. The system of claim 1, wherein the slave device is configured to:

generate an in-band interrupt over the single data line in response to the detected reflected acoustic wave;

receive a request for reading the information about the elapsed time; and

transmit, in response to the request, the information about the elapsed time to the master device.

6. The system of claim 1, further comprising the master device, wherein:

the master device is configured to receive the information about the elapsed time and to derive an event time corresponding to when the reflected acoustic wave was detected at the slave device based on the information about the elapsed time.

7. The system of claim 1, further comprising the communication link, wherein the master device is configured to:

transmit the synchronization command over the single data line and the clock signal over the single clock line; and

receive the information about the elapsed time and to derive an event time corresponding to when the acoustic wave was detected at the slave device based on the information about the elapsed time and numbers of selected transitions of the clock signal occurring between frequency changes of the clock signal that are tracked at the master device.

8. The system of claim 1, further comprising a plurality of slave devices, each configured to receive the clock signal and the synchronization command over the communication link, and each comprising one of a corresponding plurality of acoustic transducers, wherein the acoustic transducer and the plurality of acoustic transducers are arranged in a beamforming transducer array, and wherein each one of the plurality of slave devices is configured to:

detect the reflected acoustic wave reflected from the object,

generate individual information about an individualized elapsed time between the synchronization command and the detected reflected acoustic wave based, at least in part, on an individual number of selected transitions of the clock signal between the synchronization command and the detected reflected acoustic wave, and

transmit the individual information about the elapsed time over the single data line to a master device coupled to the communication link.

9. The system of claim 8, wherein the master device is configured to:

receive the individual information about the elapsed times;

derive a set of event times corresponding to when the acoustic wave was detected at the plurality of slave devices based on the individual information about the elapsed times; and

determine a position of the object based, at least in part, on the set of event times.

10. The system of claim 9, wherein:

the plurality of slave devices are configured to iteratively generate a time series of individual information corresponding to a time series of detected reflected acoustic waves reflected from the object and to transmit the time series of individual information to the master device over the single data line; and

the master device is configured to;

receive the time series of individual information;

derive a time series of sets of event times corresponding to when the acoustic waves were detected at the plurality of slave devices, based on the time series of individual information;

determine a time series of positions of the object based, at least in part, on the time series of sets of event times; and

detect a gesture associated with the object based, at least in part, on the time series of positions of the object.

11. A system comprising:

a master device configured to transmit a clock signal and a synchronization command over a communication link to a plurality of slave devices, wherein the communication link comprises a single clock line that carries the clock signal and a single data line that carries the synchronization command, and wherein the master device is configured to;

receive, from each slave device, information about an elapsed time between the synchronization command and a detection of a reflected acoustic wave reflected by an object and detected at the slave device, based, at least in part, on a number of selected transitions of the clock signal between the synchronization command and the detection of the reflected acoustic wave at the slave device;

derive a set of event times corresponding to when the acoustic wave was detected at the plurality of slave devices based on the received information about the elapsed times; and

determine a position of the object based, at least in part, on the set of event times.

12. The system of claim 11, wherein the master device is configured to:

receive a time series of the information about the elapsed times;

derive a time series of sets of event times corresponding to when the reflected acoustic waves were detected at the plurality of slave devices, based on the time series of the information about the elapsed times;

determine a time series of positions of the object based, at least in part, on the time series of sets of event times; and

detect a gesture associated with the object based, at least in part, on the time series of positions of the object.

13. The system of claim 11, wherein the master device is configured to:

transmit first delay setting information to the plurality of slave devices via the communication link, wherein the first delay setting information comprises a set of first delay settings for the plurality of slave devices that causes each slave device, after receiving the synchronization command, to emit an acoustic wave at least partially towards the object when a number of selected transitions of the clock signal after the synchronization command reach a first delay setting, of the set of first delay settings corresponding to an appropriate slave device, indicated by the first delay setting information.

14. The system of claim 13, wherein at least one of the plurality of slave devices comprises an oscillator circuit configured to generate an oscillator signal having an oscillator frequency higher than a clock frequency of the clock signal, and wherein the master device is configured to:

transmit second delay setting information to the at least one slave device via the communication link, wherein the second delay setting information comprises a second delay settings for the at least one slave device that causes the at least one slave device, after receiving the synchronization command, to emit an acoustic wave at least partially towards the object when the number of selected transitions of the clock signal after the synchronization command reach the first delay setting indicated by the first delay setting information and a number of selected transitions of the oscillation signal reach a second delay setting indicated by the second delay setting information.

15. The system of claim 11, wherein the master device is configured to:

pause the clock signal after transmitting the synchronization command;

receive an in-band interrupt over the single data line from one of the plurality of slave devices;

transmit a request to the one of the plurality of slave devices to read the information about the elapsed time from the one of the plurality of slave devices;

receive, in response to the request, the information about the elapsed time from the one of the plurality of slave devices.

16. A method comprising:

detecting a reflected acoustic wave reflected from an object using an acoustic transducer forming part of a slave device, wherein the slave device is configured to receive a clock signal and a synchronization command over a communication link, and wherein the communication link comprises a single clock line that carries the clock signal and a single data line that carries the synchronization command;

generating information about an elapsed time between the synchronization command and the detected reflected acoustic wave based, at least in part, on a number of selected transitions of the clock signal between the synchronization command and the detected reflected acoustic wave, and

transmitting the information about the elapsed time over the single data line to a master device coupled to the communication link.

17. The method of claim 16, wherein the slave device comprises an oscillator circuit configured to generate an oscillator signal having an oscillator frequency higher than a clock frequency of the clock signal, the method further comprising:

counting a number of selected transitions of the oscillator signal occurring after the detected reflected acoustic wave is detected at the slave device; and

generating the information about the elapsed time based, at least in part, on the number of selected transitions of the oscillator signal.

18. The method of claim 16, wherein the slave device comprises an oscillator circuit configured to generate an oscillator signal having an oscillator frequency higher than a clock frequency of the clock signal, the method further comprising:

receiving a first delay setting information and a second delay setting information via the communication link;

generating the oscillator signal using the oscillator circuit;

tracking a first number of selected transitions of the clock signal after the synchronization command and a second number of selected transitions of the oscillator signal that occur after the first number of selected transitions of the clock signal reach a first delay setting indicated by the first delay setting information; and

generating an emitted acoustic wave responsive to the second number of selected transitions of the oscillator signal reaching a second delay setting indicated by the second delay setting information.

19. The method of claim 16, further comprising:

generating an in-band interrupt over the single data line in response to the detected reflected acoustic wave;

receiving a request for reading the information about the elapsed time; and

transmitting the information about the elapsed time to the master device.

20. The method of claim 16, further comprising:

deriving an event time corresponding to when the reflected acoustic wave was detected at the slave device based on the information about the elapsed time.