Acoustic motion determination

• US 9,152,276 B2
• Filed: 09/22/2010
• Issued: 10/06/2015
• Est. Priority Date: 09/23/2009
• Status: Active Grant

• Current Assignee: Elliptic Laboratories AS
• Original Assignee: Elliptic Laboratories AS
• Inventors: Dahl, Tobias, Kirkhus, Trine, Kavli, Tom ystein
• Primary Examiner(s): Backer, Firmin
• Assistant Examiner(s): MURPHY, JEROLD B
• Application Number:
  US13/497,759
• Publication Number:
  US 20120243374A1
• Time in Patent Office: 1,840 Days
• Field of Search: 702150-171, 715/863, 345156-158, 341 20- 22, 463/7
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

The motion of an object is characterized by transmitting acoustic signals over first and second transmitter-receiver channels. Information relating to signals received over the first channel is compared with information relating to signals received over the second channel, to identify a similar pattern in both channels arising from reflections from the object. A relative timing difference between the channels, associated with the similar pattern, is used to characterize the motion of the object.

Claims

1. A method of characterising the motion of an object comprising:

transmitting a plurality of acoustic transmit signals over first and second channels provided on a single device, said first channel comprising a first transmitter and a first receiver and said second channel comprising one of the three options comprising said first transmitter and a second receiver, a second transmitter and said first receiver, and a second transmitter and a second receiver;

a first set of said transmit signals being reflected from an object in motion at a first set of times to form a first set of reflected signals;

receiving said first set of reflected signals over said first channel;

generating a first impulse response image comprising at least one of the group;

impulse responses calculated from the first set of reflected signals;

an offset, negated or linearly scaled transformation of impulse responses calculated from the first set of reflected signals; and

an envelope of impulse responses calculated from the first set of reflected signals;

a second set of said transmit signals being reflected from the object in motion at a second set of times to form a second set of reflected signals;

receiving said second set of reflected signals over said second channel;

generating a second impulse response image comprising at least one of the group;

impulse responses calculated from the second set of reflected signals;

an offset, negated or linearly scaled transformation of impulse response responses calculated from the second set of reflected signals; and

an envelope of impulse response responses calculated from the second set of reflected signals;

comparing the first impulse response image with the second impulse response image to identify, in the first impulse response image, a first pattern arising from the motion and, in the second impulse response image, a second pattern arising from the motion; and

using one or more relative timing differences between the channels, associated with the first and second patterns to characterise the motion of the object as “

Left”

, “

Right”

, “

Up”

, “

Down”

, “

Select”

or “

Too Vague”

.

2. A method as claimed in claim 1 comprising using the motion characterisation to control an electronic device.

3. A method as claimed in claim 1 comprising processing one or more of the first and second set of reflected signals using one or more processes selected from the group consisting of:

amplification, sampling, analogue filtering, digital filtering, envelope extraction, distortion in time, linear transformation, non-linear transformation, complex transformation, frequency-domain transformation, and time-frequency-domain transformation.

4. A method as claimed in claim 1 comprising using a temporal offset between the first and second sets of times to characterise the motion of the object.

5. A method as claimed in claim 4 wherein the temporal offset is greater than a minimum amount selected from the group consisting of:

0.5 milliseconds;

1 millisecond;

1.5 milliseconds;

the time it takes a signal to travel to an object at the periphery of a predetermined detection range;

the time it takes a signal to travel to and from an object at the periphery of a predetermined detection range;

the maximum time-of-flight difference between the two channels for a given signal; and

, for periodic transmit signals, the period of the transmit signals or a multiple of said period.

6. A method as claimed in claim 1 wherein the transmit signals are periodic.

7. A method as claimed in claim 1 wherein the transmit signals are composed of a series of pulses.

8. A method as claimed in claim 1 wherein the transmit signals comprise one or more chirps.

9. A method as claimed in claim 1 wherein the comparison step is carried out on at least a portion of a filtered signal.

10. A method as claimed in claim 1 comprising transmitting acoustic transmit signals over more than two channels, each channel comprising at least one transmitter and at least one receiver, wherein the received signals on each channel comprise reflections from the object.

11. A method as claimed in claim 1 comprising transmitting acoustic transmit signals from a plurality of transmitters wherein the transmit signal is encoded differently for each transmitter.

12. A method as claimed in claim 1 comprising calculating a variance parameter between said two impulse response images, and applying a threshold variance to determine whether said first and second patterns are similar or not.

13. A method as claimed in claim 1 comprising performing a cross-correlation between said first and second sets impulse response images.

14. A method as claimed in claim 1 wherein the first pattern is a transformation of the second pattern.

15. A method as claimed in claim 1 comprising applying a transformation to one of said first impulse response image, said second impulse response image and said first and second impulse response images before comparing said first and second patterns.

16. A method as claimed in claim 1 comprising dithering the transmit signals in time, and applying an inverse dithering to the first and second sets of reflected signals.

17. A method as claimed in claim 1 wherein the first and second patterns comprise intensity contours in said first and second impulse response images.

18. A method as claimed in claim 1 comprising applying one or more filters to the first and second impulse response images selected from the set of filters consisting of:

filters that pass signals corresponding to a set of trajectories of motion of the object;

filters to enhance a motion trend in the received signals;

filters to detect motion of the object in the presence of noise;

filters to remove contributions from slowly-moving objects;

filters to remove contributions from still objects;

filters to remove contributions where it can be determined that two objects are overlapping in time-of-flight distance;

response image edge filters; and

Constant False Alarm Rate filters.

19. Apparatus for characterising the motion of an object comprising:

a transmission subsystem arranged to transmit a plurality of acoustic signals;

a receiving subsystem arranged to receive first and second sets of reflected signals comprising respective sets of reflections of said acoustic signals from the object in motion at first and second sets of times and, with the transmission subsystem, defining first and second channels; and

a processing subsystem configured to;

generate a first impulse response image comprising at least one of the group;

impulse responses calculated from the first set of reflected signals;

an offset, negated or linearly scaled transformation of impulse responses calculated from the first set of reflected signals;

or an envelope of impulse responses calculated from the first set of reflected signals;

generate a second impulse response image comprising at least one of the group;

impulse responses calculated from the second set of reflected signals;

an offset, negated or linearly scaled transformation of impulse responses calculated from the second set of reflected signals;

or an envelope of impulse responses calculated from the second set of reflected signals;

compare the first impulse response image with the second impulse response image to identify, in the first impulse response image, a first pattern arising from the motion and, in the second impulse response image, a second pattern arising from the motion; and

use one or more relative timing differences between the channels, associated with the first and second patterns to characterise the motion of the object as “

Left”

, “

Right”

, “

Up”

, “

Down”

, “

Select”

or “

Too Vague”

.

20. Apparatus as claimed in claim 19 wherein the transmission and receiving subsystems define more than two channels.

21. Apparatus as claimed in claim 19 comprising at least one transmitter that is shared by a plurality of channels.

22. Apparatus as claimed in claim 19 comprising at least one receiver that is shared by a plurality of channels.

23. A non-transitory computer-readable medium comprising instructions that when executed by a computer causes the computer to perform a method of characterizing the motion of an object comprising:

transmitting a plurality of acoustic transmit signals over first and second channels provided on a single device, said first channel comprising a first transmitter and a first receiver and said second channel comprising one of the three options comprising said first transmitter and a second receiver, a second transmitter and said first receiver, and a second transmitter and a second receiver;

a first set of said transmit signals being reflected from an object in motion to form a first set of reflected signals;

receiving said first set of reflected signals over said first channel;

generating a first impulse response image comprising at least one of the group;

impulse responses calculated from the first set of reflected signals;

an offset, negated or linearly scaled transformation of impulse responses calculated from the first set of reflected signals;

or an envelope of impulse responses calculated from the first set of reflected signals;

a second set of said transmit signals being reflected from the object in motion at a second set of times to form a second set of reflected signals;

receiving said second set of reflected signals over said second channel;

generating a second impulse response image comprising at least one of the group;

impulse responses calculated from the second set of reflected signals;

an offset, negated or linearly scaled transformation of impulse responses calculated from the second set of reflected signals;

or an envelope of impulse responses calculated from the second set of reflected signals;

comparing the first impulse response image with the second impulse response image to identify, in the first impulse response image, a first pattern arising from the motion and, in the second impulse response image, a second pattern arising from the motion; and

using one or more relative timing differences between the channels, associated with the first and second patterns, to characterise the motion of the object as “

Left”

, “

Right”

, “

Up”

, “

Down”

, “

Select”

or “

Too Vague”

.

24. A method of characterising the motion of an object comprising:

continuously transmitting an acoustic transmit signal over first and second channels provided on a single device, said first channel comprising a first transmitter and a first receiver and said second channel comprising one of the three options comprising said first transmitter and a second receiver, a second transmitter and said first receiver, and a second transmitter and a second receiver;

a first portion of said transmit signals being reflected from an object in motion over a first range of time to form a first reflected signal portion;

receiving said first reflected signal portion over said first channel;

generating a first impulse response image comprising at least one of the group;

impulse responses calculated from the first reflected signal portion;

an offset, negated or linearly scaled transformation of impulse responses calculated from the first reflected signal portion;

or an envelope of impulse responses calculated from the first reflected signal portion;

a second portion of said transmit signal being reflected from the object in motion over a second range of time to form a second reflected signal portion;

receiving said second reflected signal portion over said second channel;

generating a second impulse response image comprising at least one of the group;

impulse responses calculated from the second reflected signal portion;

an offset, negated or linearly scaled transformation of impulse responses calculated from the second reflected signal portion;

or an envelope of impulse responses calculated from the second reflected signal portion;

comparing the first impulse response image with the second impulse response image to identify, in the first impulse response image, a first pattern arising from the motion and, in the second impulse response image, a second pattern arising from the motion; and

using one or more relative timing differences between the channels, associated with the first and second patterns, to characterise the motion of the object as “

Left”

, “

Right”

, “

Up”

, “

Down”

, “

Select”

or “

Too Vague”

.

25. A non-transitory computer-readable medium comprising instructions that when executed by a computer causes the computer to perform a method of characterizing the motion of an object comprising:

continuously transmitting an acoustic transmit signal over first and second channels provided on a single device, said first channel comprising a first transmitter and a first receiver and said second channel comprising one of the three options comprising said first transmitter and a second receiver, a second transmitter and said first receiver and a second transmitter and a second receiver;

a first portion of said transmit signal being reflected from an object in motion to form a first reflected signal portion;

receiving said first reflected signal portion over said first channel;

generating a first impulse response image comprising at least one of the group;

impulse responses calculated from the first reflected signal portion;

an offset, negated or linearly scaled transformation of impulse responses calculated from the first reflected signal portion;

or an envelope of impulse responses calculated from the first reflected signal portion;

a second portion of said transmit signal being reflected from the object in motion over a second range of time to form a second reflected signal portion;

receiving said second reflected signal portion over said second channel;

generating a second impulse response image comprising at least one of the group;

impulse responses calculated from the second reflected signal portion;

an offset, negated or linearly scaled transformation of impulse responses calculated from the second reflected signal portion;

or an envelope of impulse responses calculated from the second reflected signal portion;

comparing the first impulse response image with the second impulse response image to identify, in the first impulse response image, a first pattern arising from the motion and, in the second impulse response image, a second pattern arising from the motion; and

using one or more relative timing differences between the channels, associated with the first and second patterns, to characterise the motion of the object as “

Left”

, “

Right”

, “

Up”

, “

Down”

, “

Select”

or “

Too Vague”

.