Object and movement detection

• US 9,098,116 B2
• Filed: 12/18/2013
• Issued: 08/04/2015
• Est. Priority Date: 03/18/2008
• Status: Active Grant

• Current Assignee: Elliptic Laboratories AS
• Original Assignee: Elliptic Laboratories AS
• Inventors: Dahl, Tobias Gulden
• Primary Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US14/133,391
• Publication Number:
  US 20140320390A1
• Time in Patent Office: 594 Days
• Field of Search: 382/100, 382/103, 382/106, 382/107, 348169-172
• US Class Current: 1/1
• CPC Class Codes: G01S 15/04 Systems determining presence of a target
• CPC Class Codes: G01S 15/62 Sense-of-movement determination G01S15/588 takes precedence
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: H04L 25/0204 of multiple channels
• CPC Class Codes: H04L 25/0242 using matrix methods

Abstract

Motions, positions or configurations off, for example a human hand can be recognized by transmitting a plurality of transmit signals in respective time frames; receiving a plurality of receive signals; determining a plurality of channel impulse responses using the transmit and receive signals; defining a matrix of impulse responses, with impulse responses for adjacent time frames adjacent each other; and analyzing the matrix for patterns (22) corresponding to the motion position or configuration.

Claims

1. A method of tracking an object in the presence of one or more other objects in an imaging field comprising transmitting energy into said imaging field, receiving reflected energy from the imaging field, calculating a series of impulse responses at successive time intervals using said transmitted and received energy wherein the received energy is a convolution of the transmitted energy and the impulse responses, and separately identifying and isolating a subset of said impulse responses corresponding to a continuous motion.

2. A method as claimed in claim 1 wherein the transmitted energy is intermittent.

3. A method as claimed in claim 1 comprising analysing said impulse responses in the frequency domain.

4. A method as claimed in claim 1 comprising analysing the amplitude spectrum of said impulse responses in the frequency domain.

5. A method as claimed in claim 1 comprising determining changes in the frequency spectrum of said impulse responses over time.

6. A method as claimed claim 1 comprising analysing said impulse responses in the frequency domain and determining therefrom that an object is or has been changing its shape.

7. A method as claimed in claim 1 wherein the one or more objects includes a human hand or part thereof.

8. A method as claimed in claim 1 comprising tracking an object and controlling an electronic device in response to said tracking.

9. A method as claimed in claim 1 comprising tracking the movement of a user'"'"'s finger and controlling a cursor on a device with a graphical user interface in response to said tracking.

10. A method as claimed in claim 1 comprising detecting two of a user'"'"'s fingers moving together or apart.

11. A method as claimed in claim 1 wherein said signals are ultrasonic signals.

12. A method of controlling at least one operation of an electronic device using a method as claimed in claim 1.

13. A method as claimed in claim 1 further comprising storing results in a memory.

14. A method as claimed in claim 1 further comprising providing a display signal for a display device.

15. A method as claimed in claim 1 further comprising providing a control signal for an external device.

16. A method as claimed in claim 1 comprising removing a contribution of background reflections from the impulse responses.

18. A method as claimed in claim 1 comprising detecting a change of shape of an object in the time domain.

19. A method as claimed in claim 18 wherein said step of detecting a change of shape comprises monitoring for a predetermined deformation in the impulse responses.

20. A mobile device comprising an ultrasonic transmitter and separate/integrated ultrasonic receiver, said device being configured so that at least one operation thereof is controlled by determination of the movement of a user'"'"'s hand in accordance with a method as claimed in claim 1.

17. A method of tracking an object in the presence of one or more other objects in an imaging field comprising transmitting energy into said imaging field, receiving reflected energy from the imaging field, calculating a series of impulse responses at successive time intervals and selecting a subset of said impulse responses corresponding to a continuous motion, further comprising detecting two of a user'"'"'s fingers moving together or apart, wherein said movement together or apart is identified from different direction movements in respective halves or portions of said matrix.

21. A method of determining movement of one or more objects in an imaging field comprising:

transmitting a continuous or discontinuous transmit signal;

receiving a plurality of receive signals;

calculating a plurality of channel impulse responses using said transmit and receive signals, wherein the receive signals are convolutions of the transmit signals and the channel impulse responses;

defining a matrix of impulse responses, with impulse responses for respective time intervals adjacent one another; and

isolating from said matrix a pattern corresponding to a motion of one of said objects.

22. A method as claimed in claim 21 wherein the one or more objects includes a human hand or part thereof.

23. A method as claimed in claim 21 comprising detecting a change of shape of an object in the time domain.

24. A method as claimed in claim 21 wherein said signals are ultrasonic signals.

25. A method of controlling at least one operation of an electronic device using a method as claimed in claim 21.

26. A method as claimed in claim 21 comprising removing a contribution of background reflections from the impulse responses.

27. Apparatus for tracking an object in the presence of one or more other objects in an imaging field comprising:

transmission means arranged to transmit energy into said imaging field;

receiving means arranged to receive reflected energy from the imaging field; and

processing means arranged to calculate a series of impulse responses at successive time intervals using said transmitted and received energy wherein the received energy is a convolution of the transmitted energy and the impulse responses, and to select a subset of said impulse responses corresponding to a continuous motion.

28. Apparatus as claimed in claim 27 wherein said signals are ultrasonic signals.

29. An electronic device comprising an apparatus as claimed in claim 27 for controlling at least one operation thereof.

30. A non-transitory computer readable medium bearing software configured, when run on a computer, to track an object in the presence of one or more other objects in an imaging field, the software having inputs for energy transmission and reflected energy reception and further comprising logic arranged to calculate a series of impulse responses at successive time intervals using said transmitted and received energy wherein the received energy is a convolution of the transmitted energy and the impulse responses, and to separately identify and isolate a subset of said impulse responses corresponding to a continuous motion.

31. A method of recognising motion of a human hand comprising:

transmitting a plurality of transmit signals in respective time frames;

receiving a plurality of receive signals, at least some of said receive signals being reflected from said hand;

determining a plurality of channel impulse responses using said transmit and receive signals wherein the receive signals are convolutions of the transmit signals and the channel impulse responses;

removing a contribution of background reflections from the impulse responses;

defining a matrix of impulse responses, with impulse responses for adjacent time frames adjacent each other; and

analysing said matrix for patterns corresponding to movement of said hand.