DEVICES, SYSTEMS, AND METHODS FOR CONTROLLING DEVICES USING GESTURES

• US 20160259421A1
• Filed: 10/08/2014
• Published: 09/08/2016
• Est. Priority Date: 10/08/2013
• Status: Abandoned Application

• Current Assignee: University of Washington
• Original Assignee: University of Washington
• Inventors: Kellogg, Bryce, Nandakumar, Rajalakshmi, Gollakota, Shyamnath, Talla, Vamsi
• Application Number:
  US15/028,402
• Publication Number:
  US 20160259421A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04M 1/72442 for playing music files
• CPC Class Codes: H04W 24/02 Arrangements for optimising operational condition

Abstract

Example devices, systems, and methods described herein extract gesture information from wireless signals. Examples described herein may extract gesture information from changes in the magnitude of the amplitude of the received wireless signals, or portions of the received wireless signals (e.g., channel state information, RSSI information, RCPI information). Time-domain classification of gestures may proceed based on the amplitude changes. In this manner, sufficiently low power operation may be achieved to enable “through-the-pocket” gesture recognition on mobile devices in some examples.

Claims

1. A method comprising:

receiving, using a device, wireless signals after a gesture selected to control the device is performed;

analyzing, using the device, magnitude changes in amplitude of the wireless signals indicative of the gesture;

identifying the gesture based, at least in part, on the magnitude changes in amplitude in the wireless signals; and

responding to the gesture, using the device.

3. The method of claim 1, wherein the wireless signals include radio frequency signals, sound signals, or combinations thereof.

6. The method of claim 1, wherein the receiving comprises receiving wireless signals through a harrier layer which is not in contact with a source of the gesture, and wherein the barrier layer is at least partially opaque.

7. The method of claim 1, wherein responding comprises changing a volume, changing a playback track, selecting a contact, silencing an incoming call, or combinations thereof.

8. The method of claim 1, wherein the amplitude changes in the wireless signals comprise amplitude changes in channel state information received by the device.

11. The method of claim 1, wherein the gesture comprises a swipe, an up gesture, a down gesture, a push gesture, a pull gesture, a flick, a double flick, a punch, a lever gesture, a zoom-in gesture, as zoom-out gesture, or combinations thereof.

2. (canceled)

4-5. -5. (canceled)

9-10. -10. (canceled)

12. A device comprising:

a receiver configured to receive wireless signals and provide an indication, of magnitude changes of amplitude of the wireless signals over time;

a classifier configured to identify an associated gesture based on the indication of the magnitude changes of amplitude of the wireless signals over time the classifier further configured to provide an indication of the associated gesture; and

at least one processing unit configured to provide a response to the indication of the associated gesture.

13. The device of claim 12, wherein the classifier comprises at least one of an analog circuit encoded with gesture information, a microcontroller, and a software application loaded on the device and configured to receive the indication from the receiver.

15. The device of claim 12, wherein the receiver comprises an envelope detector.

16. The device of claim 12, further comprising an energy harvester configured to harvest sufficient energy from an environment to power the receiver and the classifier.

17. The device of claim 12, wherein the wireless signals include channel state information.

18. The device of claim 12, wherein the wireless signals comprise radio frequency signals.

19. The device of claim 12, wherein the associated gesture comprises a swipe, an up gesture, a down gesture, a push gesture, a pull gesture, a flick, a double flick, a punch, a lever gesture, a zoom-in gesture, a zoom-out gesture, or combinations thereof.

20. The device of claim 12, wherein the receiver comprises a cellular telephone receiver.

14. (canceled)

21. (canceled)

22. A device comprising:

a receiver configured to extract an amplitude of a wireless signal over time;

a classifier configured to detect changes in the amplitude of the wireless signal over time, the classifier further configured to identify a gesture corresponding to the changes in the amplitude of the wireless signal over time.

23. The device of claim 22, wherein the classifier is configured to condition the amplitude of the wireless signal over time.

24. The device of claim 23, wherein the classifier is configured to condition the amplitude of the wireless signal over time comprises the classifier configured to interpolate between gaps in the amplitude of the signal over time, apply a low pass filter to the amplitude of the signal over time, subtract a windowed moving average of the amplitude of the signal over time, or any combination thereof.

25. The device of claim 24, wherein the classifier is configured to interpolate between gaps in the amplitude of the signal over time comprises application of a 1-D linear interpolation algorithm.

30. The device of claim 22, wherein the receiver is configured to extract the amplitude of the wireless signal over time comprises the receiver configured to detect the amplitude from channel state information or received signal strength information.

31. The device of claim 30, wherein the classifier is further configured to detect changes in phase of the wireless signal over time from the channel site information of the received signal strength information, wherein the classifier is further configured to identify the gesture corresponding to the changes in the phase of the wireless signal over time.

35. The device of claim 22, further comprising a plurality of antennas configured to receive a plurality of wireless signals, wherein the classifier is configured to detect changes in amplitudes of two or more of the plurality of wireless signals over time and to identify a gesture corresponding to the changes in the amplitudes of the two or more of the plurality of wireless signals over time.

26-29. -29. (canceled)

32-34. -34. (canceled)

36-37. -37. (canceled)