Method and apparatus for detecting hand gestures with a handheld controller

• US 9,990,045 B2
• Filed: 11/12/2015
• Issued: 06/05/2018
• Est. Priority Date: 11/12/2015
• Status: Active Grant

• Current Assignee: META Platforms Technologies LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: Oculus VR, LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Inventors: Long, Clare Regimbal
• Primary Examiner(s): Lee, Nicholas J
• Assistant Examiner(s): Taylor, Jr., Duane N
• Application Number:
  US14/939,470
• Publication Number:
  US 20170139481A1
• Time in Patent Office: 936 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/0334 Ergonomic shaped mouse for vertical grip, whereby the hand controlling the mouse is resting or gripping it with an attitude almost vertical with respect of the working surface
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0338 with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A method for detecting a user'"'"'s hand gestures with a handheld controller. The method includes monitoring a first sensor and a second sensor. Each sensor is capable of sensing the presence of the user'"'"'s thumb. The method further includes sensing the presence of the thumb on the first sensor and then sensing when the thumb is no longer present on the first sensor. A time period is monitored beginning when the thumb is no longer present on the first sensor and ending when the presence of the thumb is sensed on one of the first sensor and the second sensor. Once the time period exceeds a threshold time value, a thumbs-up gesture is registered.

Claims

1. A handheld controller, comprising:

a main body;

a handle extending from the main body;

a first sensor disposed on the main body capable of sensing the presence of a user'"'"'s finger;

a second sensor capable of sensing the presence of the finger; and

a processor operative to;

monitor the first sensor and the second sensor;

register when the first sensor senses the presence of the finger;

after registering the presence of the finger, register when the finger is no longer sensed on the first sensor;

monitor a time period beginning when the finger is no longer sensed on the first sensor and ending when the presence of the finger is sensed on one of the first sensor and the second sensor; and

initiate a command to display a gesture when the time period exceeds a threshold time value and until the finger is sensed on one of the first sensor and the second sensor.

2. The handheld controller of claim 1, wherein the main body includes a thumb surface and further comprising a thumbstick extending from the thumb surface, wherein the first sensor is disposed on the thumbstick.

3. The handheld controller of claim 2, wherein the second sensor is disposed on the thumb surface.

4. The handheld controller of claim 3, wherein the first sensor and the second sensor are capacitive sensors.

5. The handheld controller of claim 2, wherein the second sensor is a button mounted in the thumb surface.

6. The handheld controller of claim 2, wherein the second sensor is a capacitive sensor disposed on a button mounted in the thumb surface.

7. The handheld controller of claim 2, wherein the processor is housed in the main body.

8. A method for detecting a user'"'"'s hand gestures with a handheld controller, the method comprising:

monitoring a first sensor and a second sensor, each sensor capable of sensing the presence of a finger of the user;

sensing the presence of the finger on the first sensor;

after registering the presence of the finger, sensing when the finger is no longer present on the first sensor;

monitoring a time period beginning when the finger is no longer present on the first sensor and ending when the presence of the finger is sensed on one of the first sensor and the second sensor; and

displaying a gesture when the time period exceeds a threshold time value and until the finger is sensed on one of the first sensor and the second sensor.

9. The method of claim 8, further comprising registering a resting position if the finger is sensed on the second sensor prior to the time period exceeding the threshold time value.

10. The method of claim 8, further comprising sensing rotation of the handheld controller and modifying the gesture according to the sensed rotation.

11. The method of claim 10, wherein sensing rotation of the handheld controller comprises monitoring an inertial measuring unit.

13. The method of claim 11, further comprising registering a resting position if the thumb is sensed on the second sensor prior to the time period exceeding the threshold time value.

14. The method of claim 11, further comprising sensing rotation of the handheld controller and modifying the thumbs-up gesture according to the sensed rotation.

15. The method of claim 14, wherein the thumbs-up gesture is modified to register a thumbs-down gesture.

12. A method for detecting a user'"'"'s hand gestures with a handheld controller, the method comprising:

monitoring a first sensor and a second sensor, each sensor capable of sensing the presence of a thumb of the user;

sensing the presence of the thumb on the first sensor;

after sensing the presence of the thumb, sensing when the thumb is no longer present on the first sensor; and

monitoring a time period beginning when the thumb is no longer present on the first sensor and ending when the presence of the thumb is sensed on one of the first sensor and the second sensor; and

displaying a thumbs-up gesture when the time period exceeds a threshold time value and until the thumb is sensed on one of the first sensor and the second sensor.