Remote control with 3D pointing and gesture recognition capabilities

• US 9,927,876 B2
• Filed: 09/28/2012
• Issued: 03/27/2018
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: Movea
• Original Assignee: Movea
• Inventors: De Foras, Etienne, Aujay, Guillaune, Aujay, Grgoire, Gomez, David, Michallon, Loic, Meunier, Nicolas
• Primary Examiner(s): Bibbins, Latanya
• Application Number:
  US13/631,134
• Publication Number:
  US 20140092011A1
• Time in Patent Office: 2,006 Days
• Field of Search: 345157, 340 43, 307119, 715716, 348734
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device

Abstract

A remote control, such as a 3D air mouse, includes motion sensors used to measure position/orientation in space to alternatively control a cursor on a display, recognize gestures by the user so that data/commands can be entered into an electronic system being controlled or the like. Timed sequences of pressing a single trigger button and the quantity of motion during said sequences are both timed in relation to thresholds to switch between modes.

Claims

1. A user to machine interface comprising:

a remote control with at least a trigger button,

a communication link between the remote control and a display,

a motion sensor for generating motion signals at least partially representative of motion of the remote control, and

a processor configured to;

process said motion signals in at least one of a first mode and a second mode of operation of said interface, and

switch the operation of the interface between said first and second modes, at least one of which enables operation of said interface based on motion of the remote control,

wherein at least a switching decision is based on an evaluation of a combination of i) a duration δ

_ON indicative of a length of time of an ON state during which a user presses the trigger button in a press and release cycle of the trigger button, and ii) a function Q_motion representative of a quantity of motion imparted to the remote by the user, derived from the motion signals including at least one moment during said ON state.

2. The interface of claim 1, wherein said switching decision is based on an evaluation of a position of a point P defined at least by two coordinates values δ

_ON (P) and Q_motion (P), in relation to at least a region in a coordinate system defined by axes of the coordinate values where said point P is plotted, the axes respectively corresponding to the duration δ

_ON and the function Q_motion, each region corresponding to one of the first mode and the second mode.

3. The interface of claim 2, wherein each region defines a class of user'"'"'s actions.

4. The interface of claim 3, wherein the switching decision depends on a combination of the result of the evaluation of the duration δ

_ON and the function Q_motion, and of the switching decision defined by the region to which the point P belongs.

5. The interface of claim 2, wherein said at least a region includes only one continuous region R.

6. The interface of claim 5, wherein said first mode belongs to a group of modes comprising i) a mode A defined as a passive mode where the interface is not operated based on motion of the remote control and ii) a mode B of control of a cursor on the display, and the result of the evaluation of the duration δ

_ON and the function Q_motion is that the point P belongs to the region R, the second mode to which the operation of the interface will switch is the other one of modes A and B in which the interface was not operating prior to said switching.

7. The interface of claim 5, wherein said first mode belongs to a group of modes comprising i) a mode A defined as a passive mode where the interface is not operated based on motion of the remote control and ii) a mode B of control of a cursor on the display, and the result of the evaluation of the duration δ

_ON and the function Q_motion is that the point P corresponding to said first mode does not belong the region R, the second mode to which the operation of the interface will switch is a mode C of user gesture recognition.

8. The interface of claim 7, wherein, at the end of the ON state, the operation of the interface will switch to the first mode in which the interface was operating prior to the beginning of the ON state.

9. The interface of claim 8, wherein the first mode is mode B.

10. The interface of claim 9, wherein, when switching from the first mode to the second mode, the position of the cursor is frozen on the display at cursor coordinates at the start of the ON state.

11. The interface of claim 10, wherein the cursor is unfrozen at a moment which is delayed by a preset value T after the end of the ON state.

12. The interface of claim 10, wherein a position on the display of a virtual cursor corresponding to the motion of the remote device is computed during execution of the second mode and the cursor is unfrozen after the end of the ON state when the distance of said virtual cursor to said frozen cursor is less than a preset value.

13. The interface of claim 1, wherein the motion sensor comprises at least one of a multi-axis accelerometer, a multi-axis gyrometer, a multi-axis magnetometer, a radio-locator and an image sensor.

14. A method of operating a user to machine interface comprising:

acquiring signals from a motion sensor, said signals being at least partially representative of motion of a remote control held by a user,

processing the signals from the motion sensor in one of a first mode and a second mode, at least one of which enables operation of said interface based on motion of the remote control, and

detecting pressing of a trigger button on the remote control by said user to switch between said first mode and said second mode,

said method further comprising determining switching decisions between said first and second modes based on an evaluation of a combination of;

i) a duration δ

_ON indicative of a length of time of an ON state during which the user presses the trigger button in a press and release cycle of the trigger button, and ii) a function Q_motion representative of a quantity of motion imparted to the remote by the user, derived from the motion signals including at least one moment during said ON state.

15. A remote control comprising:

at least a trigger button,

a circuit to establish a communication link with a display,

at least a motion sensor for generating motion signals at least partially representative of motion of the remote control, and

a processor configured to;

process said motion signals in at least one of a first mode and a second mode of operation of said remote, and

switch the operation between said first and second modes, at least one of which enables operation of said remote control based on motion imparted to the remote by a user,

wherein at least a switching decision is based on an evaluation of a combination of i) a duration indicative of a length of time of an ON state during which the user presses the trigger button in a press and release cycle of the trigger button, and ii) a function Q_motion representative of a quantity of motion imparted to the remote by the user, derived from the motion signals including at least one moment during said ON state.