INFORMATION HANDLING SYSTEM ENHANCED GESTURE MANAGEMENT, CONTROL AND DETECTION

• US 20190265801A1
• Filed: 02/28/2018
• Published: 08/29/2019
• Est. Priority Date: 02/28/2018
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Yildiz, Yagiz C., Bryan, Rex W., Aurongzeb, Deeder M.
• Granted Patent: US 10,459,528 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Gesture inputs at an information handling system adapt to manage end user resolution constraints by selectively assigning a physical input device to accept fractional inputs of the gesture type. For example, an end user maintains a gesture for a predetermined time to command a totem device to adapt from a first type of input, such as scrolling, to the gesture input so that the end user may more precisely manage the desired gesture input through the totem. Upon movement from the gesture, the physical input device reverts from the gesture input to the first type of input.

Claims

1. An information handling system comprising:

a processor operable to execute instructions that process information;

a memory interfaced with the processor and operable to store the instructions and information;

a display interfaced with the processor and operable to present the information as visual images;

one or more sensors interfaced with the processor and display, the one or more sensors operable to detect movement of an end user proximate to the display;

a rotating input device interfaced with the processor and operable to accept end user inputs as rotational movement; and

a gesture engine interfaced with the one or more sensors and the rotating input device, the gesture engine operable to detect an end user motion defined as a gesture and, in response to the gesture, to re-assign inputs at the rotating input device from a first type to instead adjust an input associated with the gesture;

wherein the gesture engine is further operable to;

monitor the end user to detect maintenance of the gesture for a period of time;

assign inputs at the rotating input device as associated with the gesture during the period of time; and

re-assign inputs to the first type at the end of the period of time upon detecting the end user has stopped maintaining the gesture.

3. The information handling system of claim 1 wherein the rotating device input associated with the gesture changes the scale associated with the gesture movement.

4. The information handling system of claim 1 wherein the rotating device input associated with the gesture comprises a reduced scale input of the same type as the gesture input.

5. The information handling system of claim 4 wherein the gesture comprises a finger pinch that commands a change in zoom of a visual image presented at the display from a first zoom level to a second zoom level and the rotational device inputs comprise a change in zoom having a fractional gradient of change in zoom of the gesture.

6. The information handling system of claim 4 wherein the display comprises a horizontally disposed touchscreen display, the rotational input device comprises a totem disposed on the touchscreen device to perform inputs as touches at the touchscreen display, and the gesture comprises a multi-finger touch at the touchscreen display.

7. The information handling system of claim 4 wherein the display comprises a head mounted display, the one or more sensors comprise a depth camera and the gesture comprises a hand motion at a virtual object presented by the head mounted display.

8. The information handling system of claim 7 wherein the gesture further comprises a rotational movement indicating rotation of the virtual object about an axis, the rotating input device communicates a rotational input through a wireless interface, and the rotational input indicates fractional rotational movement of the virtual object about the axis.

9. The information handling system of claim 1 wherein the rotating input device first type of input is a scroll of information presented at the display.

2. (canceled)

10. A method for managing gesture inputs to an information handling system, the method comprising:

detecting a gesture input with one or more sensors of the information handling system;

adapting a visual image presented at a display of the information handling system according to the gesture;

detecting maintenance of the gesture input with the one or more sensors;

in response to the detecting maintenance of the gesture input, re-assigning an input device from a first type of input to a second type of input, the second type of input associated with the gesture and the adapting the visual image;

applying inputs at the input device to adapt the visual image according to a predetermined scale of the gesture;

detecting removal of the maintenance of the gesture input with the one or more sensors; and

in response to detecting removal, re-assigning the input device from the input associated with the gesture to the first type of input.

12. The method of claim 10 wherein:

the input device comprises a rotational device that determines inputs from a relative rotational position; and

the first type of input comprises scrolling content presented at the display.

13. The method of claim 10 wherein:

the display comprises a touchscreen display;

the gesture input comprises a pinching movement with two fingers at the touchscreen display to change the visual image zoom;

detecting maintenance comprises holding the two fingers in place on the touchscreen display; and

applying inputs at the input device further comprises detecting rotation of a totem input device at the touchscreen display, the rotation applied to zoom the visual image a fractional amount of the zoom associated with the gesture.

14. The method of claim 10 wherein:

the display comprises a head mounted display that presents the visual image as a virtual object at a location;

the gesture input comprises a hand movement at the location that rotates the visual image;

detecting maintenance comprises the hand held at the location; and

applying inputs comprises detecting rotation of the input device, the rotation applied to rotate the virtual object a fractional amount of the rotation associated with the gesture.

15. The method of claim 10 wherein the applying inputs at the input device to adapt the visual image according to a predetermined scale of the gesture further comprises:

applying the inputs at the input device to change the scale of gestures by a predetermined amount.

16. The method of claim 10 wherein the applying inputs at the input device to adapt the visual image according to a predetermined scale of the gesture further comprises:

applying the inputs at the input device to change the visual image according to the gesture input.

11. (canceled)

17. A system for managing gesture inputs to an information handling system, the system comprising:

a display configured to present visual information;

one or more sensors configured to detect gestures as inputs that adjust the visual information;

a physical input device configured to accept end user inputs and apply the inputs as a first type; and

non-transient memory storing instructions that when executed on a processor;

detect a gesture maintained for a predetermined time;

in response to the maintained gesture, re-assign inputs at the physical input device from the first type to inputs associate with the gesture;

detect removal of the maintained gesture; and

in response to the detect removal of the maintained gesture, re-assign inputs at the physical input device to the first type.

18. The system of claim 17 wherein the re-assigned inputs adjust the visual information at a fraction of a gesture input.

19. The system of claim 17 wherein the re-assigned inputs calibrate the visual image adjusting by the gestures.

20. The system of claim 17 wherein the display comprises a touchscreen display, the physical input device comprises a totem that translates touches to the touchscreen display in response to end user movement, the gesture comprises a zoom of the visual image, and the totem inputs provide a fractional zoom input.