Mechanism to provide visual feedback regarding computing system command gestures

• US 10,324,535 B2
• Filed: 11/30/2015
• Issued: 06/18/2019
• Est. Priority Date: 12/23/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Mongia, Rajiv, Bhowmik, Achintya K., Yahiro, Mark H., Krieger, Dana, Magnum, Ed, Povieng, Diana
• Primary Examiner(s): Yu, Lihong
• Application Number:
  US14/954,858
• Publication Number:
  US 20160091982A1
• Time in Patent Office: 1,296 Days
• Field of Search: 375340
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting

Abstract

A mechanism to provide visual feedback regarding computing system command gestures. An embodiment of an apparatus includes a sensing element to sense a presence or movement of a user of the apparatus, a processor, wherein operation of the processor includes interpretation of command gestures of a user to provide input to the apparatus; and a display screen, the apparatus to display one or more icons on the display screen, the one or more icons being related to the operation of the apparatus. The apparatus is to display visual feedback for a user of the apparatus, visual feedback including a representation of one or both hands of the user while the one or both hands are within a sensing area for the sensing element.

Claims

1. A computing device capable of being used in processing of movement-related data, the computing device comprising:

a user interface;

one or more sensors;

a processor; and

storage capable of storing instructions to be executed by the processor, the instructions when executed by the processor being capable of resulting in performance of operations comprising;

detection, via at least one of the one or more sensors, of a movement of a body part of a user;

determination of user intent relating to the movement of the body part, wherein the body part includes one or more hands of the user; and

presentation, via the user interface, of visual feedback of the movement on a display screen, wherein the visual feedback provides a visual representation of the body part or the movement, wherein the visual representation is presented by lights of various brightness levels, wherein a first brightness level of the visual representation represents a first orientation of the body part relative to the display screen and a second brightness level of the visual representation represents a second orientation of the body part relative to the display screen.

2. The computing device of claim 1, wherein the visual feedback of the movement is based on the user intent.

3. The computing device of claim 1, wherein the operations comprise generation, via the lights, of an outline of the body part, wherein the various brightness levels represent the movement of the body part.

4. The computing device of claim 3, wherein the lights to highlight one or more portions of the body part, wherein the one or more portions include one or more finger tips of one or more fingers of the one or more hands.

5. The computing device of claim 1, wherein the visual feedback corresponds to a gesture of a plurality of gestures, wherein the user intent is determined based on the gesture or the movement.

6. The computing device of claim 5, wherein the gesture comprises a command gesture capable of being interpreted to provide an input, via the user interface, to the computing device.

7. A method comprising:

detecting, via at least one of one or more sensors of a computing device, a movement of a body part of a user;

determining user intent relating to the movement of the body part, wherein the body part includes one or more hands of the user; and

presenting, via a user interface, visual feedback of the movement on a display screen, wherein the visual feedback provides a visual representation of the body part or the movement, wherein the visual representation is presented by lights of various brightness levels, wherein a first brightness level of the visual representation represents a first orientation of the body part relative to the display screen and a second brightness level of the visual representation represents a second orientation of the body part relative to the display screen.

8. The method of claim 7, wherein the visual feedback of the movement is based on the user intent.

9. The method of claim 7, further comprising generating, via the lights, of an outline of the body part, wherein the various brightness levels represent the movement of the body part.

10. The method of claim 9, wherein the lights to highlight one or more portions of the body part, wherein the one or more portions include one or more finger tips of one or more fingers of the one or more hands.

11. The method of claim 7, wherein the visual feedback corresponds to a gesture of a plurality of gestures, wherein the user intent is determined based on the gesture or the movement.

12. The method of claim 11, wherein the gesture comprises a command gesture capable of being interpreted to provide an input, via the user interface, to the computing device.

13. At least one non-transitory machine-readable storage medium capable of storing instructions which, when executed by a computing device, cause the computing device to:

detect, via at least one of one or more sensors, a movement of a body part of a user;

determine user intent relating to the movement of the body part, wherein the body part includes one or more hands of the user; and

present, via a user interface, visual feedback of the movement on a display screen, wherein the visual feedback provides a visual representation of the body part or the movement, wherein the visual representation is presented by lights of various brightness levels, wherein a first brightness level of the visual representation represents a first orientation of the body part relative to the display screen and a second brightness level of the visual representation represents a second orientation of the body part relative to the display screen.

14. The non-transitory machine-readable storage medium of claim 13, wherein the visual feedback of the movement is based on the user intent.

15. The nor-transitory machine-readable storage medium of claim 13, wherein the computing device to generate, via the lights, of an outline of the body part, wherein the various brightness levels represent the movement of the body part.

16. The non-transitory machine-readable storage medium of claim 15, wherein the lights to highlight one or more portions of the body part, wherein the one or more portions include one or more finger tips of one or more fingers of the one or more hands.

17. The non-transitory machine-readable storage medium of claim 13, wherein the visual feedback corresponds to a gesture of a plurality of gestures, wherein the user intent is determined based on the gesture or the movement.

18. The non-transitory machine-readable storage medium of claim 17, wherein the gesture comprises a command gesture capable of being interpreted to provide an input, via the user interface, to the computing device.