MECHANISM TO PROVIDE VISUAL FEEDBACK REGARDING COMPUTING SYSTEM COMMAND GESTURES

• US 20140013279A1
• Filed: 12/23/2011
• Published: 01/09/2014
• Est. Priority Date: 12/23/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Mongia, Rajiv, Bhowmik, Achintya, Yahiro, Mark, Krieger, Dana, Mangum, Ed, Povieng, Diana
• Granted Patent: US 10,345,911 B2
• Time in Patent Office: Days
• US Class Current: 715/835
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting

Abstract

A mechanism to provide visual feedback regarding computing system command gestures. An embodiment of an apparatus includes a sensing element to sense a presence or movement of a user of the apparatus, a processor, wherein operation of the processor includes interpretation of command gestures of a user to provide input to the apparatus; and a display screen, the apparatus to display one or more icons on the display screen, the one or more icons being related to the operation of the apparatus. The apparatus is to display visual feedback for a user of the apparatus, visual feedback including a representation of one or both bands of the user while the one or both hands are within a sensing area for the sensing element.

Claims

1. An apparatus comprising:

a sensing element to sense a presence or movement of a user of the apparatus;

a processor, wherein operation of the processor includes interpretation of command gestures of a user to provide input to the apparatus; and

a display screen, the apparatus to display one or more icons on the display screen, the one or more icons being related to the operation of the apparatus;

wherein the apparatus is to display visual feedback for a user of the apparatus, visual feedback including a representation of one or both hands of the user while the one or both hands are within a sensing area for the sensing element.

2. The apparatus of claim 1, wherein the representation is to provide an illustration of a position of the hand or hands of the user in relation to one or more symbols on the display screen.

3. The apparatus of claim 1, wherein the representation of the one or both hands of the user includes a representation of the tip of one or more fingers of the hand or hands of the user.

4. The apparatus of claim 3, wherein the representation of the one or both hands of the user includes a trail following the tip of one or more fingers when the hand or hands of the user move in space.

5. The apparatus of claim 3, wherein the representation of the tip of the one or more fingers of the hand or hands of the user has a level of a brightness based on the orientation of the hand or hands in relation to the display screen.

6. The apparatus of claim 3, wherein the representation includes a representation of tips of a thumb and another finger or fingers of a hand to provide for zooming in or out from an image.

7. The apparatus of claim 1, wherein the representation of the hand or hands of the user includes a “

C”

shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are not in contact with each other.

8. The apparatus of claim 7, wherein the “

C”

shape is to surround at least a part of an icon when the first hand of the user is in a position for selecting the icon.

9. The apparatus of claim 1, wherein the representation of the hand or hands of the user includes a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are in contact with each other.

10. The apparatus of claim 9, wherein the representation is a loop or magnifying glass.

11. The apparatus of claim 9, wherein the representation is to surround at least in part of an icon, and the apparatus is to display information connected with an element represented by the icon.

12. The apparatus of claim 11, wherein the representation further includes an indication to choose an option regarding the displayed information connected with the element represented by the icon.

13. An method comprising:

sensing a presence or movement of the user by a sensing element of an apparatus;

determining one or more of a position, a movement, and an orientation of the one or both hands of the user;

displaying visual feedback to the user regarding the hand or hands of the user; and

interpreting one or more command gestures of the user to provide input to the apparatus.

14. The method of claim 13, wherein displaying visual feedback includes providing a representation of the hand or hands of the user in relation to one or more symbols on a display screen.

15. The method of claim 14, wherein the representation of the one or both hands of the user includes a representation of the tip of each finger of the hand or hands of the user.

16. The method of claim 15, wherein the representation of the one or both hands of the user includes a trail following the representation of the tip of each finger of the user as the hand or hands of the user move in space.

17. The method of claim 14, wherein the representation of the hand or hands of the user includes a “

C”

shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more fingers in a curved posture, where the thumb and the one or more other fingers are not in contact with each other.

18. The method of claim 16, wherein representation of the first hand of the including the “

C”

shape surrounding at least a part of an icon when the first hand of the user is in a position for selecting the icon.

19. The method of claim 14, wherein the representation of the hand or hands of the user includes a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where the thumb and the one or more other fingers are in contact with each other.

20. The method of claim 18, wherein the representation is a loop or magnifying glass.

21. The method of claim 19, wherein the representation is to surround at least in part of an icon, and the apparatus is to display information connected with an element represented by the icon.

22. A non-transitory computer-readable storage medium having stored thereon data representing sequences of instructions that, when executed by a processor, cause the processor to perform operations comprising:

sensing a presence or movement of the user by a sensing element of an apparatus;

determining one or more of a position, a movement, and an orientation of the one or both hands of the user;

displaying visual feedback to the user regarding the hand or hands of the user; and

interpreting one or more command gestures of the user to provide input to the apparatus.

23. The medium of claim 22, wherein displaying visual feedback includes providing a representation of the hand or hands of the user in relation to one or more symbols on a display screen.

24. The medium of claim 23, wherein the representation of the one or both hands of the user includes one or more of:

a representation of the tip of each finger of the hand or hands of the user;

a “

C”

shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more other fingers in a curved posture, where the thumb and the one or more other fingers are not in contact with each other;

or

a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where the thumb and the one or more other fingers are in contact with each other.

25. The medium of claim 24, wherein the representation of the one or both hands of the user includes a trail following the representation of the tip of each finger of the user as the hand or hands of the user move in space.

26-30. -30. (canceled)