Mechanism to provide visual feedback regarding computing system command gestures

• US 10,345,911 B2
• Filed: 12/23/2011
• Issued: 07/09/2019
• Est. Priority Date: 12/23/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Mongia, Rajiv, Bhowmik, Achintya, Yahiro, Mark, Krieger, Dana, Mangum, Ed, Povieng, Diana
• Primary Examiner(s): Nguyen, Nhat Huy T
• Application Number:
  US13/997,640
• Publication Number:
  US 20140013279A1
• Time in Patent Office: 2,755 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting

Abstract

A mechanism to provide visual feedback regarding computing system command gestures. An embodiment of an apparatus includes a sensing element to sense a presence or movement of a user of the apparatus, a processor, wherein operation of the processor includes interpretation of command gestures of a user to provide input to the apparatus; and a display screen, the apparatus to display one or more icons on the display screen, the one or more icons being related to the operation of the apparatus. The apparatus is to display visual feedback for a user of the apparatus, visual feedback including a representation of one or both hands of the user while the one or both hands are within a sensing area for the sensing element.

Claims

1. An apparatus comprising:

a sensing element to sense a presence or movement of a user of the apparatus;

a processor, wherein the processor to perform interpretation of user intent relating to the movement of the user, wherein the user movement includes moving of a body part of the user, wherein the body part includes one or more hands of the user, wherein the movement represents a gesture and the interpretation of the user intent to determine a user input intended by the gesture being communicated to the apparatus, the user input seeking a desired result; and

a display screen to display visual feedback of the movement based on the user intent, wherein the visual feedback provides a visual representation of the body part or the movement such that the visual feedback is presented by light points of multiple levels of brightness offering one or more icons representing the one or more hands of the user,

wherein the visual feedback of the one or both hands of the user includes a visual feedback of one or more tips of one or more fingers of the one or more hands of the user, the one or more tips represented by light points changing in levels of brightness based on changes of user intent, and wherein the multiple levels of brightness are based on orientation of the one or more hands in relation to the display screen.

2. The apparatus of claim 1, wherein the visual feedback provides an illustration of a position of the one or more hands of the user in relation to one or more symbols on the display screen.

3. The apparatus of claim 2, wherein the visual feedback of the one or more hands of the user includes a trail following the one or more tips of the one or more fingers when the one or more hands of the user move in space.

4. The apparatus of claim 3, wherein the visual feedback includes a representation of tips of a thumb and another finger or fingers of a hand to provide for zooming in or out from an image.

5. The apparatus of claim 3, wherein the visual feedback of the one or more hands of the user includes a “

C”

shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are not in contact with each other.

6. The apparatus of claim 5, wherein the “

C”

shape is to surround at least a part of an icon when the first hand of the user is in a position for selecting the icon.

7. The apparatus of claim 3, wherein the visual feedback of the one or more hands of the user includes a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are in contact with each other.

8. The apparatus of claim 7, wherein the representation is a loop or magnifying glass.

9. The apparatus of claim 7, wherein the visual feedback is to surround at least in part of an icon, and the apparatus is to display information connected with an element represented by the icon.

10. The apparatus of claim 9, wherein the visual feedback further includes an indication to choose an option regarding the displayed information connected with the element represented by the icon.

11. A method comprising:

sensing a presence or movement of a user of the apparatus;

performing interpretation of user intent relating to the movement of the user,

wherein the user movement includes moving of a body part of the user, wherein the body part includes one or more hands of the user, wherein the movement represents a gesture and the interpretation of the user intent to determine a user input intended by the gesture being communicated to the apparatus, the user input seeking a desired result; and

displaying visual feedback of the movement based on the user intent, wherein the visual feedback provides a visual representation of the body part or the movement such that the visual feedback is presented by light points of multiple levels of brightness offering one or more icons representing the one or more hands of the user,

wherein the visual feedback of the one or both hands of the user includes a visual feedback of one or more tips of one or more fingers of the one or more hands of the user, the one or more tips represented by light points changing in levels of brightness based on changes of user intent, and wherein the multiple levels of brightness are based on orientation of the one or more hands in relation to the display screen.

12. The method of claim 11, wherein the visual feedback provides an illustration of a position of the one or more hands of the user in relation to one or more symbols on the display screen.

13. The method of claim 12, wherein the visual feedback of the one or more hands of the user includes a trail following the one or more tips of the one or more fingers when the one or more hands of the user move in space.

14. The method of claim 13, wherein the visual feedback includes a representation of tips of a thumb and another finger or fingers of a hand to provide for zooming in or out from an image.

15. The method of claim 13, wherein the visual feedback of the one or more hands of the user includes a “

C”

shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are not in contact with each other.

16. The method of claim 15, wherein the “

C”

shape is to surround at least a part of an icon when the first hand of the user is in a position for selecting the icon.

17. The method of claim 13, wherein the visual feedback of the one or more hands of the user includes a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are in contact with each other.

18. The method of claim 17, wherein the representation is a loop or magnifying glass.

19. The method of claim 17, wherein the visual feedback is to surround at least in part of an icon, and the apparatus is to display information connected with an element represented by the icon.

20. The method of claim 19, wherein the visual feedback further includes an indication to choose an option regarding the displayed information connected with the element represented by the icon.

21. A non-transitory computer-readable storage medium having stored thereon data representing sequences of instructions that, when executed by a processor, cause the processor to perform operations comprising:

sensing a presence or movement of a user of the apparatus;

performing interpretation of user intent relating to the movement of the user,

wherein the user movement includes moving of a body part of the user, wherein the body part includes one or more hands of the user, wherein the movement represents a gesture and the interpretation of the user intent to determine a user input intended by the gesture being communicated to the apparatus, the user input seeking a desired result; and

displaying visual feedback of the movement based on the user intent, wherein the visual feedback provides a visual representation of the body part or the movement such that the visual feedback is presented by light points of multiple levels of brightness offering one or more icons representing the one or more hands of the user,

wherein the visual feedback of the one or both hands of the user includes a visual feedback of one or more tips of one or more fingers of the one or more hands of the user, the one or more tips represented by light points changing in levels of brightness based on changes of user intent, and wherein the multiple levels of brightness are based on orientation of the one or more hands in relation to the display screen.

22. The non-transitory computer-readable storage medium of claim 21, wherein the visual feedback provides an illustration of a position of the one or more hands of the user in relation to one or more symbols on the display screen.

23. The non-transitory computer-readable storage medium of claim 22, wherein the visual feedback of the one or more hands of the user includes a trail following the one or more tips of the one or more fingers when the one or more hands of the user move in space.

24. The non-transitory computer-readable storage medium of claim 23, wherein the visual feedback includes a representation of tips of a thumb and another finger or fingers of a hand to provide for zooming in or out from an image.

25. The non-transitory computer-readable storage medium of claim 23, wherein the visual feedback of the one or more hands of the user includes a “

C”

shape representing a gesture of a first hand of the user including a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are not in contact with each other.

26. The non-transitory computer-readable storage medium of claim 25, wherein the “

C”

shape is to surround at least a part of an icon when the first hand of the user is in a position for selecting the icon.

27. The non-transitory computer-readable storage medium of claim 23, wherein the visual feedback of the one or more hands of the user includes a shape representing a loop gesture of a first hand of the user to obtain information, wherein the loop gesture includes a thumb in a curved posture and one or more other fingers in a curved posture, where tips of the thumb and the one or more other fingers are in contact with each other.

28. The non-transitory computer-readable storage medium of claim 27, wherein the representation is a loop or magnifying glass.

29. The non-transitory computer-readable storage medium of claim 27, wherein the visual feedback is to surround at least in part of an icon, and the apparatus is to display information connected with an element represented by the icon.

30. The non-transitory computer-readable storage medium of claim 29, wherein the visual feedback further includes an indication to choose an option regarding the displayed information connected with the element represented by the icon.