Computing system utilizing coordinated two-hand command gestures

• US 9,684,379 B2
• Filed: 12/23/2011
• Issued: 06/20/2017
• Est. Priority Date: 12/23/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Bhowmik, Achintya, Yahiro, Mark, Krieger, Dana, Mangum, Ed, Povieng, Diana, Mongia, Rajiv
• Primary Examiner(s): Lu, Hua
• Application Number:
  US13/997,634
• Publication Number:
  US 20140208275A1
• Time in Patent Office: 2,006 Days
• Field of Search: None
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

A computing system utilizing coordinated two-hand command gestures. An embodiment of an apparatus includes a sensing element to sense a presence or movement of a user of the apparatus, including the sensing of command gestures by the user to provide input to the apparatus, a processor, wherein operation of the processor includes interpretation of the command gestures of the user and the implementation of actions in response to the command gestures, and a display screen to display elements to the user, where the display screen may display one or more elements use in command gestures, where command gestures include coordinated two-hand command gestures of the user.

Claims

1. An apparatus comprising:

a sensing element to sense a presence and movement of a user of the apparatus performed within a sensing range of the apparatus, the sensing element including a camera to detect command gestures of the user, the sensing range being a range within which the camera can view the user, the sensing element to detect a command gesture by the user performed through space within the sensing range to provide input to the apparatus, wherein detecting a command gesture includes the sensing element to sense position and movement of a first hand and a second hand of the user within the sensing range of the apparatus;

a processor, wherein operation of the processor includes interpretation of the command gesture of the user within the sensing range and the implementation of actions in response to the command gesture; and

a display screen to display elements to the user, wherein the display screen may display one or more elements as objects for operation by command gestures;

wherein the command gesture is a coordinated two-hand command gesture of the user performed by the first hand and the second hand of the user within the sensing range;

wherein, for the two-hand command gesture, the first hand performs a first gesture within the sensing range to indicate a first operation to place and maintain the apparatus in a first state, the first state including maintaining a display of a plurality of objects on the display screen, and the second hand performs a second gesture within the sensing range to indicate a second coordinated operation, the second operation to operate on one or more of the plurality of objects on the display screen.

2. The apparatus of claim 1, wherein the first gesture to place and maintain the apparatus in the first state includes a gesture of the first hand of the user within the sensing range to provide for pinning the plurality of objects displayed on the display screen in a current location.

3. The apparatus of claim 2, wherein the first gesture of the first hand for the first operation pinning the plurality of objects displayed on the display screen includes a gesture within the sensing range with a thumb and index finger of the first hand in an open position.

4. The apparatus of claim 2, wherein the second operation is a selection of a first object of the plurality of objects displayed on the display screen based on the second gesture of the second hand within the sensing range.

5. The apparatus of claim 1, wherein the second operation is a detailed entry in the current position of the plurality of objects displayed on the display screen using the second gesture of the second hand of the user within the sensing range.

6. The apparatus of claim 1, wherein the first state includes a switch to a different view on the display screen.

7. The apparatus of claim 6, wherein the second operation is a selection of a first object of the plurality of objects in the different view based on the second gesture of the second hand in the sensing range.

8. The apparatus of claim 6, wherein the first gesture of the first hand within the sensing range includes a change of a position of one or more fingers of the first hand from an extended position to a bent position.

9. The apparatus of claim 1, wherein the first state includes a search of a first object of the plurality of objects selected by the first gesture of the first hand of the user within the sensing range.

10. The apparatus of claim 9, wherein the second operation is a selection of a search choice provided by the apparatus.

11. The apparatus of claim 9, wherein the first gesture of the first hand within the sensing range includes formation of a loop with the thumb and one or more of the other fingers of the first hand.

12. The apparatus of claim 1, wherein the camera is one of a time of flight camera or a patterned light camera.

13. The apparatus of claim 1, wherein the sensing range includes space within a virtual boundary of the apparatus.

14. A method comprising:

displaying one or more elements as objects for operation by command gestures of a user for a computing system;

detecting by a sensing element a command gesture of the user performed through space within a sensing range for the computing system, the sensing element including a camera to detect command gestures of the user, the sensing range being a range within which the camera can view the user, wherein detecting a command gesture includes the sensing element to sense position and movement of a first hand and a second hand of the user within the sensing range of the computing system; and

interpreting the command gesture and implementing action in response to the command gesture;

wherein the command gesture is a coordinated two-hand gesture of the user performed by the first hand and the second hand of the user within the sensing range;

wherein, for a two-hand gesture, the first hand provides a first gesture within the sensing range to indicate a first operation to place and maintain the computing system in a first state, the first state including maintaining a display of a plurality of objects on the display screen, and the second hand provides a second gesture within the sensing range to indicate a second coordinated operation in the first state, the second operation to operate on one or more of the plurality of objects on the display screen.

15. The method of claim 14, wherein the first gesture by the first hand to place and maintain the computing system in the first state is a gesture of the first hand of the user within the sensing range to provide for pinning the plurality of objects displayed on the display screen in a current location.

16. The method of claim 14, wherein the first gesture by the first hand of the user within the sensing range is a gesture to switch to a different view on the display screen.

17. The method of claim 14, wherein the first gesture by the first hand of user within the sensing range is a search of a first object of the plurality of objects selected by the first gesture of the first hand of the user.

18. A non-transitory computer-readable storage medium having stored thereon data representing sequences of instructions that, when executed by a processor, cause the processor to perform operations comprising:

displaying one or more elements as objects for operation by command gestures of a user for a computing system;

detecting by a sensing element a command gesture of the user performed through space within a sensing range for the computing system, the sensing element including a camera to detect command gestures of the user, the sensing range being a range within which the camera can view the user, wherein detecting a command gesture includes the sensing element to sense position and movement of a first hand and a second hand of the user within the sensing range of the computing system; and

interpreting the command gesture and implementing action in response to the command gesture;

wherein the command gesture is a coordinated two-hand gesture of the user performed by the first hand and the second hand of the user within the sensing range;

wherein, for a two-hand gesture, the first hand provides a first gesture within the sensing range to indicate a first operation to place and maintain the computing system in a first state, the first state including maintaining a display of a plurality of objects on the display screen, and the second hand provides a second gesture within the sensing range to indicate a second coordinated operation in the first state, the second operation to operate on one or more of the plurality of objects on the display screen.

19. The medium of claim 18, wherein the first gesture by the first hand to place and maintain the computing system in the first state is a gesture of the first hand of the user within the sensing range to provide for pinning the plurality of objects displayed on the display screen in a current location.

20. The medium of claim 18, wherein the first gesture by the first hand of the user within the sensing range is a gesture to switch to a different view on the display screen.

21. The medium of claim 18, wherein the first gesture by the first hand of user within the sensing range is a search of a first object of the plurality of objects selected by the first gesture of the first hand of the user.