Handles interactions for human—computer interface

• US 8,499,257 B2
• Filed: 02/09/2010
• Issued: 07/30/2013
• Est. Priority Date: 02/09/2010
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mattingly, Andrew, Hill, Jeremy, Dayal, Arjun, Kramp, Brian, Vassigh, Ali, Klein, Christian, Poulos, Adam, Kipman, Alex, Margolis, Jeffrey
• Primary Examiner(s): HO, RUAY L
• Application Number:
  US12/703,115
• Publication Number:
  US 20110197161A1
• Time in Patent Office: 1,267 Days
• Field of Search: 715200-277, 715700-867, 700701-866, 709201-229, 705 50- 79, 345 30-111, 345/633, 345/158, 348206-2319, 707200-206, 725/28, 725/37
• US Class Current: 715/810
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

A system is disclosed for providing on-screen graphical handles to control interaction between a user and on-screen objects. A handle defines what actions a user may perform on the object, such as for example scrolling through a textual or graphical navigation menu. Affordances are provided to guide the user through the process of interacting with a handle.

Claims

1. In a system comprising a computing environment coupled to a capture device for capturing user position and providing a human-computer interface, the system further comprising a display displaying a graphical image, a method of facilitating user interaction with an area of the graphical image for the human-computer interface, comprising:

(a) generating a handle tied to the area of the graphical image;

(b) detecting, via a camera sensing user movement, engagement by the user with the handle generated in said step (a), said step (b) facilitated by simulating an attractive force around the handle pulling a cursor to the handle, engagement detected upon the cursor being pulled to the handle;

(c) receiving an indication of gesture by the user; and

(d) performing an action on the area of the graphical image in response to said step (c).

2. The method of claim 1, said step (a) comprising the step of displaying the handle on the area of the graphical image.

3. The method of claim 1, said step (a) comprising the step of displaying the handle adjacent the area of the graphical image.

4. The method of claim 1, said step (a) comprising the step of integrating the handle into an object which is part of the area of the graphical image so that no separate handle is displayed apart from the object.

5. The method of claim 1, said step (a) comprising the step of displaying the handle as a circular graphical object of two or three dimensions.

6. The method of claim 1, said step (a) comprising the step of displaying the handle as a graphical object and further comprising the step (e) of changing an appearance of the handle on the display from said step (a) to said step (b) and from said step (b) to said step (c).

7. The method of claim 1, said step (a) of generating a handle associated with the area of the user interface comprising the step of associating a handle to the area based on an action to be performed on the area upon detection of a gesture performed by a user while engaging the handle.

8. The method of claim 1, further comprising the step (f) of displaying affordances associated with the handle indicating how a user may interact with the handle generated in said step (a).

9. In a computer system having a computing environment coupled to a capture device for capturing user position and coupled to a display, a human-computer interface comprising:

an action area on the display, the action area capable of at least one of performing an action and having an action performed on it;

a handle displayed on the display and associated with the action area, the handle providing an explicit engagement point with an action area and defining how a user may interact with the action area

an attractive force simulated around the handle for pulling the cursor into engagement with the handle when the cursor is positioned a predetermined distance away from the handle; and

rails displayed on the display associated with the handle for defining how a user may manipulate the handle.

10. The human-computer interface of claim 9, wherein the action area is a navigation menu and the handle defines navigation paths through the navigation menu.

11. The human-computer interface of claim 10, wherein the navigation menu is a textual menu.

12. The human-computer interface of claim 10, wherein the navigation menu is a graphical menu.

13. The human-computer interface of claim 9, wherein a simulated force is generated around the handle to make engagement with the handle by a user easier to establish.