Force feedback applications based on cursor engagement with graphical targets

• US 7,131,073 B2
• Filed: 11/13/2001
• Issued: 10/31/2006
• Est. Priority Date: 12/13/1995
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Chang, Dean C.
• Primary Examiner(s): CHANG, KENT WU
• Application Number:
  US09/992,123
• Publication Number:
  US 20020050978A1
• Time in Patent Office: 1,813 Days
• Field of Search: 345/856, 345/860, 345/862, 345/801, 345/802, 345/156, 345/157, 345/161, 345/163
• US Class Current: 715/856
• CPC Class Codes: A63F 2300/1025 details of the interface with the game device, e.g. USB version detection
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: G05G 2009/0477 holding the member in a number of definite positions
• CPC Class Codes: G05G 9/047 the controlling member being movable by hand about orthogonal axes, e.g. joysticks for switches H01H25/04
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/03548 Sliders, in which the moving part moves in a plane
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H01H 2003/008 with a haptic or a tactile feedback controlled by electrical means, e.g. a motor or magnetofriction
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A method and apparatus for providing a click surface in a graphical environment, such as a graphical user interface, implemented on a host computer for use with a force feedback interface device. A displayed cursor is controlled by a user-moveable user object, such as a mouse, of the interface device. A click surface is displayed with an associated graphical object, such as a graphical button or an edge of a window, icon, or other object. When the click surface is contacted by the cursor, a force is output opposing movement of the user object in a direction into the click surface and into the graphical object. When the user object has moved to or past a trigger position past the contact with the click surface, a command gesture signal is provided to the host computer indicating that the graphical object has been selected as if a physical input device on the user object, such as a button, has been activated by the user. Preferably, the host computer displays the graphical environment including the click surface and cursor, while a microprocessor local to the interface device controls the force output of the click surface in parallel with the host display.

Claims

1. A method comprising:

updating a display of a cursor within a graphical user interface using sensor information received from an interface device, the sensor information representing motion of at least a portion of the interface device;

detecting a speed of the cursor when the cursor engages the graphical target; and

outputting a tactile sensation based upon the speed of the cursor when the cursor engages the graphical target.

2. The method of claim 1 wherein the outputting a tactile sensation occurs only if the detected speed of engagement is below a predetermined threshold speed, a tactile sensation will be output to the user.

3. The method of claim 2 wherein the detected speed is compared with a plurality of threshold speeds, the plurality of threshold speeds being associated with a plurality of tactile sensations, the output tactile sensation being from the plurality of tactile sensations.

4. The method of claim 1 wherein the detecting further includes determining when the cursor has moved to or past a trigger location positioned in the graphical target.

5. The method of claim 4 further comprising selecting a function within the graphical user interface when the cursor has moved to or past the trigger location.

6. The method of claim 5 wherein the selecting only is performed when the speed of the cursor is below a predetermined threshold speed.

7. The method of claim 1 wherein the graphical target is a menu element displayed in the graphical environment.

8. The method of claim 1 wherein the graphical target is a graphical button.

9. The method of claim 1 further comprising changing at least one displayed characteristic of the graphical target to indicate that the function has been selected.

10. The method of claim 1 wherein the tactile sensation includes a force on the interface device.

11. The method of claim 1 wherein the tactile sensation includes one or more of a vibration, a texture, and a jolt.

12. A method comprising:

displaying a cursor within a graphical user interface using sensor information received from an interface device, the sensor information being associated with motion of at least a portion of the interface device;

outputting a tactile feedback command to be provided to the interface device to cause a tactile sensation when the cursor engages the graphical target;

detecting whether the cursor has moved to or past a trigger location in the graphical target;

selecting a function within a graphical user interface when the cursor has moved to or past the trigger location; and

modifying the tactile sensation, the modifying being associated with the selecting of the function.

13. The method of claim 12 wherein the cursor is determined to have moved to the trigger location when the cursor has moved a predetermined distance past a point of engagement.

14. The method of claim 12 wherein the graphical target is modified visually when the cursor reaches the trigger location.

15. The method of claim 12 wherein the graphical target is a menu element displayed in the graphical user interface.

16. The method of claim 12 wherein the graphical target is a graphical button displayed in the graphical user interface.

17. The method of claim 12 further comprising:

changing at least one displayed characteristic of the graphical target to indicate that the function has been selected.

18. The method of claim 12 wherein the output tactile sensation includes a force on the interface device.

19. The method of claim 12 wherein the output tactile sensation includes at least one of a vibration, a texture, and a jolt.

20. The method of claim 12, wherein the graphical target is a static selection surface, the cursor being displayed at an original position of engagement while the at least a portion of the interface device moves in a direction corresponding to a direction into the graphical target.

21. A program storage device readable by a machine, said device embodying a program of instructions executable by the machine to perform a method comprising:

updating a display of a cursor within a graphical user interface using sensor information received from an interface device, the sensor information being associated with motion of at least a portion of the interface device;

outputting a tactile sensation when the cursor engages the graphical target;

detecting whether the cursor has moved to or past a trigger location in the graphical target;

selecting a function within the graphical user interface when the cursor has moved to or past the trigger location; and

modifying the tactile sensation in response to the function being selected.