Defining force sensations associated with graphical images

• US 8,838,671 B2
• Filed: 03/05/2002
• Issued: 09/16/2014
• Est. Priority Date: 12/13/1995
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Wies, Evan F., Chang, Dean C., Rosenberg, Louis B., Tan, Sian W., Mallett, Jeffrey R.
• Primary Examiner(s): BIAGINI, CHRISTOPHER D
• Application Number:
  US10/092,158
• Publication Number:
  US 20020138562A1
• Time in Patent Office: 4,578 Days
• Field of Search: 709/203, 709217-219, 345/701
• US Class Current: 709/203
• CPC Class Codes: A63F 2300/1025 details of the interface with the game device, e.g. USB version detection
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: G05B 19/00 Programme-control systems
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/0333 Ergonomic shaped mouse for one hand
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/03548 Sliders, in which the moving part moves in a plane
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

Force feedback is provided to a user of a client computer receiving information such as a web page over a network such as the World Wide Web from a server machine. The client machine has a force feedback interface device through which the user experiences physical force feedback. The web page may include force feedback information to provide authored force effects. Force feedback is correlated to web page objects by a force feedback program running on the client and based on input information from the interface device, the web page objects, and the force feedback information. Generic force effects can also be provided, which are applied uniformly at the client machine to all web page objects of a particular type as defined by user preferences at the client machine. A web page authoring interface is also described that includes the ability to add force sensations to a web page. The user may assign force effects to web page objects and immediately feel how the web page will feel to an end user. A web page is output by the interface, including force information to provide the force effects at a client. The authoring tool can include or access a force design interface for creating or modifying force effects.

Claims

1. A method comprising:

receiving, by an electronic device, a web page, the web page comprising a web page object corresponding to an embedded feel sensation and a second feel sensation, the embedded feel sensation referenced by markup associated with the web page;

receiving, by the electronic device, a location of a cursor based on information received from an input device;

determining whether the location of the cursor corresponds to the web page object;

in response to determining that the location of the cursor corresponds to the web page object, generating, by the electronic device, a force feedback signal configured to cause the second feel sensation rather than the embedded feel sensation based at least in part on a determination that the second feel sensation overrides the embedded feel sensation; and

outputting the force feedback signal to the input device.

2. The method of claim 1, wherein the web page is received through a network, wherein the network comprises the Internet.

3. The method of claim 1, wherein the location of the cursor comprises a first location and wherein determining whether the location of the cursor corresponds to the web page object comprises:

determining a second location corresponding to the web page object;

determining whether the first location corresponds to the second location; and

in response to determining that the first location corresponds to the second location, determining that the location corresponds to the web page object.

4. The method of claim 1, wherein the input device comprises a simulation device comprising a processor.

5. The method of claim 1, wherein determining whether the location of the cursor corresponds to the web page object comprises:

determining a region of the web page corresponding with the web page object;

determining whether the location of the cursor corresponds to a portion of the region of the web page; and

in response to determining that the location of the cursor corresponds to the portion of the region, determining that the location of the cursor corresponds to the web page object.

6. The method of claim 1, wherein determining whether the location of the cursor corresponds to the web page object comprises:

determining a region of the web page corresponding with the web page object;

receiving an input signal from the input device, the input signal corresponding to a button on the input device being depressed;

determining whether the input signal is received while the location of the cursor corresponds to a portion of the region of the web page; and

in response to determining that the input signal is received while the location of the cursor corresponds to the portion of the region of the web page, determining that the location of the cursor corresponds to the web page object.

7. The method of claim 1, further comprising:

extracting, by the electronic device, the embedded feel sensation referenced by the markup.

8. The method of claim 1, wherein the embedded feel sensation comprises an authored force effect and the second feel sensation comprises a generic force effect.

9. The method of claim 1, wherein the embedded feel sensation comprises a generic force effect and the second feel sensation comprises an authored force effect.

10. The method of claim 1, further comprising generating a force feedback effect associated with the second feel sensation.

11. The method of claim 1, further comprising:

receiving the force feedback signal; and

generating a force feedback effect.

12. The method of claim 1, wherein the markup references a java applet or an ActiveX control comprising the embedded feel sensation.

13. A non-transitory computer-readable medium storing instructions to cause a processor to:

receive a web page, the web page comprising a web page object corresponding to an embedded feel sensation and a second feel sensation, the embedded feel sensation referenced by markup associated with the web page;

receive a location of a cursor based on information received from an input device;

determine whether the location of the cursor corresponds to the web page object;

in response to determining that the location of the cursor corresponds to the web page object, generate a force feedback signal configured to cause the embedded feel sensation rather than the second feel sensation based at least in part on a determination that the embedded feel sensation overrides the second feel sensation; and

output the force feedback signal to the input device.

14. The non-transitory computer-readable medium of claim 13, wherein determine whether the location of the cursor corresponds to the web page object comprises:

determine a region of the web page corresponding with the web page object;

receive an input signal from the input device, the input signal corresponding to a button on the input device being depressed;

determine whether the input signal is received while the location of the cursor corresponds to a portion of the region of the web page; and

in response to determining that the input signal is received while the location of the cursor corresponds to the portion of the region of the web page, determine that the location of the cursor corresponds to the web page object.

15. The non-transitory computer-readable medium of claim 13, further comprising instructions to cause the processor to:

extract the embedded feel sensation referenced by the markup.

16. The non-transitory computer-readable medium of claim 13, wherein the second feel sensation comprises an authored force effect.

17. The non-transitory computer-readable medium of claim 13, wherein the second feel sensation comprises a generic force effect.

18. The non-transitory computer-readable medium of claim 13, wherein:

the embedded feel sensation comprises an authored force effect and the second feel sensation comprises a generic force effect;

or

the embedded feel sensation comprises a generic force effect and the second feel sensation comprises an authored force effect.

19. The non-transitory computer-readable medium of claim 13, further comprising instructions to cause the processor to:

receive the force feedback signal; and

generate a force feedback effect.

20. The non-transitory computer-readable medium of claim 13, wherein the markup references a java applet or an ActiveX control comprising the embedded feel sensation.