Networked applications including haptic feedback

• US 8,072,422 B2
• Filed: 12/15/2009
• Issued: 12/06/2011
• Est. Priority Date: 12/01/1995
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rosenberg, Louis B., Brave, Scott B., Tan, Sian W.
• Primary Examiner(s): Liang, Regina
• Application Number:
  US12/638,263
• Publication Number:
  US 20100148943A1
• Time in Patent Office: 721 Days
• Field of Search: 345156-158, 345/161, 273/148.B, 463 30- 32, 463 36- 42, 715/701, 715/702, 709/203, 709/217, 709/227, 709/250
• US Class Current: 345/156
• CPC Class Codes: A63B 24/00 Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
• CPC Class Codes: A63F 11/0051 Indicators of values, e.g. score counters
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/577 using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1025 details of the interface with the game device, e.g. USB version detection
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: B25J 9/1689 Teleoperation
• CPC Class Codes: G05G 2009/04766 providing feel, e.g. indexing means, means to create counterforce
• CPC Class Codes: G05G 2009/04777 with additional push or pull action on the handle
• CPC Class Codes: G05G 9/047 the controlling member being movable by hand about orthogonal axes, e.g. joysticks for switches H01H25/04
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0383 : Signal control means within the pointing device
• CPC Class Codes: H01H 2003/008 : with a haptic or a tactile feedback controlled by electrical means, e.g. a motor or magnetofriction
• CPC Class Codes: H04L 67/131 : Protocols for games, networked simulations or virtual reality

Abstract

Method and apparatus for providing peer-to-peer force feedback over a computer network. A network force feedback system includes a network, a first computer coupled to the network, and a second computer coupled to the network. The first and second computers each include a visual display and a force feedback interface device. Each computer provides a force feedback signal to its force feedback device based on information received from the other, remote computer and in some cases also based on input from the local force feedback device. Positional information of each force feedback device and/or feel sensation information can be transmitted between the computers over the network. A graphical environment can be displayed to enhance the interaction between users. The present invention therefore permits two computer users to interact using force feedback provided over a network on a peer-to-peer basis.

Claims

1. A networked haptic feedback gaming system comprising:

a first computer having a network interface for communicating with a second computer over a network, the first computer configured to;

generate a first image in a first gaming environment on the visual display, the first image based on second information received from a second computer, the second information comprising second force information,

transmit the first image to a first display;

generate a first force feedback signal based at least in part on the second force information received from the second computer;

transmit the first force feedback signal to a first actuator configured to output a first force effect based on the first force feedback signal,

generate first information, the first information comprising first force information,

transmit the first information to the second computer; and

wherein the second computer is configured to;

generate a second image in a second gaming environment on the visual display, the second image based on the first information received from the first computer,

transmit the second image to a second display;

generate a second force feedback signal based at least in part on the first force information received from the first computer; and

transmit the second force feedback signal to a second actuator configured to output a second force effect based on the second force feedback signal.

2. The system of claim 1, wherein the first computer is in communication with a first manipulandum comprising the first actuator configured to output the first haptic effect.

3. The system of claim 2, wherein the first manipulandum comprises a local processor configured to:

receive the first force feedback signal and to generate a first actuator signal based on the first force feedback signal; and

transmit the first actuator signal to the first actuator to cause the first actuator to output the first force effect.

4. The system of claim 1, wherein the first force effect is correlated with the first image.

5. The system of claim 1, wherein the first computer is configured to communicate with the second computer in a peer-to-peer mode.

6. The system of claim 1, wherein the second haptic information comprises mapping information indicating a feel sensation.

7. The system of claim 6, wherein the first computer is further configured to request server force information over the network from a server, receive the server force information, and to generate the first force feedback signal based on the server force information.

8. A method comprising:

sending a first force signal from a first computer to a second computer, the first force signal configured to cause a first force feedback signal to be sent to a second force feedback device from the second computer, wherein the first force feedback signal is configured to cause the second force feedback device to output a first force using an actuator of the second force feedback device;

receiving second information from the second computer, the second information comprising second force information;

generating a second force feedback signal based on the second force information, the second force feedback signal configured to cause the first force feedback device to output a second force using an actuator of the first force feedback device;

transmitting the second force feedback signal to a first force feedback device in communication with the first computer; and

displaying an image based on the second information.

9. The method of claim 8, wherein outputting the second force is correlated with first image.

10. The method of claim 8, wherein the first computer is configured to communicate with the second computer in a peer-to-peer mode.

11. The method of claim 8, wherein the second force information comprises mapping information indicating a feel sensation.

12. The method of claim 11, further comprising

requesting server force information from a server,

receiving the server force information, and

generating the first force feedback signal based on the server haptic information.

13. A memory comprising program code, the program code comprising:

program code for sending a first force signal from a first computer to a second computer, the first force signal configured to cause a first force feedback signal to be sent to a second force feedback device from the second computer, wherein the first force feedback signal is configured to cause the second force feedback device to output a first force using an actuator of the second force feedback device;

program code for receiving second information from the second computer, the second information comprising second force information;

program code for generating a second force feedback signal based on the second force information, the second force feedback signal configured to cause the first force feedback device to output a second force using an actuator of the first force feedback device;

program code for transmitting the second force feedback signal to a first force feedback device in communication with the first computer; and

program code for displaying an image based on the second information.

14. The memory of claim 13, wherein outputting the second force is correlated with first image.

15. The memory of claim 13, wherein the first computer is configured to communicate with the second computer in a peer-to-peer mode.

16. The method of claim 13, wherein the second force information comprises mapping information indicating a feel sensation.

17. The memory of claim 13, further comprising

program code for requesting server force information from a server,

program code for receiving the server force information, and

program code for generating the first force feedback signal based on the server force information.