3D haptics for interactive computer systems

• US 9,916,003 B1
• Filed: 09/02/2016
• Issued: 03/13/2018
• Est. Priority Date: 09/02/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Sinclair, Michael Jack, Ofek, Eyal, Benko, Hrvoje, Holz, Christian
• Primary Examiner(s): HEARD, ERIN FILE
• Application Number:
  US15/255,866
• Publication Number:
  US 20180067543A1
• Time in Patent Office: 557 Days
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Abstract

A controller device for a virtual environment includes a handle and a contact device having a substantially planar surface. A position of the contact device relative to the handle is adjustable. An actuator module is arranged to adjust the position of the contact device relative to the handle. A control module in communication with the virtual environment selectively controls the actuator module to adjust the position of the contact device in response to data received from the virtual environment. The data includes an indication of an interaction between a user and an object represented within the virtual environment.

Claims

1. A controller device for a virtual environment, the controller device comprising:

a handle;

a contact device having a substantially planar surface, wherein a position of the contact device relative to the handle is adjustable;

an actuator module, arranged on a first end of the handle, including a plurality of actuator arms configured to adjust the position of the contact device relative to the handle, wherein the contact device is mounted on the actuator module via the plurality of actuator arms; and

a control module in communication with the virtual environment, wherein the control module selectively controls one or more actuator arms of the plurality of actuator arms of the actuator module to adjust the position of the contact device in response to data received from the virtual environment, wherein the data includes an indication of an interaction between a user and an object represented within the virtual environment.

2. The controller device of claim 1, wherein the contact device includes a platform, and wherein, to adjust the position of the contact device, the actuator module at least one of (i) tilts the platform and (ii) extends and retracts the platform.

3. The controller device of claim 1, wherein, to adjust the position of the contact device, the actuator module adjusts the position of the contact device based on a contact point between the user and the object represented within the virtual environment.

4. The controller device of claim 3, wherein the actuator module adjusts the position of the contact device based on a surface normal to the object at the contact point.

5. The controller device of claim 3, wherein the actuator module adjusts the position of the contact device based on a determination of whether movement of the controller device causes the user to penetrate the object represented within the virtual environment.

6. The controller device of claim 5, wherein the actuator module selectively extends the contact device based on the determination of whether movement of the controller device causes the user to penetrate the object represented within the virtual environment.

7. The controller device of claim 1, wherein the contact device includes at least one of a force sensor, a vibration mechanism, a temperature output device, and a touchpad.

8. The controller device of claim 7, wherein the force sensor comprises a force sensing resistor.

9. The controller device of claim 7, wherein the force sensor generates a signal in response to user contact with the contact device.

10. A method for operating a controller device for a virtual environment, the method comprising:

displaying an object within the virtual environment;

generating data including an indication of interaction between a user and a surface of the object;

providing the data to an actuator of the controller device; and

using the actuator, adjusting a position of a contact device relative to a handle of the controller device based on the data, wherein the contact device has a substantially planar surface, wherein the actuator is arranged on a first end of the handle and include a plurality of actuator arms configured to adjust the position of the contact device relative to the handle, and wherein the contact device is mounted on the actuator module via the plurality of actuator arms,

wherein the position of the contact device is adjusted in response to data received from the virtual environment by selectively controlling one or more actuator arms of the plurality of actuator arms of the actuator.

11. The method of claim 10, wherein adjusting the position of the contact device includes at least one of (i) tilting the contact device and (ii) extending and retracting the contact device.

12. The method of claim 10, wherein adjusting the position of the contact device includes adjusting the position of the contact device based on a contact point between the user and the surface of the object.

13. The method of claim 12, wherein adjusting the position of the contact device includes adjusting the position of the contact device based on a surface normal to the object at the contact point.

14. The method of claim 10, further comprising, using the contact device, generating a signal in response to user contact with the contact device.

15. A controller device for a virtual environment, the controller device comprising:

a handle;

a platform having a substantially planar surface, wherein a position of the platform relative to the handle is adjustable;

an actuator module, arranged on a first end of the handle, including a plurality of actuator arms configured to adjust the position of the platform relative to the handle, wherein the platform is mounted on the actuator module via the plurality of actuator arms; and

a control module in communication with the virtual environment, wherein the control module;

receives data indicative of contact between a user and a surface represented within the virtual environment, wherein the data includes an indication of a surface normal of the surface at a contact point between the user and the surface, and

provides a command to adjust the position of the platform based on the indication of the surface normal,

wherein the actuator module selectively controls one or more actuator arms of the plurality of actuator arms to adjust the position of the platform relative to the handle in response to the command provided by the control module such that a surface normal to the platform in the adjusted position corresponds to the surface normal at the contact point between the user and the surface.

16. The controller device of claim 15, wherein, to adjust the position of the platform, the actuator module at least one of (i) tilts the platform and (ii) extends and retracts the platform.

17. The controller device of claim 15, wherein, to adjust the position of the platform, the actuator module adjusts the position of the platform based on a contact point between the user and the object represented within the virtual environment.

18. The controller device of claim 17, wherein the actuator module adjusts the position of the platform based on a determination of whether movement of the controller device causes the user to penetrate the object represented within the virtual environment.

19. The controller device of claim 18, wherein the actuator module selectively extends the contact device based on the determination of whether movement of the controller device causes the user to penetrate the object represented within the virtual environment.

20. The controller device of claim 15, wherein the platform includes at least one of a force sensor, a vibration mechanism, a temperature output device, and a touchpad.