SYSTEM AND METHOD FOR OUTPUTTING A HAPTIC EFFECT BASED ON A CAMERA ZOOM STATE, CAMERA PERSPECTIVE, AND/OR A DIRECTION IN WHICH A USER'S EYES ARE DIRECTED

• US 20170173457A1
• Filed: 03/06/2017
• Published: 06/22/2017
• Est. Priority Date: 06/09/2014
• Status: Abandoned Application

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rihn, William
• Application Number:
  US15/450,166
• Publication Number:
  US 20170173457A1
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/5252 using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

A haptic peripheral system comprising a display, a haptic peripheral device, and a processor is disclosed. The processor is in communication with the display and the haptic peripheral device. The processor is configured to determine a zoom state of a virtual camera of a virtual environment, and to determine at least one of: (i) a perspective of the virtual camera, wherein the perspective indicates which of a first person point of view and a third person point of view the virtual camera has, and (ii) a direction in which the user'"'"'s eyes are directed. The processor is further configured to cause the haptic peripheral device to output a haptic effect that depends on the zoom state, and on at least one of: (i) the perspective of the virtual camera and (ii) the direction in which a user'"'"'s eyes are directed.

Claims

1. A haptic peripheral system, comprising:

a display configured to present a virtual environment;

a haptic peripheral device configured to be controlled by a user; and

a processor in communication with the display and the haptic peripheral device, and configured

to determine a zoom state of a virtual camera of the virtual environment,

to determine at least one of;

(i) a perspective of the virtual camera, wherein the perspective indicates which of a first person point of view and a third person point of view the virtual camera has, and (ii) a direction in which the user'"'"'s eyes are directed, and

to cause the haptic peripheral device to output a haptic effect that depends on the zoom state of the virtual camera, and on at least one of;

(i) the perspective of the virtual camera and (ii) the direction in which the user'"'"'s eyes are directed.

2. The haptic peripheral system of claim 1, wherein the processor is configured to determine the perspective of the virtual camera and to determine a strength level for the haptic effect based on a combination of the zoom state and the perspective of the virtual camera, and to cause the haptic peripheral device to output the haptic effect at the determined strength level.

3. The haptic peripheral system of claim 2, wherein the zoom state is associated with a first haptic effect having first strength level, and the perspective is associated with a second haptic effect having a second strength level, and wherein the processor is configured to determine which haptic effect of the first haptic effect and the second haptic effect has higher priority, and to select the strength level of the haptic effect having the higher priority.

4. The haptic peripheral system of claim 2, wherein the processor is configured to select a haptic effect type for the haptic effect based on at least the perspective of the virtual camera, and to cause the haptic peripheral device to output the haptic effect with the selected haptic effect type.

5. The haptic peripheral system of claim 4, wherein the haptic peripheral device has a plurality of haptic actuators, and wherein the processor is configured to cause the haptic peripheral device to output the haptic effect with one of the plurality of haptic actuators that is associated with the selected haptic effect type.

6. The haptic peripheral system of claim 5, wherein the haptic peripheral device has a user input element, wherein the plurality of haptic actuators includes a rumble actuator configured to generate a haptic effect at a housing of the haptic peripheral device, and includes a targeted actuator configured to directly actuate the user input element, and wherein the rumble actuator is associated with an ambient haptic effect type, and the targeted actuator is associated with a targeted haptic effect type.

7. The haptic peripheral system of claim 1, wherein the processor is disposed in a host computer that is in wired or wireless communication with the haptic peripheral device, and wherein the host computer is in wired communication with the display, or the host computer and the display are combined into a single device.

8. The haptic peripheral system of claim 1, wherein the display is part of a portable computer that is coupled to the haptic peripheral device, and the processor is disposed in the portable computer or in the haptic peripheral device.

9. The haptic peripheral system of claim 1, wherein the haptic peripheral system is a head-mounted wearable device, wherein the haptic peripheral device is a wearable part of the head-mounted wearable device, and the processor is disposed in the haptic peripheral device.

10. The haptic peripheral system of claim 1, wherein the haptic effect is caused by a virtual object or event in the virtual environment.

11. The haptic peripheral system of claim 10, wherein the processor is configured to determine which zoom state the virtual camera is in by determining a virtual distance between the virtual camera and a virtual object or event in the virtual environment.

12. The haptic peripheral system of claim 11, wherein the system comprises a host computer in communication with the haptic peripheral device, and the virtual distance is based on an actual distance between the haptic peripheral device and the host computer.

13. The haptic peripheral system of claim 11, wherein the haptic peripheral device comprises a proximity sensor, and wherein the processor is configured to determine the virtual distance based on measurements by the proximity sensor.

14. The haptic peripheral system of claim 1, wherein the processor is configured to vary a strength level for the haptic effect further based on whether the virtual environment depicts a view that is in focus or a view that is out of focus.

15. The haptic peripheral system of claim 14, wherein the processor is configured to increase the strength level for the haptic effect when the view becomes in focus, and to decrease the strength level when the view becomes out of focus.

16. A method of generating a haptic effect in a haptic peripheral system, comprising:

a processor causing a display of the haptic peripheral system to present a virtual environment;

the processor determining a zoom state of a virtual camera of the virtual environment;

the processor determining at least one of;

(i) a perspective of the virtual camera, wherein the perspective indicates which of a first person point of view and a third person point of view the virtual camera has, and (ii) a direction in which the user'"'"'s eyes are directed, and

the processor causing a haptic peripheral device of the haptic peripheral system to output a haptic effect that depends on the zoom state of the virtual camera, and on at least one of;

(i) the perspective of the virtual camera and (ii) the direction in which the user'"'"'s eyes are directed.