Haptically enhanced interactivity with interactive content

• US 10,248,298 B2
• Filed: 08/13/2018
• Issued: 04/02/2019
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Birnbaum, David M., Grant, Danny A., Heubel, Robert W.
• Primary Examiner(s): Nam, Hyun
• Application Number:
  US16/101,608
• Publication Number:
  US 20180356963A1
• Time in Patent Office: 232 Days
• Field of Search: None
• CPC Class Codes: A63F 13/28 responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light controlling the output signals based on the game progress A63F13/50
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04B 1/3827 Portable transceivers

Abstract

Interactive content may be presented to a user that is manipulating a peripheral. One or more state parameters that are related to the position of the peripheral may be determined. The peripheral may be identified from a plurality of possible peripherals. The interactive content may be adjusted based at least in part on the one or more position parameters and/or the identification of the peripheral. Haptic feedback to be provided to the user may be determined based at least in part on the one or more position parameters and/or the identification of the peripheral.

Claims

1. A system comprising:

a processor; and

a memory device comprising program code that is executable by the processor to cause the processor to;

display a virtual environment via an electronic display;

detect an interaction with a virtual object in the virtual environment based on a peripheral being at a particular position in free space with respect to the virtual object; and

based on detecting the interaction;

determine a first feedback parameter that depends on an identifier of the peripheral and a second feedback parameter that depends on the particular position of the peripheral in free space; and

transmit a haptic signal configured to cause a haptic output device to output haptic feedback in accordance with the first feedback parameter and the second feedback parameter.

2. The system of claim 1, wherein the virtual object is a three-dimensional virtual object.

3. The system of claim 1, wherein the virtual environment is an augmented reality environment.

4. The system of claim 1, wherein the peripheral is a body part.

5. The system of claim 1, wherein the peripheral is a consumer product.

6. The system of claim 1, wherein the peripheral is an electronic device that comprises the haptic output device.

7. The system of claim 1, wherein the peripheral comprises a mobile telephone, a digital music player, a personal digital assistant, a smartphone, an e-book reader, a laptop computer, a tablet computer, or a remote control.

8. The system of claim 1, wherein the peripheral comprises a wearable computer.

9. A method comprising:

displaying, by a processor, a virtual environment via an electronic display;

detecting, by the processor, an interaction with a virtual object in the virtual environment based on a peripheral being at a particular position in free space with respect to the virtual object; and

based on detecting the interaction;

determining, by the processor, a first feedback parameter that depends on an identifier of the peripheral and a second feedback parameter that depends on the particular position of the peripheral in free space; and

transmitting, by the processor, a haptic signal configured to cause a haptic output device to output haptic feedback in accordance with the first feedback parameter and the second feedback parameter.

10. The method of claim 9, wherein the virtual object is a three-dimensional virtual object.

11. The method of claim 9, wherein the virtual environment is an augmented reality environment.

12. The method of claim 9, wherein the peripheral is a body part.

13. The method of claim 9, wherein the peripheral is a consumer product.

14. The method of claim 9, wherein the peripheral is an electronic device that comprises the haptic output device.

15. The method of claim 9, wherein the peripheral comprises a mobile telephone, a digital music player, a personal digital assistant, a smartphone, an e-book reader, a laptop computer, a tablet computer, or a remote control.

16. The method of claim 9, wherein the peripheral comprises a wearable computer.

17. A non-transitory computer-readable medium comprising program code that is executable by a processor to cause the processor to:

display a virtual environment via an electronic display;

detect an interaction with a virtual object in the virtual environment based on a peripheral being at a particular position in free space with respect to the virtual object; and

based on detecting the interaction;

determine a first feedback parameter that depends on an identifier of the peripheral and a second feedback parameter that depends on the particular position of the peripheral in free space; and

transmit a haptic signal configured to cause a haptic output device to output haptic feedback in accordance with the first feedback parameter and the second feedback parameter.

18. The non-transitory computer-readable medium of claim 17, wherein the virtual object is a three-dimensional virtual object.

19. The non-transitory computer-readable medium of claim 17, wherein the virtual environment is an augmented reality environment.

20. The non-transitory computer-readable medium of claim 17, wherein the peripheral is a body part.

21. The non-transitory computer-readable medium of claim 17, wherein the peripheral is a consumer product.

22. The non-transitory computer-readable medium of claim 17, wherein the peripheral is an electronic device that comprises the haptic output device.

23. The non-transitory computer-readable medium of claim 17, wherein the peripheral comprises a mobile telephone, a digital music player, a personal digital assistant, a smartphone, an e-book reader, a laptop computer, a tablet computer, or a remote control.

24. The non-transitory computer-readable medium of claim 17, wherein the peripheral comprises a wearable computer.