USING VORTICES TO PROVIDE TACTILE SENSATIONS CORRESPONDING TO A VISUAL PRESENTATION

• US 20150015607A1
• Filed: 07/12/2013
• Published: 01/15/2015
• Est. Priority Date: 07/12/2013
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Sodhi, Rajinder, Poupyrev, Ivan, Glisson, Matthew Feld
• Granted Patent: US 9,619,027 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: F15D 1/0015 Whirl chambers
• CPC Class Codes: F15D 1/009 by means of vortex rings
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: Y10T 137/2087 Means to cause rotational flow of fluid [e.g., vortex generator]

Abstract

To convey tactile sensations over an open space, a system may use a vortex generator to direct one or more vortices at an object in 3-D space. Once a vortex strikes an object—e.g., a user'"'"'s hand—it applies a force. The vortex generator can control the frequency and intensity of the vortices in order to provide different tactile sensations that correspond to virtual objects or events in a visual presentation. The system may identify and track objects in the real-world environment, and based on information provided by a device displaying the visual presentation, transmit instructions to the vortex generator to discharge vortices that convey a tactile sensation corresponding to the virtual object or event in the visual presentation. By doing so, the vortices augment the real-world environment to immerse the user in the visual presentation.

Claims

3-1. The method of claim 1, further comprising:

determining a time delay between the event in the visual presentation and the time required for the vortex to strike the physical object, wherein the vortex is discharged from the vortex generator to account for the time delay.

6. A computer program product for augmenting reality based on a visual presentation, the computer program product comprising:

a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to;

identify the location of a physical object based on data captured from a sensing device;

orient a vortex generator based on the identified location of the physical object;

determine a tactile sensation corresponding to at least one of a virtual object in the visual presentation and an event in the visual presentation; and

after orienting the vortex generator, discharge at least one vortex from the vortex generator, wherein the vortex is discharged with physical attributes to provide the tactile sensation corresponding to the visual presentation upon striking the physical object.

7. The computer program product of claim 6, wherein discharging at least one vortex form the vortex generator comprises computer-readable program code configured to:

select a predefined pattern of sequential vortices for conveying the tactile sensation of the virtual object or the event in the visual presentation, the predefined pattern defining one or more frequencies and one or more intensities used by the vortex generator when discharging the sequential vortices.

8. The computer program product of claim 7, wherein the predefined pattern of sequential vortices provide the tactile sensation corresponding to a texture of the virtual object when striking the physical object.

9. The computer program product of claim 6, further comprising computer-readable program code configured to:

determine a time delay between the event in the visual presentation and the time required for the vortex to strike the physical object, wherein the vortex is discharged from the vortex generator to account for the time delay.

10. The computer program product of claim 6, further comprising computer-readable program code configured to:

adjusting an intensity of the vortex based on a measured distance from the vortex generator to the physical object such that a substantial similar tactile sensation is provided to the physical object regardless of the distance between the physical object and the vortex generator.

11. The computer program product of claim 6, wherein orienting the vortex generator further comprises computer-readable program code configured to:

determine a direction of movement of the physical object; and

orient the vortex generator to discharge the vortex at a predicted, future location of the physical object.

12. A system, comprising:

a sensing device;

a vortex generator configured to discharge a vortex, the vortex generator comprising adjusters configured to change an orientation of the vortex generator; and

a computing device communicatively coupled to the sensing device and the vortex generator, the computing device configured to;

identify the location of a physical object based on data captured from the sensing device;

orient the vortex generator based on the identified location of the physical object;

determine a tactile sensation corresponding to at least one of a virtual object in the visual presentation and an event in the visual presentation; and

after orienting the vortex generator, discharge at least one vortex from the vortex generator, wherein the vortex is discharged with physical attributes to provide the tactile sensation corresponding to the visual presentation upon striking the physical object.

13. The system of claim 12, wherein the sensing device is fixable mounted such that a position of the vortex generator relative to a position of the sensing device remains constant as the vortex generator is moved.

14. The system of claim 13, further comprising a depth sensor, wherein the computing device is configured to use data captured by the sensing device and the depth sensor to identify the location of the physical object in 3-D space.

15. The system of claim 12, wherein the computing device is configured to orient the vortex generator by transmitting instructions to the adjusters such that a nozzle of the vortex generator is moved.

16. The system of claim 12, further comprising:

a display device configured to display the visual presentation, wherein the display device is communicatively coupled to the computing device to provide the computing device with information associated with at least one of the virtual object in the visual presentation and the event in the visual presentation.

17. The system of claim 16, wherein the display device and the computing device are integrated to form a unified device, wherein the vortex generator and sensing device are mounted onto the unified device.

18. A vortex generator comprising:

a body enclosing a central cavity;

an actuator mounted onto the body, the actuator configured to change the volume of the central cavity in response to a first control signal;

a flexible, elongated nozzle attached to the body at a first end, wherein, in response to the actuator changing the volume of the central cavity, air flows through the nozzle and generates a vortex at a second end of the nozzle opposite the first end; and

an adjustment element coupled to the nozzle, the adjustment element is configured to, in response to a second control signal, adjust the position of the second end of the nozzle relative to the first end of the nozzle thereby changing the direction the vortex travels.

19. The vortex generator of claim 18, wherein the adjustment element moves the second end of the nozzle relative to the body, such that the adjustment element does not move the body when adjusting the second end of the nozzle.

20. The vortex generator of claim 18, wherein the adjustment element is a first gimbal controller that moves the second end of the nozzle along a first axis, wherein the vortex generator further comprises a second gimbal controller that adjusts the second end of the nozzle along a second axis perpendicular to the first axis.