Systems and methods for immersive interaction with virtual objects
First Claim
1. A system for providing non-visual sensory feedback to a user interacting with a virtual object, comprising:
- a processor; and
a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, when executed on the processor, cause the system to at least;
receive data captured by a capture device, the data comprising at least one of a velocity, acceleration or rotation of a body part associated with a user;
predict, based on the data, a future interaction by the user with the virtual object at a future time;
compute, prior to the future time, and based on the predicted future interaction by the user with the virtual object, a non-visual sensory feedback that corresponds to the future interaction by the user with the virtual object and a duration for providing the non-visual sensory feedback, computing the non-visual sensory feedback comprising computing, based on the predicted future interaction, an amount of non-visual sensory feedback prior to the future time and before the predicted future interaction actually occurs; and
provide the computed non-visual sensory feedback to the user at the future time.
2 Assignments
0 Petitions
Accused Products
Abstract
A system to present the user a 3-D virtual environment as well as non-visual sensory feedback for interactions that user makes with virtual objects in that environment is disclosed. In an exemplary embodiment, a system comprising a depth camera that captures user position and movement, a three-dimensional (3-D) display device that presents the user a virtual environment in 3-D and a haptic feedback device provides haptic feedback to the user as he interacts with a virtual object in the virtual environment. As the user moves through his physical space, he is captured by the depth camera. Data from that depth camera is parsed to correlate a user position with a position in the virtual environment. Where the user position or movement causes the user to touch the virtual object, that is determined, and corresponding haptic feedback is provided to the user.
62 Citations
20 Claims
-
1. A system for providing non-visual sensory feedback to a user interacting with a virtual object, comprising:
-
a processor; and a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, when executed on the processor, cause the system to at least; receive data captured by a capture device, the data comprising at least one of a velocity, acceleration or rotation of a body part associated with a user; predict, based on the data, a future interaction by the user with the virtual object at a future time; compute, prior to the future time, and based on the predicted future interaction by the user with the virtual object, a non-visual sensory feedback that corresponds to the future interaction by the user with the virtual object and a duration for providing the non-visual sensory feedback, computing the non-visual sensory feedback comprising computing, based on the predicted future interaction, an amount of non-visual sensory feedback prior to the future time and before the predicted future interaction actually occurs; and provide the computed non-visual sensory feedback to the user at the future time. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for providing non-visual sensory feedback to a user interacting with a virtual object, comprising:
-
receiving data captured by a capture device, the data comprising at least one of a velocity, acceleration or rotation of a body part associated with a user; predicting, based on the data, a future interaction by the user is with the virtual object at a future time; computing, prior to the future time, and based on the predicted future interaction by the user with the virtual object, a non-visual sensory feedback that corresponds to the future interaction by the user with the virtual object and a duration for providing the non-visual sensory feedback, computing the non-visual sensory feedback comprising computing, based on the predicted future interaction, an amount of non-visual sensory feedback prior to the future time and before the predicted future interaction actually occurs; and providing the computed non-visual sensory feedback to the user at the future time. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
-
19. A computer-readable storage device bearing computer-readable instructions that, when executed on a computer, cause the computer to perform operations comprising:
-
displaying a virtual object to a user via a three-dimensional (3-D) display; receiving data captured by a capture device, the data comprising at least one of a velocity, acceleration or rotation of a body part associated with the user; predicting, based on the data, a future interaction by a user with the virtual object at a future time; computing, prior to the future time, and based on the predicted future interaction by the user with the virtual object, a non-visual sensory feedback that corresponds to the future interaction by the user with the virtual object and a duration for providing the non-visual sensory feedback, computing the non-visual sensory feedback comprising computing, based on the predicted future interaction, an amount of non-visual sensory feedback prior to the future time and before the predicted future interaction actually occurs; and providing the computed non-visual sensory feedback to the user at the future time. - View Dependent Claims (20)
-
Specification