Augmented reality environment with secondary sensory feedback
First Claim
Patent Images
1. A system comprising:
- an augmented reality functional node configured to be positioned within an environment and independent of a user, the augmented reality functional node having a projector and a camera for generating an augmented reality environment, the projector projecting one or more images on one or more surfaces of one or more physical objects within the environment and the camera capturing interaction of a user with the one or more images, the images providing primary stimuli for the user;
a computing device configured to;
determine a plurality of different types of secondary sensory devices available in the environment,select a secondary sensory device of a first type of the plurality of different types, wherein the secondary sensory device is separate from the augmented reality functional node and separate from the user, andfacilitate coordination between the augmented reality functional node and the secondary sensory device so that secondary sensory feedback is provided from the secondary sensory device to the user in synchronization with the projecting of the one or more images; and
wherein the secondary sensory device is configured to generate the secondary sensory feedback within the augmented reality environment in response to the user interacting with the one or more images projected on the one or more surfaces of the one or more physical objects.
2 Assignments
0 Petitions
Accused Products
Abstract
An architecture includes a system to create an augmented reality environment in which images are projected onto a scene and user movement within the scene is captured. In addition to primary visual stimuli, the architecture further includes introduction of a secondary form of sensory feedback into the environment to enhance user experience. The secondary sensory feedback may be tactile feedback and/or olfactory feedback. The secondary sensory feedback is provided to the user in coordination with the visual based activity occurring within the scene.
-
Citations
28 Claims
-
1. A system comprising:
-
an augmented reality functional node configured to be positioned within an environment and independent of a user, the augmented reality functional node having a projector and a camera for generating an augmented reality environment, the projector projecting one or more images on one or more surfaces of one or more physical objects within the environment and the camera capturing interaction of a user with the one or more images, the images providing primary stimuli for the user; a computing device configured to; determine a plurality of different types of secondary sensory devices available in the environment, select a secondary sensory device of a first type of the plurality of different types, wherein the secondary sensory device is separate from the augmented reality functional node and separate from the user, and facilitate coordination between the augmented reality functional node and the secondary sensory device so that secondary sensory feedback is provided from the secondary sensory device to the user in synchronization with the projecting of the one or more images; and wherein the secondary sensory device is configured to generate the secondary sensory feedback within the augmented reality environment in response to the user interacting with the one or more images projected on the one or more surfaces of the one or more physical objects. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An architecture comprising:
-
an augmented reality generation system having projection and image capture capabilities to generate an augmented reality environment by projecting structured light on one or more physical objects in an environment and capturing user movement of a user within the structured light in the environment, the augmented reality generation system being positioned in a first location independent of the user; a computing device configured to;
determine a plurality of different types of sensory devices available in the environment, and select one or more sensory devices of a tactile type of the plurality of different types, the one or more tactile sensory devices being separate from the user and positioned in a second location different from the first location of the augmented reality generation system and the one or more tactile sensory devices being operable in cooperation with the augmented reality generation system to provide tactile feedback to the user as the user interacts with the structured light projected on the one or more physical objects within the augmented reality environment; anda remote computing system having processors and data storage separate from the augmented reality generation system, the remote computing system providing instructions to at least one tactile sensory device to provide the tactile feedback in coordination with the augmented reality environment. - View Dependent Claims (13, 14, 15)
-
-
16. A method comprising:
-
projecting, from a first location independent of a user, visually-perceptible images onto surfaces in an environment;
determining a plurality of different types of secondary sensory devices available in the environment;
selecting a secondary sensory device of a first type of the plurality of different types;capturing interaction of the user with one or more of the visually-perceptible images; and generating, from a second location different than the first location and independent of the user, a secondary sensory feedback from the secondary sensory device to provide sensory feedback to the user in coordination with the user interacting with one or more of the visually-perceptible images projected onto the surfaces in the environment. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
-
23. A method comprising:
-
projecting, from a first location independent of a user, structured light onto one or more surfaces of physical surroundings within a scene;
determining a plurality of different types of sensory devices available in the scene;
selecting a sensory device of a tactile type of the plurality of different types;capturing movement of the user within the scene by detecting deformation of the structured light projected onto the one or more surfaces of the physical surroundings; receiving input as a result of capturing the movement of the user; and delivering, from a second location different than the first location and independent of the user, tactile feedback from the sensory device to the user in response to receipt of the input, the tactile feedback being delivered to the user while the user is within the scene. - View Dependent Claims (24, 25, 26, 27, 28)
-
Specification