VIRTUAL ENVIRONMENT GENERATING SYSTEM
First Claim
1. A method for visually augmenting an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, comprising:
- receiving eye-tracking information from an eye-tracking system in the head-mounted display device;
receiving lighting information from an optical sensor system in the head-mounted display device;
receiving depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device;
generating a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including a virtual object representation and a real-world object representation;
visually augmenting the virtual object representation in the virtual environment based on the eye-tracking information; and
rendering the virtual object representation on the transparent display of the head-mounted display device.
3 Assignments
0 Petitions
Accused Products
Abstract
A system and related methods for visually augmenting an appearance of a physical environment as seen by a user through a head-mounted display device are provided. In one embodiment, a virtual environment generating program receives eye-tracking information, lighting information, and depth information from the head-mounted display. The program generates a virtual environment that models the physical environment and is based on the lighting information and the distance of a real-world object from the head-mounted display. The program visually augments a virtual object representation in the virtual environment based on the eye-tracking information, and renders the virtual object representation on a transparent display of the head-mounted display device.
123 Citations
20 Claims
-
1. A method for visually augmenting an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, comprising:
-
receiving eye-tracking information from an eye-tracking system in the head-mounted display device; receiving lighting information from an optical sensor system in the head-mounted display device; receiving depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device; generating a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including a virtual object representation and a real-world object representation; visually augmenting the virtual object representation in the virtual environment based on the eye-tracking information; and rendering the virtual object representation on the transparent display of the head-mounted display device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A virtual environment generating system including a head-mounted display device operatively connected to a computing device, the head-mounted display device including a transparent display through which a user may view a physical environment that includes a real-world object, the virtual environment generating system comprising:
a virtual environment generating program executed by a processor of the computing device, the virtual environment generating program configured to; receive eye-tracking information from an eye-tracking system in the head-mounted display device; receive lighting information from an optical sensor system in the head-mounted display device; receive depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device; generate a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including a virtual object representation and a real-world object representation; visually augment the virtual object representation in the virtual environment based on the eye-tracking information; and render the virtual object representation on the transparent display of the head-mounted display device. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
19. A computer-readable storage medium comprising instructions stored thereon and executable by a computing device to visually augment an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, the instructions being executable to:
-
receive eye-tracking information from an eye-tracking system in the head-mounted display device; receive lighting information from an optical sensor system in the head-mounted display device; receive depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device; generate a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including a virtual object representation and a real-world object representation; determine from the eye-tracking information that the user is looking at the real-world object; blur an appearance of the virtual object representation as seen by the user through the transparent display; and render the virtual object representation on the transparent display of the head-mounted display device. - View Dependent Claims (20)
-
Specification