Virtual environment generating system
First Claim
1. A method for visually augmenting an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, comprising:
- receiving eye-tracking information from an eye-tracking system in the head-mounted display device;
determining from the eye-tracking information that the user is looking at a virtual object representation;
receiving lighting information from an optical sensor system in the head-mounted display device;
receiving depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device;
generating a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including the virtual object representation and a real-world object representation;
visually augmenting the virtual object representation in the virtual environment based on the eye-tracking information that the user is looking at the virtual object representation;
rendering the virtual object representation on the transparent display of the head-mounted display device;
determining from the eye-tracking information that the user is looking at the real-world object;
based on determining that the user is looking at the real-world object, blurring the virtual object representation as seen by the user through the transparent display;
analyzing a contrast pattern behind the virtual object representation in the physical environment; and
adjusting one or more of a color and a brightness of the virtual object representation to enhance contrast of the virtual object representation with respect to the contrast pattern.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and related methods for visually augmenting an appearance of a physical environment as seen by a user through a head-mounted display device are provided. In one embodiment, a virtual environment generating program receives eye-tracking information, lighting information, and depth information from the head-mounted display. The program generates a virtual environment that models the physical environment and is based on the lighting information and the distance of a real-world object from the head-mounted display. The program visually augments a virtual object representation in the virtual environment based on the eye-tracking information, and renders the virtual object representation on a transparent display of the head-mounted display device.
25 Citations
16 Claims
-
1. A method for visually augmenting an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, comprising:
-
receiving eye-tracking information from an eye-tracking system in the head-mounted display device; determining from the eye-tracking information that the user is looking at a virtual object representation; receiving lighting information from an optical sensor system in the head-mounted display device; receiving depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device; generating a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including the virtual object representation and a real-world object representation; visually augmenting the virtual object representation in the virtual environment based on the eye-tracking information that the user is looking at the virtual object representation; rendering the virtual object representation on the transparent display of the head-mounted display device; determining from the eye-tracking information that the user is looking at the real-world object; based on determining that the user is looking at the real-world object, blurring the virtual object representation as seen by the user through the transparent display; analyzing a contrast pattern behind the virtual object representation in the physical environment; and adjusting one or more of a color and a brightness of the virtual object representation to enhance contrast of the virtual object representation with respect to the contrast pattern. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A virtual environment generating system including a head-mounted display device operatively connected to a computing device, the head-mounted display device including a transparent display through which a user may view a physical environment that includes a real-world object, the virtual environment generating system comprising:
-
a virtual environment generating program executed by a processor of the computing device, the virtual environment generating program configured to; receive eye-tracking information from an eye-tracking system in the head-mounted display device; determine from the eye-tracking information that the user is looking at a virtual object representation; receive lighting information from an optical sensor system in the head-mounted display device; receive depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device; generate a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including the virtual object representation and a real-world object representation; visually augment the virtual object representation in the virtual environment based on the eye-tracking information that the user is looking at the virtual object representation; render the virtual object representation on the transparent display of the head-mounted display device; determine from the eye-tracking information that the user is looking at the real-world object; based on determining that the user is looking at the real-world object, blur the virtual object representation as seen by the user through the transparent display; analyze a contrast pattern behind the virtual object representation in the physical environment; and adjust one or more of a color and a brightness of the virtual object representation to enhance contrast of the virtual object representation with respect to the contrast pattern. - View Dependent Claims (11, 12, 13, 14)
-
-
15. A nonvolatile computer-readable storage medium comprising instructions stored thereon and executable by a computing device to visually augment an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, the instructions being executable to:
-
receive eye-tracking information from an eye-tracking system in the head-mounted display device; receive lighting information from an optical sensor system in the head-mounted display device; receive depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device; generate a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including a virtual object representation and a real-world object representation; determine from the eye-tracking information that the user is looking at the real-world object; based on the eye-tracking information that the user is looking at the real-world object, blur an appearance of the virtual object representation as seen by the user through the transparent display; analyze a contrast pattern behind the virtual object representation in the physical environment; adjust one or more of a color and a brightness of the virtual object representation to enhance contrast of the virtual object representation with respect to the contrast pattern; and render the virtual object representation on the transparent display of the head-mounted display device. - View Dependent Claims (16)
-
Specification