Virtual light in augmented reality
First Claim
Patent Images
1. A method for a computing device, comprising:
- receiving optical sensor information output by an optical sensor system observing a physical environment, the optical sensor system forming a sensory component of a head-mounted display system;
receiving position sensor information output by a position sensor system indicating a perspective of the optical sensor system within the physical environment, the position sensor system forming another sensory component of the head-mounted display system;
creating an ambient lighting model from the optical sensor information and the position sensor information, the ambient lighting model describing ambient lighting conditions of the physical environment;
modeling the physical environment from the optical sensor information and the position sensor information to create a virtual environment;
applying the ambient lighting model to the virtual environment including an added virtual object not present in the physical environment to obtain an illuminated virtual object; and
rendering a graphical representation of the illuminated virtual object for presentation via a see-through display of the head-mounted display system, the see-through display configured to visually augment an appearance of the physical environment to a user viewing the physical environment through the see-through display.
2 Assignments
0 Petitions
Accused Products
Abstract
A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.
42 Citations
17 Claims
-
1. A method for a computing device, comprising:
-
receiving optical sensor information output by an optical sensor system observing a physical environment, the optical sensor system forming a sensory component of a head-mounted display system; receiving position sensor information output by a position sensor system indicating a perspective of the optical sensor system within the physical environment, the position sensor system forming another sensory component of the head-mounted display system; creating an ambient lighting model from the optical sensor information and the position sensor information, the ambient lighting model describing ambient lighting conditions of the physical environment; modeling the physical environment from the optical sensor information and the position sensor information to create a virtual environment; applying the ambient lighting model to the virtual environment including an added virtual object not present in the physical environment to obtain an illuminated virtual object; and rendering a graphical representation of the illuminated virtual object for presentation via a see-through display of the head-mounted display system, the see-through display configured to visually augment an appearance of the physical environment to a user viewing the physical environment through the see-through display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computing system, comprising:
a head-mounted display system including; a see-through display configured to visually augment an appearance of the physical environment to a user viewing the physical environment through the see-through display, an optical sensor system configured to observe a physical environment, and a position sensor system configured to indicate a perspective of the optical sensor system within the physical environment; and
a computing device configured to;receive optical sensor information output by the optical sensor system observing the physical environment; receive position sensor information output by the position sensor system indicating the perspective of the optical sensor system; create an ambient lighting model from a combination of the optical sensor information and the position sensor information describing ambient lighting conditions of the physical environment; model the physical environment from the combination of the optical sensor information and the position sensor information to create a virtual environment; apply the ambient lighting model to the virtual environment to obtain an illuminated virtual environment; and render a graphical representation of the illuminated virtual environment in real-time for presentation via the see-through display as the perspective of the optical sensor system within the physical environment changes over time. - View Dependent Claims (14)
-
15. A head-mounted display system, comprising:
-
an optical sensor system configured to observe a physical environment; a position sensor system configured to assess a perspective of the optical sensor system; and a see-through display configured to visually augment an appearance of the physical environment with a virtual object that is virtually illuminated according to ambient lighting conditions of the physical environment, the see-through display applying an ambient lighting model to the physical environment to obtain a virtual shadow of the virtual object, and contrasting the virtual shadow with a graphical representation of a non-shadow region bordering the virtual shadow. - View Dependent Claims (16, 17)
-
Specification