Augmented reality content rendering via albedo models, systems and methods
First Claim
Patent Images
1. A method of rendering augmented reality content, comprising:
- obtaining, by a rendering device, an albedo model related to a patient in a medical environment, the albedo model comprising portions corresponding to portions of the patient, wherein each portion of the albedo model includes lighting rules selected based on a reflective nature of a corresponding portion of the patient;
obtaining, by the rendering device, augmented reality (AR) content related to the patient;
deriving, by the rendering device, a pose of the patient or of one or more portions of the patient from a digital representation of the patient;
aligning, by the rendering device, the albedo model with the pose;
deriving, by the rendering device, observed shading data from the digital representation and the albedo model;
deriving an estimated object shading model using the albedo model and the observed shading data;
generating, by the rendering device, environmentally adjusted AR content by applying the estimated object shading model to the AR content; and
rendering, by the rendering device, the environmentally adjusted AR content.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods for rendering augmented reality (AR) content are presented. An a priori defined 3D albedo model of an object is leveraged to adjust AR content so that is appears as a natural part of a scene. Disclosed devices recognize a known object having a corresponding albedo model. The devices compare the observed object to the known albedo model to determine a content transformation referred to as an estimated shading (environmental shading) model. The transformation is then applied to the AR content to generate adjusted content, which is then rendered and presented for consumption by a user.
26 Citations
34 Claims
-
1. A method of rendering augmented reality content, comprising:
-
obtaining, by a rendering device, an albedo model related to a patient in a medical environment, the albedo model comprising portions corresponding to portions of the patient, wherein each portion of the albedo model includes lighting rules selected based on a reflective nature of a corresponding portion of the patient; obtaining, by the rendering device, augmented reality (AR) content related to the patient; deriving, by the rendering device, a pose of the patient or of one or more portions of the patient from a digital representation of the patient; aligning, by the rendering device, the albedo model with the pose; deriving, by the rendering device, observed shading data from the digital representation and the albedo model; deriving an estimated object shading model using the albedo model and the observed shading data; generating, by the rendering device, environmentally adjusted AR content by applying the estimated object shading model to the AR content; and rendering, by the rendering device, the environmentally adjusted AR content. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A computer program product embedded in a non-transitory computer-readable medium comprising instructions for rendering augmented reality content, which, when executed, configure one or more computer processors to perform a method comprising:
-
obtaining an albedo model related to a patient in a medical environment, the albedo model comprising portions corresponding to portions of the patient, wherein each portion of the albedo model includes lighting rules selected based on a reflective nature of a corresponding portion of the patient; obtaining augmented reality (AR) content related to the patient; deriving a pose of the patient from a digital representation of the patient; aligning the albedo model with the pose; deriving observed shading data from the digital representation and the albedo model; deriving an estimated object shading model using the albedo model and the observed shading data; generating environmentally adjusted AR content by applying the estimated object shading model to the AR content; and rendering the environmentally adjusted AR content.
-
Specification