Blended reality systems and methods
First Claim
1. An apparatus to provide a view of reflected and transmitted light to create a visual effect that combines reflected images and transmitted images, the apparatus comprising:
- a display configured to display images;
a mirror having a first side and a second side opposite the first side, the display facing the second side of the mirror, the mirror being partially-reflective and partially-transmissive such that at least a portion of light provided by the display passes through the mirror and is visible from the first side of the mirror;
a frame surrounding the mirror;
a plurality of projectors positioned on the frame and configured to illuminate a user and object elements facing the first side of the mirror;
a camera configured to acquire image data of the user and object elements; and
an image blending system communicably coupled to the display, the plurality of projectors, and the camera, the image blending system configured to;
in a scanning phase, analyze image data received from the camera to determine locations of the user and object elements;
in a tracking phase, analyze the image data received from the camera to determine a location of the user'"'"'s eyes, the location of the user'"'"'s eyes including a height and a distance of the user'"'"'s eyes relative to the mirror;
control the plurality of projectors to illuminate at least some of the user and object elements such that light from the illuminated user and object elements is reflected by the mirror to form reflected light, the reflected light visible from the first side of the mirror within a first portion of the first side of the mirror; and
control the display to output display light, wherein a first portion of the display light corresponds to an image,wherein the first portion of the display light passes from the second side of the mirror to the first side of the mirror such that the first portion of the display light is visible from the first side of the mirror within a second portion of the first side of the mirror,wherein a second portion of the display light passes from the second side of the mirror to the first side of the mirror at a location corresponding to the first portion of the first side of the mirror, andwherein the second portion of the display light has a light intensity lower than a light intensity of the reflected light such that the reflected light is visible instead of the second portion of the display light;
wherein at least a portion of the reflected light and the display light combine to form a composite image.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods are provided for generating a blended reality view to a user, the blended reality view combining images reflected by a mirror with images transmitted from a screen behind the mirror. Systems for generating blended reality views can include a display device with a screen positioned behind a mirror. The display device can generate a pattern of illumination and non-illumination on the screen so that the illuminated portions of the screen substantially transmit through the mirror. Projectors can be used to illuminate objects in front of the mirror so that the illuminated objects are reflected by the mirror. In combination, the portions of the screen transmitted through the mirror and the illuminated objects reflected by the mirror can provide a blended reality view to a user viewing the mirror.
-
Citations
20 Claims
-
1. An apparatus to provide a view of reflected and transmitted light to create a visual effect that combines reflected images and transmitted images, the apparatus comprising:
-
a display configured to display images; a mirror having a first side and a second side opposite the first side, the display facing the second side of the mirror, the mirror being partially-reflective and partially-transmissive such that at least a portion of light provided by the display passes through the mirror and is visible from the first side of the mirror; a frame surrounding the mirror; a plurality of projectors positioned on the frame and configured to illuminate a user and object elements facing the first side of the mirror; a camera configured to acquire image data of the user and object elements; and an image blending system communicably coupled to the display, the plurality of projectors, and the camera, the image blending system configured to; in a scanning phase, analyze image data received from the camera to determine locations of the user and object elements; in a tracking phase, analyze the image data received from the camera to determine a location of the user'"'"'s eyes, the location of the user'"'"'s eyes including a height and a distance of the user'"'"'s eyes relative to the mirror; control the plurality of projectors to illuminate at least some of the user and object elements such that light from the illuminated user and object elements is reflected by the mirror to form reflected light, the reflected light visible from the first side of the mirror within a first portion of the first side of the mirror; and control the display to output display light, wherein a first portion of the display light corresponds to an image, wherein the first portion of the display light passes from the second side of the mirror to the first side of the mirror such that the first portion of the display light is visible from the first side of the mirror within a second portion of the first side of the mirror, wherein a second portion of the display light passes from the second side of the mirror to the first side of the mirror at a location corresponding to the first portion of the first side of the mirror, and wherein the second portion of the display light has a light intensity lower than a light intensity of the reflected light such that the reflected light is visible instead of the second portion of the display light; wherein at least a portion of the reflected light and the display light combine to form a composite image. - View Dependent Claims (2, 3)
-
-
4. A method of generating a combined image at a targeted location that combines reflected images and transmitted images, the method comprising:
-
acquiring image data of surfaces in an environment; generating a virtual three dimensional model of the surfaces in the environment by analyzing the acquired image data; acquiring image data of an object positioned within the environment; identifying a target on the object by analyzing the acquired image data; generating images that are transmitted through a mirror from a first side of the mirror to a second side of the mirror such that the images are visible to the identified target on the object from the second side of the mirror; and projecting light onto selected surfaces in the environment to selectively illuminate the selected surfaces such that light from the illuminated selected surfaces is reflected by the mirror to form reflected light, the reflected light visible from the second side of the mirror within a first portion of the second side of the mirror, wherein a light intensity associated with the images within the first portion of the second side of the mirror is lower than a light intensity of the reflected light such that the reflected light is visible instead of the images within the first portion of the second side of the mirror, and wherein a combined image is visible to the identified target, the combined image comprising an image associated with the reflected light and the images transmitted through the mirror. - View Dependent Claims (5, 6, 7, 8)
-
-
9. An apparatus comprising:
-
a display device comprising a screen; a planar reflective surface positioned adjacent to the screen of the display device, the planar reflective surface configured to allow transmission of light from the screen through the planar reflective surface to a viewing side of the planar reflective surface; a plurality of projectors configured to project light onto surfaces on the viewing side of the planar reflective surface; an image acquisition device positioned to acquire images of the surfaces on the viewing side of the planar reflective surface; and an image blending system configured to; receive acquired images from the image acquisition system; control the plurality of projectors to selectively illuminate surfaces on the viewing side of the planar reflective surface such that light from the illuminated surfaces is reflected by the planar reflective surface to form reflected light; and control the display device to illuminate a portion of the screen and to leave a portion of the screen blank such that display light corresponding to the illuminated portion of the screen passes through the planar reflective surface to the viewing side of the planar reflective surface within a first portion of the viewing side of the planar reflective surface, wherein a light intensity of the display light is greater than a light intensity of the reflected light within the first portion of the viewing side of the planar reflective surface such that the display light is visible instead of the reflected light within the first portion of the viewing side of the planar reflective surface, and wherein at a targeted location on the viewing side of the planar reflective surface a combined image forms, the combined image comprising the reflected light and the display light. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification