Projection and camera system for augmented reality environment
First Claim
1. A device comprising:
- a head structure;
a base structure connected to the head structure by an arm mechanism;
a plurality of components housed in one or more of the head structure or the base structure, the plurality of components comprising;
an illumination component to illuminate at least a portion of an environment;
a prism arrangement comprising a plurality of optical elements, the prism arrangement having an associated optical path within the prism arrangement;
a projector to project images onto a surface of the environment, the projector configured to project the images along at least a first portion of the optical path within the prism arrangement;
a time-of-flight sensor to receive at least a portion of light from the illumination component scattered by the environment, the light being received along at least the first portion of the optical path within the prism arrangement, the time-of-flight sensor configured to determine a time of flight value associated with one or more objects in the illuminated portion of the environment; and
a processor to determine distance information of the one or more objects relative to the time of flight sensor, the distance information determined based at least in part on the determined time of flight value.
2 Assignments
0 Petitions
Accused Products
Abstract
A device includes a projection and camera system to create an augmented reality environment in which images are projected onto a scene and user movement within the scene is captured. The projection and camera system have a camera to image scattered IR light from the scene and compute time of flight values used in depth mapping of objects in the room. The system also has a projector to project the images onto the scene. The projected images and scattered IR light use a common optical path through the same lens. Additionally, an illumination system used to illuminate the scene with the IR light may also use the common optical path through the same lens. In one implementation, the projection and camera system are mounted in a movable head of a table lamp.
-
Citations
27 Claims
-
1. A device comprising:
-
a head structure; a base structure connected to the head structure by an arm mechanism; a plurality of components housed in one or more of the head structure or the base structure, the plurality of components comprising; an illumination component to illuminate at least a portion of an environment; a prism arrangement comprising a plurality of optical elements, the prism arrangement having an associated optical path within the prism arrangement; a projector to project images onto a surface of the environment, the projector configured to project the images along at least a first portion of the optical path within the prism arrangement; a time-of-flight sensor to receive at least a portion of light from the illumination component scattered by the environment, the light being received along at least the first portion of the optical path within the prism arrangement, the time-of-flight sensor configured to determine a time of flight value associated with one or more objects in the illuminated portion of the environment; and a processor to determine distance information of the one or more objects relative to the time of flight sensor, the distance information determined based at least in part on the determined time of flight value. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system comprising:
-
a projector to project an image along a first portion of an optical path within a prism arrangement comprising a plurality of optical elements, the prism arrangement guiding light from the projector along the optical path; an illumination component to illuminate an area external to the system; and a time-of-flight component to receive light scattered from the illuminated area and determine a time-of-flight value associated with one or more objects in the illuminated area, the light being received and directed through the prism arrangement along the first portion of the optical path within the prism arrangement. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. An optical assembly to direct light within a projection system, the optical assembly comprising:
-
a first prism having at least a first surface; a second prism having at least first and second surfaces, the first surface of the second prism being adjacent to, but spaced apart by an air gap, the first surface of the first prism, wherein the second prism is configured to; project light along a first portion of an optical path within the second prism, and receive light reflected from one or more objects from outside the optical assembly along at least the first portion of the optical path; and a third prism having at least a first surface that is joined to the second surface of the second prism. - View Dependent Claims (21, 22)
-
-
23. An optical assembly to direct light within a projection system, the optical assembly comprising:
-
a first prism having at least a first surface; and a second prism having at least a first surface, the first surface of the second prism being adjacent to, but spaced apart by an air gap, to the first surface of the first prism, wherein the second prism is configured to; project light along a first portion of an optical path within the second prism, and receive light reflected from one or more objects from outside the optical assembly along at least the first portion of the optical path. - View Dependent Claims (24)
-
-
25. An optical assembly for use in a projection system, the optical assembly comprising:
-
a lens having an associated first portion of an optical path within the lens along which; image information from a projector is transmitted at least in part to an area of an environment; and light scattered from the environment is received at least in part, wherein the image information is transmitted and the scattered light is received at least partly along the first portion of the optical path within the lens; and a prism arrangement comprising a plurality of optical elements to direct, at least in part; the image information from the projector to the lens; and the received light from the lens to a depth sensor. - View Dependent Claims (26, 27)
-
Specification