Projection and camera system for augmented reality environment
First Claim
1. A device comprising:
- a head structure;
a base structure connected to the head structure by an arm mechanism;
a plurality of components housed in one or more of the head structure or the base structure, the plurality of components comprising;
a lens;
a projector to project images, through the lens, onto one or more objects in an environment external to the device;
an illumination component to illuminate, through the lens, the one or more objects in the environment into which at least a portion of the images from the projector are to be projected;
a time-of-flight sensor to receive at least a portion of light from the illumination component scattered by the environment, the light being received at the lens, the time-of-flight sensor configured to determine a time of flight value associated with one or more objects associated with the one or more objects in the environment; and
a processor to determine distance information of the one or more objects relative to the time of flight sensor, the distance information determined based at least in part on the determined time of flight value.
2 Assignments
0 Petitions
Accused Products
Abstract
A device includes a projection and camera system to create an augmented reality environment in which images are projected onto a scene and user movement within the scene is captured. The projection and camera system have a camera to image scattered IR light from the scene and compute time of flight values used in depth mapping of objects in the room. The system also has a projector to project the images onto the scene. The projected images and scattered IR light use a common optical path through the same lens. Additionally, an illumination system used to illuminate the scene with the IR light may also use the common optical path through the same lens. In one implementation, the projection and camera system are mounted in a movable head of a table lamp.
-
Citations
31 Claims
-
1. A device comprising:
-
a head structure; a base structure connected to the head structure by an arm mechanism; a plurality of components housed in one or more of the head structure or the base structure, the plurality of components comprising; a lens; a projector to project images, through the lens, onto one or more objects in an environment external to the device; an illumination component to illuminate, through the lens, the one or more objects in the environment into which at least a portion of the images from the projector are to be projected; a time-of-flight sensor to receive at least a portion of light from the illumination component scattered by the environment, the light being received at the lens, the time-of-flight sensor configured to determine a time of flight value associated with one or more objects associated with the one or more objects in the environment; and a processor to determine distance information of the one or more objects relative to the time of flight sensor, the distance information determined based at least in part on the determined time of flight value. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system comprising:
-
a lens; a projector to project an image through the lens into an area external to the system; an illumination component, independent of the projector, to illuminate through the lens an area external to the system and into which at least a portion of the image from the projector is being projected; and a time-of-flight component to receive light scattered from the illuminated area and determine a time-of-flight value associated with one or more objects in the illuminated area, the light being received back through the lens. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
-
18. A system comprising:
-
a lens; a projector to project an image through the lens; an illumination component to generate light that is directed out through the lens to illuminate an environment external to the system and into which at least a portion of the image from the projector is being projected; and a time-of-flight component to receive light scattered from the illuminated area and determine a time-of-flight value associated with one or more objects in the illuminated area, the light being received through the lens. - View Dependent Claims (19, 20, 21, 22, 23)
-
-
24. A system comprising:
-
a lens having an associated optical path; a projector to project an image through the lens along at least a portion of the optical path into an environment external to the system; an illumination component to project light through the lens along at least a portion of the optical path in order to illuminate the environment into which at least a portion of the image from the projector is being projected; and a sensor to receive light scattered from the environment through the lens along at least a portion of the optical path, the sensor to use the received light for analysis of one or more objects in the environment. - View Dependent Claims (25, 26, 27, 28)
-
-
29. A method comprising:
-
illuminating an environment with infrared (IR) light; capturing, through a lens, the IR light scattered by one or more objects in the environment; determining a time of flight value based on the scattered IR light that is captured through the lens; and projecting an image through the lens into the environment being illuminated by the IR light such that the projected image and the captured IR light pass through the lens. - View Dependent Claims (30, 31)
-
Specification