Automatic projection focusing

• US 9,759,994 B1
• Filed: 11/23/2015
• Issued: 09/12/2017
• Est. Priority Date: 09/12/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Soyannwo, Olusanya Temitope, Yan, Renwei, Crump, Edward Dietz, Wang, Weijian, Chang, Samuel Henry, Yao, Ning
• Primary Examiner(s): Chowdhury, Sultan
• Application Number:
  US14/949,276
• Time in Patent Office: 659 Days
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/53 Means for automatic focusing, e.g. to compensate thermal effects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 9/317 Convergence or focusing systems electronic adjustment of convergence H04N9/3185; convergence or focusing arrangements for cathode ray tubes H04N9/28; means for automatic focusing of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/53
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3188 Scale or resolution adjustment scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Techniques are described for performing automatic focusing of a projected image on a mobile projection surface. Specific regions of the projected image are identified that are likely to be desired to stay in optimal focus, and attributes of those specific regions, such as sharpness and contrast, can be used to determine the need to refocus the image. Advanced knowledge of the image data being projected can be utilized to determine the specific regions of the projected image that require monitoring for optimal focusing.

Claims

1. A system comprising:

one or more processors;

a camera;

a projector; and

one or more non-transitory computer-readable storage media storing computer-executable instructions that are executable by the one or more processors to cause the one or more processors to;

cause the projector to project an image on a surface;

capture image information of the image, the image information representative of one or more objects within the image;

determine motion information associated with the image based at least in part on the image information;

determine, based at least in part upon the motion information, a region in the image for monitoring;

detect that a change in an image attribute associated with the region meets or exceeds a first threshold; and

adjust a focus parameter of the projector and project the image on the surface using the focus parameter, the focus parameter including at least one of a position setting or a motor setting of the projector.

2. The system of claim 1, wherein the instructions are further executable to:

determine the region in the image based at least in part upon review of data captured by one or more sensors and associated with the surface.

3. The system of claim 2, wherein the instructions are further executable to:

determine estimated motion for an object of the one or more objects depicted in the image based upon image data associated with the image; and

determine the region based at least in part upon the estimated motion.

4. The system of claim 1, wherein the instructions are further executable to:

project a plurality of images on the surface, the plurality of images including the image;

determine motion of an object of the one or more objects within the region of each of the plurality of images;

determine that an amount of the motion is less than a second threshold; and

determine the region, based at least in part upon the amount of the motion being less than the second threshold.

5. The system of claim 1, wherein the instructions are further executable to, after adjusting the focus parameter:

change the first threshold to a third threshold for the region.

6. The system of claim 1, wherein the instructions are further executable to, after adjusting the focus parameter:

change a frequency of monitoring the region.

7. The system of claim 1, wherein the instructions are further executable to:

determine that the image is distorted by the surface;

establish a baseline distortion of the image;

establish a second threshold based at least in part on the baseline distortion; and

detect that a second change in the image attribute associated with the region meets or exceeds the second threshold.

8. A method comprising:

under control of one or more computer systems configured with executable instructions;

projecting an image on a surface;

capturing data associated with the image;

selecting a region associated with the image to be monitored;

detecting a change in an image attribute of the image within the region, the change greater than a threshold associated with the image attribute; and

adjusting a focus of a projector based at least in part on the threshold being met or exceeded.

9. The method of claim 8, further comprising:

adjusting the threshold based at least in part on the adjusting of the focus of the projector.

10. The method of claim 8, further comprising:

monitoring the region at periodic time intervals.

11. The method of claim 8, further comprising:

determining that the projected image is distorted by an amount; and

adjusting the threshold based at least in part on the amount.

12. The method of claim 8, further comprising:

changing a time interval associated with periodic monitoring of the region.

13. The system of claim 8, further comprising:

projecting a light pattern on the surface; and

determining the region based at least in part on data captured by one or more sensors associated with the light pattern projected on the surface.

14. A computing device comprising:

one or more processors;

a sensor to capture image data;

a projector to project an image onto a surface; and

one or more non-transitory computer-readable storage media storing computer-executable instructions that are executable by the one or more processors to cause the one or more processors to;

determine, from the image data, a region in the image that is to be monitored; and

adjust an attribute of the image based at least in part on detecting a reduction in image quality greater than or equal to the threshold.

15. The computing device of claim 14, wherein the surface is a portable display medium and the instructions are further executable to:

track a movement of the portable display medium; and

cause the projector to continually project the image on the portable display medium.

16. The computing device of claim 15, further comprising adjust a focus parameter of the projector to adjust the attribute, the focus parameter including at least one of a position setting or a motor setting of the projector.

17. The computing device of claim 16, wherein the instructions are further executable to:

cause the sensor to capture the image data at periodic intervals.

18. The computing device of claim 14, wherein the instructions are further executable to:

cause the projector to project a light pattern on the surface; and

determine the region based at least in part upon analyzing image data associated with the light pattern.

19. The computing device of claim 14, wherein the sensor includes at least one of:

one or more image sensors;

one or more cameras;

one or more microphones;

one or more ultrasound transducers;

one or more heat sensors;

one or more motion detectors;

or

one or more depth sensing cameras.

20. The computing device of claim 14, wherein the instructions are further executable to:

adjust the threshold based at least in part on the adjusting the attribute.