Automatic projection focusing

• US 9,197,870 B1
• Filed: 09/12/2012
• Issued: 11/24/2015
• Est. Priority Date: 09/12/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Chang, Samuel Henry, Crump, Edward Dietz, Wang, Weijian, Yao, Ning, Soyannwo, Olusanya T., Yan, Renwei
• Primary Examiner(s): CHOWDHURY, SULTAN U.
• Application Number:
  US13/612,173
• Time in Patent Office: 1,168 Days
• Field of Search: 353/28, 353/30, 353/69, 353/70, 353/79, 353/121, 353/122, 382/103, 382/162, 382/165, 382/167, 382/275, 382/276, 345/158, 345/419
• US Class Current: 1/1
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/53 Means for automatic focusing, e.g. to compensate thermal effects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 9/317 Convergence or focusing systems electronic adjustment of convergence H04N9/3185; convergence or focusing arrangements for cathode ray tubes H04N9/28; means for automatic focusing of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/53
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3188 Scale or resolution adjustment scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Techniques are described for performing automatic focusing of a projected image on a mobile projection surface. Specific regions of the projected image are identified that are likely to be desired to stay in optimal focus, and attributes of those specific regions, such as sharpness and contrast, can be used to determine the need to refocus the image. Advanced knowledge of the image data being projected can be utilized to determine the specific regions of the projected image that require monitoring for optimal focusing.

Claims

1. A method comprising:

under control of one or more computing systems configured with specific executable instructions,

projecting one or more images on a surface within an environment;

capturing image information from the environment;

based at least in part on analyzing the captured image information, determining at least one region in the projected one or more images that is to be monitored;

based at least in part on analyzing the captured image information, monitoring the at least one region in the projected one or more images for a threshold of a change in an image attribute associated with the at least one region; and

adjusting projection of the one or more images based at least in part upon the threshold being met.

2. The method of claim 1, further comprising determining the at least one region in the projected one or more images based at least in part upon review of image data in the environment that comprises the projected light pattern.

3. The method of claim 2, further comprising:

predicting motion for an object in the one or more images based upon review of image data that is to be projected; and

determining the at least one region in the projected one or more images based upon the predicted motion within the image data.

4. The method of claim 1, further comprising:

capturing motion in the one or more images that are displayed on the surface; and

determining the at least one region in the projected one or more images based at least in part upon determining that an amount of a motion within that the at least one region over a number image frames is less than another threshold.

5. The method of claim 1, further comprising changing the threshold for the region being monitored upon the adjusting of the projection of the one or more images in that region.

6. The method of claim 1, further comprising changing a frequency of monitoring of the region upon the adjusting of the projection of the one or more images in that region.

7. The method of claim 1, further comprising:

determining if the projected one or more images is distorted by the surface on which the one or more images is projected;

establishing a baseline distortion of the projected one or more images for the surface on which the one or more images is projected; and

monitoring the at least one region in the projected one or more images for a threshold of a change in the image attribute associated with the at least one region accounting for the baseline distortion within the region.

8. The method of claim 1, wherein adjusting projection of the one or more images is adjusting the focus for the one or more images.

9. One or more non-transitory computer readable media storing computer-executable instructions executable by one or more processors to cause the one or more processors to:

cause a projector to project a one or more images on a surface within an environment;

capture image information from the environment;

based at least in part on analyzing the captured image information, determine at least one region in the projected one or more images that is to be monitored;

based at least in part on analyzing the captured image information, monitor the at least one region in the projected one or more images for a threshold of a change in an image attribute associated with the at least one region; and

adjust projection of the one or more images based at least upon the threshold being met.

10. The one or more non-transitory computer readable media of claim 9, wherein the computer-executable instructions are further executable to:

determine the at least one region in the projected one or more images based at least in part upon review of image data in the environment that comprises the projected light pattern.

11. The one or more non-transitory computer readable media of claim 10, wherein the computer-executable instructions are further executable to:

predict motion for an object in the one or more images based upon review of image data that is to be projected; and

determine the at least one region in the projected one or more images based upon the predicted motion within the image data.

12. The one or more non-transitory computer readable media of claim 9, wherein the computer-executable instructions are further executable to:

capture motion in the one or more images that are displayed on the surface; and

determine the at least one region in the projected one or more images based at least in part upon determining that an amount of a motion within that the at least one region over a number image frames is less than another threshold.

13. The one or more non-transitory computer readable media of claim 9, wherein the computer-executable instructions are further executable to:

change the threshold for the region being monitored upon the adjusting of the projection of the one or more images in that region.

14. The one or more non-transitory computer readable media of claim 9, wherein the computer-executable instructions are further executable to:

change a frequency of monitoring of the region upon the adjusting of the projection of the one or more images in that region.

15. The one or more non-transitory computer readable media of claim 9, wherein the computer-executable instructions are further executable to:

determine if the projected one or more images is distorted by the surface on which the one or more images is projected;

establish a baseline distortion of the projected one or more images for the surface on which the one or more images is projected; and

monitor the at least one region in the projected one or more images for a threshold of a change in the image attribute associated with the at least one region accounting for the baseline distortion within the region.

16. The one or more non-transitory computer readable media of claim 9, wherein adjusting projection of the one or more images is adjusting the focus of the one or more images.

17. A system comprising:

one or more processors;

a camera;

a projector; and

one or more non-transitory computer-readable storage media storing computer-executable instructions that are executable by the one or more processors to cause the one or more processors to;

cause the projector to project one or more images to be displayed on a surface of an environment;

capturing image information from the environment;

based at least in part on analyzing the captured image information, determine at least one region in the projected one or more images that is to be monitored;

based at least in part on analyzing the captured image information, monitor the at least one region in the projected one or more images for a threshold of a change in an image attribute associated with the at least one region; and

adjust projection of the one or more images based at least in part upon the threshold being met.

18. The system of claim 17, wherein the instructions are further executable to:

determine the at least one region in the projected one or more images based at least in part upon review of image data in the environment that comprises the projected one or more images.

19. The system of claim 18, wherein the instructions are further executable to:

predict motion for an object in the one or more images based upon review of image data that is to be projected; and

determine the at least one region in the projected one or more images based at least in part upon the predicted motion within the image data.

20. The system of claim 17, wherein the instructions are further executable to:

capture motion in the one or more images that are displayed on the surface; and

determine the at least one region in the projected one or more images, based at least in part upon determining that an amount of a motion within that the at least one region over a number image frames is less than another threshold.

21. The system of claim 17, wherein the adjusting projection of the one or more images is adjusting the focus of the one or more images and the instructions are further executable to:

change the threshold for the region being monitored upon the adjusting of the focus of the one or more images in that region.

22. The system of claim 17, wherein the adjusting projection of the one or more images is adjusting the focus of the one or more images and the instructions are further executable to:

change a frequency of monitoring of the region upon the adjusting of the focus of the one or more images in that region.

23. The system of claim 17, wherein the instructions are further executable to:

determine if the projected one or more images is distorted by the surface on which the one or more images is projected;

establish a baseline distortion of the projected one or more images for the surface on which the one or more images is projected; and

monitor the at least one region in the projected one or more images for a threshold of a change in the image attribute associated with the at least one region accounting for the baseline distortion within the region.