Wide-field of view (FOV) imaging devices with active foveation capability

• US 10,061,130 B2
• Filed: 11/13/2017
• Issued: 08/28/2018
• Est. Priority Date: 04/05/2012
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Gao, Chunyu, Hua, Hong
• Primary Examiner(s): Atala, Jamie
• Assistant Examiner(s): Boylan, James
• Application Number:
  US15/811,543
• Publication Number:
  US 20180157046A1
• Time in Patent Office: 288 Days
• Field of Search: 348 38
• CPC Class Codes: G02B 13/06 Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0145 creating an intermediate image
• CPC Class Codes: G02B 2027/015 involving arrangement aiming to get less bulky devices
• CPC Class Codes: G02B 25/001 Eyepieces
• CPC Class Codes: G02B 26/00 Optical devices or arrangements for the control of light using movable or deformable optical elements control of light by modification of the optical properties of the media of the elements involved therein G02F1/00
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/1066 for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view
• CPC Class Codes: G02B 27/144 using partially transparent surfaces without spectral selectivity G02B27/147 takes precedence
• CPC Class Codes: G02B 27/283 used for beam splitting or combining
• CPC Class Codes: G02B 5/04 Prisms
• CPC Class Codes: G03B 37/02 with scanning movement of lens or cameras
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

The present invention comprises a foveated imaging system capable of capturing a wide field of view image and a foveated image, where the foveated image is a controllable region of interest of the wide field of view image.

Claims

1. A clustered imaging system comprising:

at least two foveated imaging systems each configured to capture a wide field of view image composing an extended field of view of the clustered imaging system, wherein each wide field of view image has at least one intersection at a neighboring field of view image boundary between the at least two wide field of view images of the least two foveated imaging systems,

wherein each of the at least two foveated imaging systems system comprise;

an objective lens, facing an external scene, configured to receive incoming light from an external scene and to focus the incoming light upon a beamsplitter;

the beamsplitter, configured to split the incoming light from the external scene into a first portion on a wide field of view imaging path and a second portion on a foveated imaging path;

the wide field of view imaging path comprising;

a first stop, separate from the objective lens, which limits the amount of the first portion received in the wide field of view path from the beamsplitter;

a wide field of view imaging lens, different from the objective lens and configured to receive the first portion from the first stop and focus the first portion on a wide field of view imaging sensor;

the wide field of view imaging sensor, configured to record the first portion light as the wide field of view image;

the foveated imaging path consisting of;

a second stop, which limits the second portion received in the foveated imaging path from the beamsplitter;

a multi-axis scanning mirror configured to selectively reflect the second portion as an identified region of interest back towards the beamsplitter;

a reflective surface disposed upon the beamsplitter, configured to direct the identified region of interest reflected by the scanning mirror;

a foveated imaging lens, configured to form the identified region of interest directed by the reflective surface on a foveated imaging sensor; and

the foveated imaging sensor, configured to record the identified region of interest from the foveated imaging lens as a higher resolution foveated image,

wherein the clustered foveated image system is configured to display at least one higher resolution foveated image from the at least two foveated imaging systems within the extended field of view image.

2. The clustered imaging system according to claim 1, wherein the neighboring field of view image boundary between the at least two foveated imaging systems overlaps.

3. The clustered imaging system according to claim 1, further comprising a multi-faceted mirror configured to create a single common viewpoint within the extended field of view.