OPTICAL SCOPE SYSTEM FOR CAPTURING AN IMAGE OF A SCENE

• US 20190327421A1
• Filed: 12/14/2017
• Published: 10/24/2019
• Est. Priority Date: 12/16/2016
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Emmerich, Thimo, Facius, Zoltan, Springer, Paul
• Granted Patent: US 11,146,723 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 1/00188 with focusing or zooming features
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: G02B 23/2484 Arrangements in relation to a camera or imaging device processing or control of video signals generated by an endoscope H04N23/60, H04N23/70
• CPC Class Codes: G02B 7/36 using image sharpness techniques , e.g. image processing techniques for generating autofocus signals image data processing per se G06T; in cameras having a solid state image sensor H04N23/67
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 23/16 Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 23/617 Upgrading or updating of programs or applications for camera control
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 23/676 Bracketing for image capture at varying focusing conditions
• CPC Class Codes: H04N 23/743 Bracketing, i.e. taking a series of images with varying exposure conditions
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 23/959 by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics

Abstract

An optical device for capturing an image of a scene, the optical device comprising: a plurality of image sensors each operable to capture a respective initial image of the scene; a lens arrangement operable to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the lens arrangement; and an image processor operable to generate the captured image of the scene on the basis of image data from one or more of the captured initial images.

Claims

1. An optical scope system for capturing an image of a scene, the endoscope system comprising:

a plurality of image sensors each operable to capture a respective initial image of the scene;

a lens arrangement operable to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the lens arrangement; and

an image processor operable to generate the captured image of the scene on the basis of image data from one or more of the captured initial images.

2. The optical scope system according to claim 1, wherein the image processor is operable to:

determine an image sharpness level for corresponding portions of each of the captured initial images;

determine the highest one of the determined image sharpness levels; and

generate, on the basis of image data from each of the captured initial images, the captured image of the scene so that a portion of the captured image of the scene corresponding to the corresponding portions of each of the captured initial images has a sharpness level equal to the determined highest image sharpness level.

3. The optical scope system according to claim 2, wherein:

each of the image sensors is operable to capture light using each of red, green and blue (RGB) colour channels; and

the image processor is operable to generate the portion of the captured image of the scene corresponding to the corresponding portions the captured initial images on the basis of the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level.

4. The optical scope system according to claim 2, wherein:

each of the image sensors is operable to capture light using a different respective one of red, green and blue (RGB) colour channels; and

the image processor is operable to generate the portion of the captured image of the scene corresponding to the corresponding portions of the captured initial images by;

transporting the image sharpness level of the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level to the other corresponding portions of the captured initial images; and

combining the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level with the other corresponding portions of the captured initial images to which the determined highest image sharpness level has been transported.

5. The optical scope system according to claim 1, wherein each of the plurality of image sensors is located along a different respective optical path with respect to the lens arrangement.

6. The optical scope system according to claim 1, wherein the lens arrangement is operable to receive light from the scene captured by an optical instrument and to form the initial image of the scene on each image sensor using the received light, wherein the distance of each respective image sensor from the lens arrangement is determined on the basis of one or more characteristics of the optical instrument.

7. The optical scope system according to claim 6, comprising a plurality of image sensor adjustment devices each operable to adjust the distance of a respective one of the image sensors from the lens arrangement.

8. The optical scope system according to claim 7, comprising:

a user interface operable to receive information from a user for determining the distance of each respective image sensor from the lens arrangement; and

a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the lens arrangement on the basis the received information.

9. The optical scope system according to claim 7, comprising:

an instrument interface operable to receive information from the optical instrument for determining the distance of each respective image sensor from the lens arrangement; and

a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the lens arrangement on the basis the received information.

10. The optical scope system according to claim 9, wherein the information for determining the distance of each respective image sensor from the lens arrangement comprises (a) the distance of each respective image sensor from the lens arrangement, (b) one or more optical properties of the optical instrument on the basis of which the controller is configured to calculate the distance of each respective image sensor from the lens arrangement, or (c) an identifier of the optical instrument on the basis of which the controller is configured to consult a database in order to obtain the distance of each respective image sensor from the lens arrangement or the one or more optical properties of the optical instrument for calculating the distance of each respective image sensor from the lens arrangement.

11. The optical scope system according to claim 6, wherein the optical instrument is an endoscope.

12. The optical scope system according to claim 11, wherein the endoscope is a medical endoscope.

13. An endoscopic system comprising an optical scope system according to claim 6 and an optical instrument configured to capture light from the scene for use by the lens arrangement of the optical device in forming an initial image of the scene on each image sensor of the optical device.

14. A method of capturing an image of a scene in an optical scope system, the method comprising:

capturing a plurality of initial images of the scene, each initial image of the scene being captured using a respective one of a plurality of image sensors, wherein each image sensor is located at a different respective distance from a lens arrangement operable to receive light from the scene and to form each initial image on each respective image sensor; and

generating the captured image of the scene on the basis of image data from one or more of the captured initial images.

15. A recording medium storing a computer program for controlling a computer to perform a method according to claim 14.

16. An optical scope system for capturing an image of a scene comprising means configured to perform a method according to claim 14.