CAMERA SYSTEM AND METHOD FOR AMALGAMATING IMAGES TO CREATE AN OMNI-FOCUSED IMAGE

• US 20100265346A1
• Filed: 12/13/2007
• Published: 10/21/2010
• Est. Priority Date: 12/13/2007
• Status: Active Grant

• Current Assignee: Keigo Iizuka
• Original Assignee: Keigo Iizuka
• Inventors: Iizuka, Keigo
• Granted Patent: US 8,384,803 B2
• Time in Patent Office: Days
• US Class Current: 348/218.100
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 23/743 Bracketing, i.e. taking a series of images with varying exposure conditions
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

This invention relates to a system and method for creating an omni-focused image. Specifically, this invention relates to a system and method for electronically amalgamating images using real-time distance information to create an omni-focused image. The system of the invention comprises one or more video cameras aimed at a scene each generating a video output focused at a different distance, a distance mapping camera providing distance information for one or more objects in the scene, and a pixel selection utility wherein the pixel selection utility uses the distance information to select pixels from the video outputs to be used to generate a video display. The system is then operable to focus and amalgamate the video outputs to produce one image with multiple focal points or an omni-focused image.

Claims

1. An image system comprising:

a) one or more video cameras aimed at a scene each generating a video output focused at a different distance;

b) a distance mapping camera providing distance information for one or more objects in the scene; and

c) a pixel selection utility wherein the pixel selection utility uses the distance information to select pixels from the video outputs to be used to generate a video display;

wherein the system is operable to focus and amalgamate the video outputs to produce one image with multiple focal points.

2. The system as claimed in claim 1 wherein the video output, the distance information, and the video display are substantially synchronized.

3. The system as claimed in claim 2 wherein the video output and the distance information are synchronized by means of a general sync signal and the single video display is synchronized by means of a sync adder.

4. The system as claimed in claim 2 wherein the size of the video output is adjustable by means of a size adjuster.

5. The system as claimed in claim 1 wherein the distance mapping camera is a Divergence Ratio Axi-vision Camera.

6. The system as claimed in claim 3 wherein the distance information is converted into binary coded decimal.

7. The system as claimed in claim 6 wherein the pixel switch may be further implemented by means of a latching mechanism and a series of AND gates.

8. The system as claimed in claim 7 wherein the latching mechanism may be further comprised of at least two comparator pairs.

9. The system as claimed in claim 8 wherein the comparator pairs of the latching mechanism compare the binary coded decimal distance information to latched predetermined threshold voltages to generate a latch output.

10. The system as claimed in claim 9 wherein the latch output is used by the series of AND gates to select individual pixels from the video output to generate the video display.

11. The system as claimed in claim 7 wherein the latching mechanism is implemented by means of latching in an integrated circuit.

12. The system as claimed in claim 1 wherein 2 to N video cameras may be incorporated into the system focused at up to N−

1 different distances.

13. The system as claimed in claim 1 wherein only one video camera is provided, the video camera being operable to produce a plurality of video outputs each focused at different distances and store the video outputs to a memory means linked to the system, wherein the video display is generated from the video outputs stored to the memory means.

14. The system as claimed in claim 1 wherein the video cameras output video images simultaneously and the distance mapping camera provides the distance information in real time.

15. The system as claimed in claim 1 wherein the system provides an endoscope.

16. The system as claimed in claim 1 wherein the system provides a laparoscope.

17. The system as claimed in claim 12 wherein the system provides a means to produce a single set of frames corresponding to a moving image focused at multiple points.

18. A method for amalgamating one or more video outputs aimed at a scene and focused at one or more distances to produce one image with multiple focal points comprising the steps of:

a) providing one or more video cameras, each video camera aimed at a scene and focused at a distance, each video camera operable to generate a video output;

b) further providing a distance mapping camera also aimed at the scene wherein the distance mapping camera provides distance information corresponding to one or more objects in the scene; and

c) generating a video display by selecting pixels from the video outputs using the distance information linking the one or more video cameras and the distance mapping camera with a pixel selection utility operable to use the distance information from the distance mapping camera to select individual pixels from the video outputs to be used to generate a single video display.

19. The method as claimed in claim 18 wherein the video cameras output video images simultaneously and the distance mapping camera provides the distance information in real time.

20. The method as claimed in claim 19 wherein at least two video cameras are provided to generate the video outputs.

21. The method as claimed in claim 18 comprising the further step of adjusting the size of the video outputs to ensure that the video outputs are congruent.

22. The method as claimed in claim 18 wherein the pixel selection utility is a pixel switch operable to select, one pixel at a time, the particular video output associated with the distance information of the object corresponding to the pixel.

23. The method as claimed in claim 18 comprising the further step of synchronizing the video output, the distance information, and the video display.

24. The method as claimed in claim 23 wherein the synchronization is enabled externally to the cameras.

25. The method as claimed in claim 23 wherein the synchronization is provided by means of sync separator means is generated by one or more of the cameras.

26. The method as claimed in claim 18 wherein the pixel utility is associated with the one or more video cameras and the distance mapping camera, the method further comprising the steps of:

a) associating an analog output of each video camera with an input of an analog to digital conversion means; and

b) associating an output of the analog to digital conversion means with an input of the pixel utility.