Endoscope with integrated measurement of distance to objects of interest

• US 10,401,611 B2
• Filed: 04/25/2016
• Issued: 09/03/2019
• Est. Priority Date: 04/27/2015
• Status: Active Grant

• Current Assignee: EndoChoice Incorporated (Boston Scientific Corporation)
• Original Assignee: EndoChoice Incorporated (Boston Scientific Corporation)
• Inventors: Stith, Curtis William, Jakl, Edward Andrew
• Primary Examiner(s): Neal, Timothy J
• Assistant Examiner(s): Chou, William B
• Application Number:
  US15/137,760
• Publication Number:
  US 20160309992A1
• Time in Patent Office: Days
• Field of Search: 600109, 600110, 600111, 600112, 600117, 600181, 600182, 348 45, 348 65, 348294, 348340, 250200, 250216
• CPC Class Codes: A61B 1/00006 of control signals
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00057 provided with means for testing or calibration
• CPC Class Codes: A61B 1/0011 Manufacturing of endoscope parts
• CPC Class Codes: A61B 1/00188 with focusing or zooming features
• CPC Class Codes: G02B 23/2415 Stereoscopic endoscopes
• CPC Class Codes: G02B 23/2423 of the distal end
• CPC Class Codes: G02B 7/04 with mechanism for focusing or varying magnification
• CPC Class Codes: G02B 7/28 Systems for automatic generation of focusing signals
• CPC Class Codes: G02B 7/34 using different areas in a pupil plane

Abstract

The present specification describes a method for determining the distance of an object from the tip of an endoscope during an endoscopic procedure, wherein at least one lens is configured to converge light from outside the tip onto a sensor that includes a plurality of photodiodes a portion of which are adjacent pairs of photodiodes configured to be phase detection pixels. The method includes receiving light into each adjacent pair of photodiodes, wherein said light is reflected off a surface of said object; determining a first response curve to said light for a first photodiode of said adjacent pair of photodiodes and a second response curve to said light for a second photodiode of said adjacent pair of photodiodes; identifying an intersection between the first response curve and the second response curve; and using data derived from said intersection to determine said distance to the object.

Claims

1. A method for determining a distance of an object from a tip of an endoscope during an endoscopic procedure, wherein said tip comprises a housing having a distal end and a curved side wall and a first viewing element positioned on said distal end, wherein said first viewing element comprises at least one lens and a sensor, wherein the at least one lens is configured to converge light from outside said tip onto said sensor, wherein said sensor comprises a plurality of photodiodes and wherein a portion of said plurality of photodiodes are adjacent pairs of photodiodes configured to be phase detection pixels, said method comprising:

receiving light into each adjacent pair of photodiodes, wherein said light is reflected off a surface of said object;

determining, for a first photodiode of said adjacent pair of photodiodes, a first response curve of the first photodiode to said light, and determining, for a second photodiode of said adjacent pair of photodiodes, a second response curve of the second photodiode to said light;

identifying an intersection between the first response curve and the second response curve; and

using data derived from said intersection to determine said distance to the object.

2. The method of claim 1 wherein at least 98% of said plurality of photodiodes are not phase detection pixels.

3. The method of claim 1 wherein said sensor is divided into four quadrants and wherein an equal number of phase detection pixels are present in each of said four quadrants.

4. The method of claim 1 wherein a single microlens is disposed between said at least one lens and each adjacent pair of photodiodes.

5. The method of claim 4 wherein a single color filter is disposed between said single microlens and each adjacent pair of photodiodes.

6. The method of claim 5 wherein a first photodiode of said adjacent pair of photodiodes comprises a light opaque mask covering a right portion of said first photodiode and a second photodiode of said adjacent pair of photodiodes comprises a light opaque mask covering a left portion of said second photodiode.

7. The method of claim 6 wherein a length of the right portion is equal to a length of the left portion.

8. The method of claim 1 wherein a first microlens is disposed between said at least one lens and a first photodiode of the adjacent pair of photodiodes and a second microlens, separate from the first microlens, is disposed between said at least one lens and a second photodiode of the adjacent pair of photodiodes.

9. The method of claim 8 wherein a first color filter is disposed between said first microlens and the first photodiode of the adjacent pair of photodiodes and a second color filter, separate from the first color filter, is disposed between said second microlens and the second photodiode of the adjacent pair of photodiodes.

10. The method of claim 9 wherein the first photodiode of said adjacent pair of photodiodes comprises a light opaque mask covering a right portion of said first photodiode and the second photodiode of said adjacent pair of photodiodes comprises a light opaque mask covering a left portion of said second photodiode.

11. The method of claim 10 wherein a length of the right portion is equal to a length of the left portion.

12. The method of claim 1 wherein said data derived from said intersection comprises an angle of incidence of said light and wherein said angle of incidence is equal for each photodiode in a given adjacent pair of photodiodes.

13. The method of claim 1 further comprising using a processor to apply a first gain to light response data from each of the phase detection pixels, wherein the light response data is the data generated from a signal from at least one of the first photodiode and the second photodiode, where the signal is indicative of the amount of light received by that photodiode.

14. The method of claim 13 further comprising using the processor to apply a second gain to light response data from the plurality of photodiodes other than the phase detection pixels wherein the first gain is larger than the second gain.

15. The method of claim 1 further comprising using a processor to remove light response data generated from at least some of the phase detection pixels from an image and to replace said light response data generated from at least some of the phase detection pixels with light response data derived from photodiodes other than the phase detection pixels.

16. The method of claim 1, wherein said tip further comprises a second viewing element positioned on said curved side wall, wherein said second viewing element comprises at least one second viewing element lens and a second viewing element sensor, wherein the at least one second viewing element lens is configured to converge light from outside said tip onto said second viewing element sensor, wherein said second viewing element sensor comprises a plurality of photodiodes, wherein a portion of said plurality of photodiodes are adjacent pairs of photodiodes configured to be phase detection pixels, and wherein at least 98% of said plurality of photodiodes are not phase detection pixels.

17. The method of claim 16 wherein said second viewing element sensor is divided into four quadrants and wherein an equal number of phase detection pixels are present in each of said four quadrants.

18. The method of claim 1, wherein said first viewing element comprises a CCD sensor.

19. The method of claim 1, wherein said first viewing element comprises a CMOS sensor.

20. The method of claim 1, wherein using data derived from said intersection to determine said distance to the object includes:

determining an angle of incidence of the received light using

     1) the intersection between the first response curve and the second response curve and

     2) at least one lens characteristic of the at least one lens.

21. A method for determining a distance of an object from a tip of an endoscope during an endoscopic procedure, wherein said tip comprises a housing having a distal end and a curved side wall and a viewing element positioned on said distal end, wherein said viewing element comprises at least one lens and a sensor, wherein the at least one lens is configured to converge light from outside said tip onto said sensor, wherein said sensor comprises a plurality of photodiodes and wherein a portion of said plurality of photodiodes are adjacent pairs of photodiodes configured to be phase detection pixels, said method comprising:

receiving light into each adjacent pair of photodiodes, wherein said light is reflected off a surface of said object;

determining, for a first photodiode of said adjacent pair of photodiodes, a first response of the first photodiode to said light, and determining, for a second photodiode of said adjacent pair of photodiodes, a second response of the second photodiode to said light;

identifying a value indicative of an intersection point between the first response and the second response; and

using data derived from said value to determine said distance to the object.

22. The method of claim 21 wherein at least 98% of said plurality of photodiodes are not phase detection pixels.

23. The method of claim 21 wherein at most 2% of said plurality of photodiodes are phase detection pixels.

24. A method for determining a distance of an object from a tip of an endoscope during an endoscopic procedure, wherein said tip comprises a housing having a distal end and a curved side wall and a first viewing element positioned on said distal end, wherein said viewing element comprises at least one lens and a sensor, wherein the at least one lens is configured to converge light from outside said tip onto said sensor, wherein said sensor comprises a plurality of photodiodes and wherein a portion of said plurality of photodiodes are adjacent pairs of photodiodes configured to be phase detection pixels, said method comprising:

receiving light into each adjacent pair of photodiodes, wherein said light is reflected off a surface of said object, and wherein said received light induces a response in each of the adjacent pair of photodiodes;

determining an intersection point between a first response curve, of a first photodiode of said adjacent pair of photodiodes, to said light, and a second response curve, of a second photodiode of said adjacent pair of photodiodes, to said light; and

using data derived from said intersection point to determine said distance to the object.