Minimize image sensor I/O and conductor counts in endoscope applications

• US 10,881,272 B2
• Filed: 05/21/2019
• Issued: 01/05/2021
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Depuy Synthes Products Incorporated (Johnson & Johnson)
• Original Assignee: Depuy Synthes Products Incorporated (Johnson & Johnson)
• Inventors: Blanquart, Laurent
• Primary Examiner(s): Billah, Masum
• Application Number:
  US16/418,871
• Publication Number:
  US 20190269304A1
• Time in Patent Office: 595 Days
• Field of Search: 348 76
• CPC Class Codes: A61B 1/00006 of control signals
• CPC Class Codes: A61B 1/00018 using electrical cables
• CPC Class Codes: A61B 1/00055 for alerting the user
• CPC Class Codes: A61B 1/00066 Proximal part of endoscope body, e.g. handles A61B1/0052 takes precedence
• CPC Class Codes: A61B 1/00124 electrical, e.g. electrical plug-and-socket connection
• CPC Class Codes: A61B 1/051 Details of CCD assembly
• CPC Class Codes: A61B 1/053 being detachable
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS

Abstract

The disclosure extends to systems and methods for reducing the area of an image sensor by employing bi-directional pads used for both image data issuance and configuration command reception and internal supply voltage generation, for reducing the number of conductors in an endoscope system.

Claims

1. An endoscopic device comprising:

an image sensor, having an area sufficient to be located near a tip of a distal end of the endoscopic device, the image sensor comprising;

a plurality of on-chip registers for configuring operation of the image sensor;

a plurality of bi-directional pads connected to the image sensor which all operate as pads to input and output digital data from the image sensor such that the number of pads necessary to exchange the input and output of digital data in the image sensor is reduced by combining digital input and output functionality into the same bidirectional pads; and

a state identifier that identifies what state each bi-directional pad of the plurality of bi-directional pads are in during an operation cycle of the device;

wherein the image sensor is configured to control each of the plurality of bi-directional pads to have an output state and an input state for sending and receiving data;

wherein electronic communication between a control circuit and the image sensor is performed through each of the bidirectional pads in a plurality of phases comprising;

a first service-line phase during which the bi-directional pads are in an output state and non-image data is output from the image sensor,

a rolling-readout phase following the first service-line phase and during which the bi-directional pads are in an output state and image data is output from the image sensor,

a second service-line phase, following the rolling-readout phase and during which the bi-directional pads are in an output state and non-image data is output from the image sensor, and

a configuration phase during which the bi-directional pads are in an input state and instruction data is received by the image sensor through the bi-directional pads.

2. The endoscopic device of claim 1, wherein during the rolling-readout phase, the first service-line phase, and the second service-line phase the endoscopic device does not issue slow-control commands.

3. The endoscopic device of claim 1, further comprising an emitter configured to illuminate a scene, wherein pulse control for the emitter corresponds to the plurality of bi-directional pad phases.

4. The endoscopic device of claim 3, wherein a pulse is emitted by the emitter during the configuration phase.

5. The endoscopic device of claim 3, wherein a pulse is emitted by the emitter during one of the first service-line phase and the second service-line phase.

6. The endoscopic device of claim 3, wherein a pulse is emitted by the emitter during the first service-line phase and the configuration phase.

7. An endoscopic system comprising:

a control unit; and

an endoscope comprising;

an image sensor having an area sufficient to be disposed near a tip of a distal end of a lumen of the endoscope, the image sensor comprising;

a plurality of on-chip registers for configuring operation of the image sensor;

a plurality of bi-directional pads connected to the image sensor which all operate as pads to input and output digital data from the image sensor such that the number of pads necessary to exchange the input and output of digital data in the image sensor is reduced by combining digital input and output functionality into the same bidirectional pads; and

a state identifier that identifies what state each bi-directional pad of the plurality of bi-directional pads are in during an operation cycle of the device;

wherein the endoscopic system is configured to control each of the plurality of bi-directional pads to have an output state and an input state for sending and receiving data;

wherein electronic communication between a control circuit and the image sensor is performed through each of the bidirectional pads in a plurality of phases comprising;

a first service-line phase during which the bi-directional pads are in an output state and non-image data is output from the image sensor,

a rolling-readout phase following the first service-line phase and during which the bi-directional pads are in an output state and image data is output from the image sensor,

a second service-line phase, following the rolling-readout phase and during which the bi-directional pads are in an output state and non-image data is output from the image sensor, and

a configuration phase during which the bi-directional pads are in an input state and instruction data is received by the image sensor through the bi-directional pads.

8. The endoscopic system of claim 7, further comprising a serial command protocol to electronically communicate with the image sensor when the bi-directional pads are in an input state.

9. The endoscopic system of claim 7, further comprising a protocol for configuring on-chip registers.

10. The endoscopic system of claim 7, further comprising a clock for coordinating function of external devices in electronic communication with the endoscopic system.

11. The endoscopic system of claim 7, wherein the image sensor is a minimal area CMOS image sensor.

12. The endoscopic system of claim 11, further comprising a voltage converter to provide power from an external power supply source to the image sensor.

13. The endoscopic system of claim 12, wherein the voltage converter is an up converter.

14. The endoscopic system of claim 12, wherein the voltage converter is a down converter.

15. The endoscopic system of claim 7, wherein the system further comprises at least one data line to a sensor.

16. The endoscopic system of claim 7, further comprising a switch-cap DC-DC converter;

an LDO converter;

or a switch-cap DC-DC converter and the LDO converter.

17. The endoscopic system of claim 7, wherein the endoscopic system is configured to provide analog data from the endoscope to the image sensor, and the system further comprises an analog to digital converter on the image sensor to receive external device data.

18. The endoscopic system of claim 7, wherein the endoscopic system uses a serial protocol to transmit digital data to the image sensor.

19. The endoscopic system of claim 7, wherein during the rolling-readout phase, the first service-line phase, and the second service-line phase, the endoscopic system does not issue slow-control commands.

20. The endoscopic system of claim 7, further comprising an emitter configured to illuminate a scene, wherein pulse control for the emitter corresponds to the plurality of bi-directional pad phases.

21. The endoscopic system of claim 20, wherein a pulse is emitted by the emitter during the second service-line phase and the configuration phase.

22. The endoscopic system of claim 20, wherein a pulse is emitted by the emitter during one of the first service-line phase and the second service-line phase.