Image sensor synchronization without input clock and data transmission clock

• US 10,517,469 B2
• Filed: 03/15/2014
• Issued: 12/31/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Depuy Synthes Products Incorporated (Johnson & Johnson)
• Original Assignee: Depuy Synthes Products Incorporated (Johnson & Johnson)
• Inventors: Blanquart, Laurent, Wichern, Donald M.
• Primary Examiner(s): Atala, Jamie J
• Assistant Examiner(s): Abouzahra, Hesham K
• Application Number:
  US14/214,790
• Publication Number:
  US 20140285645A1
• Time in Patent Office: 2,117 Days
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 25/745 Circuitry for generating timing or clock signals

Abstract

An endoscopic system for use a controlled light environment is disclosed. In an implementation, the system may include an endoscope having an image sensor, an emitter, and a control circuit. The control circuit controls a frequency of the emitter in response to signals that correspond to the frequency of the emitter. The image sensor has input and output pads, where a pad count is reduced by not having a dedicated input synchronization clock pad. A frame period is divided into three defined states: a rolling-readout state during which image data is output through the pads, a service-line state during which non-image data is output through the pads, and a configuration state during which instruction data is received by the image sensor through the pads. Signal transitions are encoded within output data from the image sensor and correspond with defined states.

Claims

1. An endoscopic system for use in a light deficient environment comprising:

an endoscope comprising an image sensor located at a distal end of the endoscope;

a control circuit in electronic communication with the image sensor;

an oscillator disposed in the control circuit;

wherein the image sensor comprises;

a plurality of bidirectional data pads wherein there is no dedicated input synchronization clock pad, such that a number of bidirectional pads is reduced thereby reducing an area of the image sensor;

wherein electronic communication through each of the bidirectional pads is performed in three defined phases;

a rolling-readout phase during which image data is output from the image sensor through the bidirectional pads to the control circuit,

a service-line phase during which non-image data is output from the image sensor through the bidirectional pads to the control circuit, and

a configuration phase during which image sensor configuration data is received by the image sensor from the control circuit through the bidirectional pads, wherein image sensor data output lines are reversed during the configuration phase and a clock data recovery circuit is unlocked from the oscillator when the sensor data output lines are reversed,

a frequency detector connected to the control circuit to control a clock frequency of the image sensor in response to signals from the control circuit that correspond to the frequency of the oscillator;

wherein signal transitions are encoded within output data from the image sensor in correspondence to the defined phases of the bidirectional pads.

2. The endoscopic system of claim 1, wherein the output data comprises signal transitions as service lines within frame data.

3. The endoscopic system of claim 1, wherein a camera control unit includes a camera control unit oscillator that provides a reference clock frequency to the frequency detector to synchronize incoming sensor data.

4. The endoscopic system of claim 1, wherein a data recovery circuit located within a camera control unit is used to lock on incoming sensor data to keep it synchronized.

5. The endoscopic system of claim 1, further comprising at least one transition within each pixel serial data created within a pixel array of the image sensor.

6. The endoscopic system of claim 5, further comprising at least one transition during a series of a plurality pixel data sets created by the pixel array.

7. The endoscopic system of claim 5, further comprising a plurality of transitions within each pixel serial data created by the pixel array.

8. The endoscopic system of claim 5, wherein pixel data is replaced in the pixel array according to synchronization determined by clock signal data.

9. The endoscopic system of claim 1, wherein non-image data is replaced with clock signal data within at least one service line phase of one frame period.

10. The endoscopic system of claim 1, wherein non-image data is replaced with clock signal data within the configuration phase.

11. The endoscopic system of claim 1, wherein clock signal data is transmitted during all frame period phases except during the rolling-readout phase.

12. The endoscopic system of claim 1, further comprising a Phase Lock Loop built with blocks of the image sensor and blocks of a camera control unit.

13. The endoscopic system of claim 12, further comprising data lines and configuration lines electrically connecting together sensor Phase Lock Loop blocks and camera control unit Phase Lock Loop blocks.

14. The endoscopic system of claim 13, wherein a camera control unit oscillator and a data recovery circuit are used to lock on to incoming sensor data.

15. The endoscopic system of claim 1, wherein the bidirectional data pads issue image data during a defined portion of a frame period.

16. The endoscopic system of claim 15, wherein the bidirectional data pads issue a plurality of types of data during and corresponding to a plurality of portions of frame data output.

17. The endoscopic system of claim 16, wherein the bidirectional data pads are configured to switch direction and receive commands from external system components during a third defined time period of the frame period while in receive mode.

18. The endoscopic system of claim 1, wherein the oscillator is a Voltage Controlled Oscillator, and wherein the system further comprises a Phase Loop Lock based on a charge pump for driving the Voltage Controlled Oscillator.

19. The endoscopic system of claim 18, further comprising Phase Loop Lock based on a Digital to Analog Convertor for driving the Voltage Controlled Oscillator.

20. The endoscopic system of claim 1, further comprising a sensor configuration register to store changes in resultant operating frequency.

21. The endoscopic system of claim 1, further comprising a camera control unit oscillator disposed in camera control unit which is configured as a Phase Lock Loop reference clock.

22. The endoscopic system of claim 1, further comprising a Phase Lock Loop based on differing voltage strength pushes.

23. An endoscopic system for use in a light deficient environment comprising:

a camera control unit;

an endoscope that is in electronic communication with the camera control unit, the endoscope comprising an image sensor located in a distal end of the endoscope;

a control circuit in electronic communication with the image sensor and a frequency detector, wherein the frequency detector controls a frequency of the image sensor in response to signals from the control circuit that correspond to the frequency of an oscillator disposed in the control circuit;

wherein the image sensor comprises a plurality of bidirectional pads, wherein there is no dedicated input synchronization clock pad such that a number of bidirectional pads is reduced thereby reducing an area of the image sensor;

wherein electronic communication through each of the bidirectional pads is performed in three defined phases;

a rolling-readout phase during which image data is output from the image sensor through the bidirectional pads to the camera control unit,

a service-line phase during which non-image data comprising synchronization data of the image sensor to the control unit is output from the image sensor through the bidirectional pads to the control circuit, and

a configuration phase during which image sensor configuration data is received by the image sensor from the control circuit through the bidirectional pads wherein image sensor data output lines are reversed during the configuration phase and a clock data recovery circuit is unlocked from the oscillator when the sensor data output lines are reversed;

wherein signal transitions are encoded within output data from the image sensor that correspond to the defined phases of the bidirectional pads.