Combined SBI and conventional image processor

• US 7,995,045 B2
• Filed: 04/13/2007
• Issued: 08/09/2011
• Est. Priority Date: 04/13/2007
• Status: Active Grant

• Current Assignee: Ethicon Endo-Surgery, Inc. (Johnson & Johnson)
• Original Assignee: Ethicon Endo-Surgery, Inc. (Johnson & Johnson)
• Inventors: Dunki-Jacobs, Robert J.
• Primary Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US11/786,858
• Publication Number:
  US 20080252778A1
• Time in Patent Office: 1,579 Days
• Field of Search: 345/204, 348/E3.009, 348/E5.078, 348/E5.09, 348/E7.084, 348/205, 348/441, 359/224
• US Class Current: 345/204
• CPC Class Codes: A61B 1/042 characterised by a proximal camera, e.g. a CCD camera
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2360/02 Graphics controller able to handle multiple formats, e.g. input or output formats
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 2370/12 Use of DVI or HDMI protocol in interfaces along the display data pipeline
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 3/30 otherwise than with constant velocity or otherwise than in pattern formed by unidirectional, straight, substantially horizontal or vertical lines

Abstract

An apparatus and method for allowing multiple high and low resolution SBI and conventional FPA imaging devices to use a common high resolution monitor and archive device without increasing or significantly changing the footprint of existing devices. This system and method uses a frame grabber for digitizing video from the legacy FPA devices, a frame mapper for rendering or mapping the FPA video into the SBI digital format, a converter for rasterizing SBI data streams into pixel-oriented FPA video frames, an input selector for selecting which FPA or SBI imaging device to display on a high resolution monitor, an processor for storing and manipulating frames of video, a video output encoder for converting the SBI frames into a video signal appropriate for display on the high resolution monitor, and an output means for connecting to a storage device for archiving video and images.

Claims

1. An FPA and SBI image processor for FPA and SBI imaging devices, the apparatus comprising:

a first input port that accepts a first SBI formatted digital sample data stream;

a second input port that accepts a video signal from an FPA video source;

an FPA processor that renders the video signal from the FPA video source to a second SBI formatted digital sample data stream;

a selector that selects an SBI formatted digital sample data stream from the first SBI formatted digital sample data streams and the second SBI formatted digital sample data streams for processing;

an SBI processor means for generating processed data by processing the selected SBI formatted digital sample data stream; and

an output port that outputs the processed data.

2. The apparatus of claim 1 further comprising a high resolution monitor adapted to accept the processed data from the output port.

3. The apparatus of claim 2 wherein the high resolution monitor is selected from the group consisting of:

an SBI compatible monitor; and

a pixel-oriented FPA compatible monitor.

4. The apparatus of claim 2 where the high resolution monitor is a wearable heads-up display.

5. The apparatus of claim 1 further comprising an archive that accepts the processed data from the output port.

6. The apparatus of claim 5 wherein the archive is selected from the group consisting of:

an SBI compatible archive; and

a pixel-oriented FPA compatible archive.

7. The apparatus of claim 1 where the FPA processor further comprises:

a frame grabber for acquiring an FPA video frame from the video signal; and

a frame mapper for rendering the FPA video frame into an SBI formatted digital sample data stream.

8. The apparatus of claim 1 where the FPA video source is one selected from the group consisting of:

the output of an FPA camera;

the output of a video recording device;

the output of an FPA video processor; and

a computer synthesized video stream.

9. An FPA and SBI image processor that allows both FPA and SBI imaging devices to use a common high resolution monitor and archive, the apparatus comprising:

an input port adapted for accepting a first SBI formatted digital sample data stream;

an input port adapted for accepting a video signal comprised of a first series of pixel-oriented video frames from an FPA video source;

a processor capable of (a) converting the first series of pixel-oriented video frames in the video signal to a second SBI formatted digital sample data stream;

(b) rasterizing the first SBI formatted digital sample data stream into a second series of pixel-oriented video frames;

(c) selecting a first output from the first SBI formatted digital sample data stream, the second SBI formatted digital sample data streams, the first series of pixel-oriented video frames, and the second series of pixel-oriented video frames; and

(d) rendering the first output to a suitable format for the high resolution monitor; and

an output port adapted for outputting the first output to the high resolution monitor.

10. The apparatus of claim 9 where the processor is capable of performing image enhancing algorithms on the first SBI formatted digital sample data stream, the second SBI formatted digital sample data streams, the first series of pixel-oriented video frames, and the second series of pixel-oriented video frames.

11. The apparatus of claim 9 where the output port includes circuitry and a physical connector for connecting to a high resolution pixel-oriented FPA monitor.

12. The apparatus of claim 9 where the processor is further capable of (e) selecting a second output from the first SBI formatted digital sample data stream, the second SBI formatted digital sample data streams, the first series of pixel-oriented video frames, and the second series of pixel-oriented video frames;

and further comprising;

an archive output port adapted for outputting the second output to the archive device when triggered by a user.

13. The apparatus of claim 12 where the archive output port includes circuitry and a physical connector for connecting to a pixel-oriented archive device.

14. The apparatus of claim 9 where the FPA video source is one selected from the group consisting of:

the output of an FPA camera;

the output of a video recording device;

the output of an FPA video processor; and

a computer synthesized video stream.

15. A method for allowing both an FPA video source and an SBI imaging device to use a common high resolution monitor and archive, the method comprising the steps of:

acquiring, as a first source, a series of pixel-oriented frames of video from the FPA video source;

inputting, as a second source, an SBI formatted digital sample data stream from the SBI imaging device;

selecting, as an output selection, one of the first source and the second source;

outputting the output selection to the high resolution monitor; and

triggering the output selection to be sent to the archive.

16. The method of claim 15, the method further comprising the step:

performing image enhancement processes on the output selection prior to outputting.

17. The method of claim 15, the method further comprising the step:

converting the first source into an SBI format.

18. The method of claim 15, the method further comprising the steps:

rasterizing the second source into a pixel-oriented FPA format; and

rendering the output selection to a suitable high resolution FPA video signal for use with the high resolution monitor.

19. An FPA and SBI image processor for FPA and SBI imaging devices, the apparatus comprising:

a first input port adapted for accepting a first SBI formatted digital sample data stream;

a second input port adapted for accepting a video signal from an FPA video source;

an FPA processor for rendering the video signal from the FPA video source to a second SBI formatted digital sample data stream, further comprising;

a frame grabber for acquiring an FPA video frame from the video signal; and

a frame mapper for rendering the FPA video frame into an SBI formatted digital sample data stream;

a selector for selecting an SBI formatted digital sample data stream from the first or second SBI formatted digital sample data streams for processing;

an SBI processor means for generating processed data by processing the selected SBI formatted digital sample data stream; and

an output port adapted for outputting the processed data.

20. The apparatus of claim 19 further comprising a high resolution monitor adapted to accept the processed data from the output port.

21. The apparatus of claim 20 wherein the high resolution monitor is selected from the group consisting of:

an SBI compatible monitor; and

a pixel-oriented FPA compatible monitor.

22. The apparatus of claim 20 where the high resolution monitor is a wearable heads-up display.

23. The apparatus of claim 19 further comprising an archive adapted to accept the processed data from the output port.

24. The apparatus of claim 23 wherein the archive is selected from the group consisting of:

an SBI compatible archive; and

a pixel-oriented FPA compatible archive.

25. The apparatus of claim 19 where the FPA video source is one selected from the group consisting of:

the output of an FPA camera;

the output of a video recording device;

the output of an FPA video processor; and

a computer synthesized video stream.

26. A method for allowing both an FPA video source and an SBI imaging device to use a common high resolution monitor and archive, the method comprising the steps of:

acquiring, as a first source, a series of pixel-oriented frames of video from the FPA video source;

inputting, as a second source, an SBI formatted digital sample data stream from the SBI imaging device;

rasterizing the second source into a pixel-oriented FPA format;

selecting, as an output selection, one of the first source and the second source;

rendering the output selection to a suitable high resolution FPA video signal for use with the high resolution monitor;

outputting the output selection to the high resolution monitor; and

triggering the output selection to be sent to the archive.