Interface for viewing video from cameras on a surgical visualization system

• US 9,681,796 B2
• Filed: 11/10/2014
• Issued: 06/20/2017
• Est. Priority Date: 06/27/2012
• Status: Active Grant

• Current Assignee: CamPlex, Inc.
• Original Assignee: CamPlex, Inc.
• Inventors: Tesar, John, Charles, Steven T.
• Primary Examiner(s): Hammond, Ellen C
• Application Number:
  US14/537,524
• Publication Number:
  US 20150141759A1
• Time in Patent Office: 953 Days
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/0004 for electronic operation
• CPC Class Codes: A61B 1/00045 Display arrangement
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00149 using articulated arms
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/051 Details of CCD assembly
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61B 1/32 Devices for opening or enlarging the visual field, e.g. of a tube of the body dilators A61M29/00
• CPC Class Codes: A61B 17/00 Surgical instruments, devices or methods, e.g. tourniquets A61B18/00 takes precedence; contraceptive devices, pessaries, or applicators therefor A61F6/00; eye surgery A61F9/007; ear surgery A61F11/00
• CPC Class Codes: A61B 17/02 for holding wounds open; Tractors specula A61B1/32 ; drainage appliances for wounds A61M27/00
• CPC Class Codes: A61B 17/0206 with antagonistic arms as supports for retractor elements
• CPC Class Codes: A61B 17/0218 for minimally invasive surgery A61B17/0281, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence
• CPC Class Codes: A61B 17/025 Joint distractors
• CPC Class Codes: A61B 17/0293 with ring member to support retractor elements
• CPC Class Codes: A61B 17/16 Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans arthroscopic bone cutters A61B17/320016; dental implant drills potentially for other surgical use A61C8/0089; bone grinders A61F2/4644, A22C17/06; A61B17/1662 takes precedence over all other subgroups except A61B17/17
• CPC Class Codes: A61B 17/1604 Chisels; Rongeurs; Punches; Stamps
• CPC Class Codes: A61B 17/1628 Motors; Power supplies
• CPC Class Codes: A61B 17/1644 using fluid other than turbine drive fluid
• CPC Class Codes: A61B 17/3211 : Surgical scalpels, knives; Accessories therefor
• CPC Class Codes: A61B 2017/00207 : with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2017/0256 : for the spine
• CPC Class Codes: A61B 2090/371 : with simultaneous use of two cameras
• CPC Class Codes: A61B 2576/00 : Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 34/20 : Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/0077 : Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/7425 : Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: A61B 5/7475 : User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61B 50/13 : Trolleys, e.g. carts
• CPC Class Codes: A61B 50/15 : Mayo stands; Tables
• CPC Class Codes: A61B 90/20 : Surgical microscopes characterised by non-optical aspects
• CPC Class Codes: A61B 90/30 : Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
• CPC Class Codes: A61B 90/361 : Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation

Abstract

A surgical device includes a plurality of cameras integrated therein. The view of each of the plurality of cameras can be integrated together to provide a composite image. A surgical tool that includes an integrated camera may be used in conjunction with the surgical device. The image produced by the camera integrated with the surgical tool may be associated with the composite image generated by the plurality of cameras integrated in the surgical device. The position and orientation of the cameras and/or the surgical tool can be tracked, and the surgical tool can be rendered as transparent on the composite image. A surgical device may be powered by a hydraulic system, thereby reducing electromagnetic interference with tracking devices.

Claims

1. A surgical visualization system comprising:

a plurality of cameras configured to acquire video images of a surgical site, at least one of the plurality of cameras being an endoscope camera and configured to acquire video images within the surgical site;

an auxiliary optical assembly comprising at least one of the plurality of cameras, the at least one of the plurality of cameras being a surgical microscope camera having a field of view that can be configured to include the surgical site, wherein the surgical microscope camera is configured to provide a surgical microscope view of the surgical site;

a binocular viewing assembly comprising a housing and a plurality of oculars, the plurality of oculars configured to provide views of at least one display disposed in the housing, the plurality of oculars comprising a left ocular and a right ocular each being tubular;

a viewing articulating arm, the binocular viewing assembly disposed on the viewing articulating arm, the viewing articulating arm configured to adjust a position of the binocular viewing assembly;

a second articulating arm, the auxiliary optical assembly disposed on the second articulating arm so that the auxiliary optical assembly can be positioned independently of the binocular viewing assembly; and

an image processing system in communication with the at least one display and the plurality of cameras including the surgical microscope camera, the image processing system comprising processing electronics,

wherein the image processing system is configured to;

receive the video images acquired by the plurality of cameras including the surgical microscope camera;

receive input from a user indicating a selection of the endoscope camera or the surgical microscope camera;

based on the selection, switch between providing output video images based on the video images acquired by the endoscope camera and providing output video images based on the video images acquired by the surgical microscope camera; and

display on the at least one display disposed in the housing the output video images that are provided based on the selection, the output video images comprising video images acquired by the endoscope camera, video images acquired by the surgical microscope camera, or both video images acquired by the endoscope camera and video images acquired by the surgical microscope camera,

wherein the surgical microscope camera is not coupled to a direct view surgical microscope, and

wherein the auxiliary optical assembly is smaller than the binocular viewing assembly.

2. The system of claim 1, wherein the surgical microscope camera comprises a 3-D camera and the at least one display is configured to provide 3-D viewing of images from the 3-D camera.

3. The system of claim 1, wherein the surgical microscope camera providing the surgical microscope view has a working distance between about 15 cm and about 45 cm.

4. The system of claim 3, wherein the surgical microscope camera has a variable magnification.

5. The system of claim 1, further comprising a support, the viewing articulating arm attached to the support such that the viewing articulating arm can move relative to the support.

6. The system of claim 1, further comprising a surgical retractor configured to hold open a surgical incision and thereby provide a pathway for access of surgical tools to a surgical site.

7. The system of claim 6, further comprising a retractor camera configured to acquire video images of the surgical site, the retractor camera being disposed on the surgical retractor and configured to acquire video images within an opening to which the surgical retractor provides access, wherein the retractor camera has an electromagnetic tracking device associated therewith to track its position.

8. The system of claim 1, wherein the binocular viewing assembly further comprises at least one redirection element comprising a reflective surface, the at least one redirection element disposed in the housing to redirect an optical path of video images from the at least one display to the plurality of oculars.

9. The system of claim 1, wherein the surgical microscope camera is coupled to the housing of the binocular viewing assembly.

10. The system of claim 1, wherein at least two of the plurality of cameras have tracking devices associated therewith to track the relative positions of the at least two cameras with respect to each other.

11. The system of claim 10, wherein said tracking devices comprise electromagnetic tracking devices.

12. The system of claim 1, wherein the surgical microscope camera has an optical input for receiving light from the surgical site and the distance from the plurality of oculars to the optical input of the surgical microscope camera is not larger than the size of the binocular viewing assembly such that when in use, a surgeon can ergonomically perform surgery at a surgical site beneath the auxiliary optical assembly while viewing through the plurality of oculars the output video images of the surgical site displayed on the at least one display.

13. The system of claim 1, wherein the at least one display has a resolution in excess of 300 ppi.

14. The system of claim 1, wherein the image processing system is configured to:

receive an image acquired by an imaging modality;

receive input from the user indicating a selection of the endoscope camera, the surgical microscope camera, or the imaging modality;

based on the selection, switch among providing output video images based on the video images acquired by the endoscope camera, providing output video images based on the video images acquired by the surgical microscope camera, and providing output video images based on the image acquired by the imaging modality; and

display on the at least one display disposed in the housing the output video images that are provided based on the selection, the output video images comprising video images acquired by the endoscope camera, video images acquired by the surgical microscope camera, images acquired by the imaging modality, or a combination thereof.

15. The system of claim 14, wherein the imaging modality is an MRI, CT, x-ray, C-arm, O-arm, or ultrasound.

16. The system of claim 1, wherein one or more of the plurality of cameras have an associated light source to provide illumination for viewing the surgical site.

17. The system of claim 1, further comprising an external monitor.

18. The system of claim 17, wherein the external monitor is disposed on an arm.

19. The system of claim 1, further comprising two external monitors.

20. The system of claim 19, wherein at least one of the two external monitors is disposed on an arm.

21. The system of claim 1, wherein the image processing system comprises a user interface to control the images on the at least one display.

22. The system of claim 1, wherein the auxiliary optical assembly comprises a left-eye camera and a right-eye camera included in the plurality of cameras, the left-eye camera and the right-eye camera configured to provide a stereoscopic surgical microscope view of the surgical site.

23. The system of claim 1, wherein the at least one display comprises at least two displays configured to provide 3-D viewing of images from one or more of the plurality of cameras.

24. The system of claim 1, wherein the left and right oculars are configured to provide stereoscopic vision.