Interface for viewing video from cameras on a surgical visualization system

• US 8,882,662 B2
• Filed: 03/13/2013
• Issued: 11/11/2014
• Est. Priority Date: 06/27/2012
• Status: Active Grant

• Current Assignee: CamPlex, Inc.
• Original Assignee: CamPlex, Inc.
• Inventors: Charles, Steven T.
• Primary Examiner(s): Cumberledge, Jerry
• Application Number:
  US13/802,509
• Publication Number:
  US 20140005484A1
• Time in Patent Office: 608 Days
• Field of Search: 600201-246
• US Class Current: 600/214
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/0004 for electronic operation
• CPC Class Codes: A61B 1/00045 Display arrangement
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00149 using articulated arms
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/051 Details of CCD assembly
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61B 1/32 Devices for opening or enlarging the visual field, e.g. of a tube of the body dilators A61M29/00
• CPC Class Codes: A61B 17/00 Surgical instruments, devices or methods, e.g. tourniquets A61B18/00 takes precedence; contraceptive devices, pessaries, or applicators therefor A61F6/00; eye surgery A61F9/007; ear surgery A61F11/00
• CPC Class Codes: A61B 17/02 for holding wounds open; Tractors specula A61B1/32 ; drainage appliances for wounds A61M27/00
• CPC Class Codes: A61B 17/0206 with antagonistic arms as supports for retractor elements
• CPC Class Codes: A61B 17/0218 for minimally invasive surgery A61B17/0281, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence
• CPC Class Codes: A61B 17/025 Joint distractors
• CPC Class Codes: A61B 17/0293 with ring member to support retractor elements
• CPC Class Codes: A61B 17/16 Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans arthroscopic bone cutters A61B17/320016; dental implant drills potentially for other surgical use A61C8/0089; bone grinders A61F2/4644, A22C17/06; A61B17/1662 takes precedence over all other subgroups except A61B17/17
• CPC Class Codes: A61B 17/1604 Chisels; Rongeurs; Punches; Stamps
• CPC Class Codes: A61B 17/1628 Motors; Power supplies
• CPC Class Codes: A61B 17/1644 using fluid other than turbine drive fluid
• CPC Class Codes: A61B 17/3211 : Surgical scalpels, knives; Accessories therefor
• CPC Class Codes: A61B 2017/00207 : with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2017/0256 : for the spine
• CPC Class Codes: A61B 2090/371 : with simultaneous use of two cameras
• CPC Class Codes: A61B 2576/00 : Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 34/20 : Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/0077 : Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/7425 : Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: A61B 5/7475 : User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61B 50/13 : Trolleys, e.g. carts
• CPC Class Codes: A61B 50/15 : Mayo stands; Tables
• CPC Class Codes: A61B 90/20 : Surgical microscopes characterised by non-optical aspects
• CPC Class Codes: A61B 90/30 : Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
• CPC Class Codes: A61B 90/361 : Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation

Abstract

A surgical device includes a plurality of cameras integrated therein. The view of each of the plurality of cameras can be integrated together to provide a composite image. A surgical tool that includes an integrated camera may be used in conjunction with the surgical device. The image produced by the camera integrated with the surgical tool may be associated with the composite image generated by the plurality of cameras integrated in the surgical device. The position and orientation of the cameras and/or the surgical tool can be tracked, and the surgical tool can be rendered as transparent on the composite image. A surgical device may be powered by a hydraulic system, thereby reducing electromagnetic interference with tracking devices.

Claims

1. A surgical visualization system comprising:

a surgical retractor configured to hold open an incision and thereby provide a pathway for access of surgical tools to a surgical site, said retractor comprising portions configured to be disposed about an open central region centrally located between said retractor portions so as to permit access of surgical tools to the surgical site through said open central region;

a plurality of cameras configured to acquire video images of the surgical site, said plurality of cameras comprising at least two cameras disposed on the retractor and configured to acquire video images within said surgical site to which the retractor provides access, said at least two cameras directed inward toward said central open region and at least one of said at least two cameras directed downward into the surgical field; and

an image processing system in communication with the plurality of cameras, the image processing system comprising at least one physical processor,

wherein the image processing system is configured to;

receive the video images acquired by the plurality of cameras;

receive input from a user indicating a selection of at least one camera from the plurality of cameras;

provide output video images based on the video images acquired by the at least one selected camera; and

resize, arrange, or both resize and arrange the viewable output video images from the at least one selected camera to present them on a display according to received input.

2. The surgical visualization system of claim 1, wherein the image processing system is configured to increase a size of viewable output video images from a first selected camera in relation to simultaneously viewable output video images from a second camera based at least partly on received input.

3. The surgical visualization system of claim 1, wherein the image processing system is configured to arrange viewable output video images from a first selected camera in a more central location in relation to simultaneously viewable output video from a second camera based at least partly on received input.

4. The surgical visualization system of claim 1, wherein at least one of the viewable output video images are represented by a reduced-size real-time video stream that is configured to be presented on a graphical user interface for selection by a user, wherein the graphical user interface includes a representation of a position of the retractor and the plurality of cameras.

5. The surgical visualization system of claim 1, wherein at least one of the viewable output video images is represented by a reduced-size real-time video stream that is configured to be presented on a display for selection by a user, the reduced-size real-time video stream comprising video from the respective camera.

6. The surgical visualization system of claim 1, wherein the image processing system is (a) configured to display video images that are from a camera that is not selected and that are not displayed on the display after receiving input from the user indicating a selection thereof, (b) is configured to display video images that are from the camera that is not selected and that are displayed as a reduced-size real-time video stream more prominently after receiving input from the user indicating a selection thereof, or (c) configured as set forth in both (a) and (b).

7. The surgical visualization system of claim 1, wherein the image processing system is configured to present the output video images in a tiled format.

8. The surgical visualization system of claim 7, wherein the tiled output images comprise at least three images.

9. The surgical visualization system of claim 8, wherein the image processor is configured to rotate the tiled output images around a single, common axis.

10. The surgical visualization system of claim 7, wherein the tiled output images comprise at least four images.

11. The surgical visualization system of claim 1, wherein the output video images from at least two of the plurality of cameras are discontinuous.

12. The surgical visualization system of claim 1, wherein the at least one selected camera comprises a first camera disposed on the retractor in a position opposite a second camera also disposed on the retractor.

13. The surgical visualization system of claim 12, wherein the image processing system is further configured to cause video images from said first selected camera and video images from said second camera to be rotated 180°

with respect to each other.

14. The surgical visualization system of claim 1, wherein said retractor comprises a tubular retractor.

15. The surgical visualization system of claim 1, wherein said at least two cameras disposed on said retractor comprise a camera configured to be moved up and down the retractor such that the height of the camera with respect to the surgical site may be adjusted.

16. The surgical visualization system of claim 15, wherein the camera configured to be moved up and down the retractor is configured to be moved up and down the retractor via a track.

17. The surgical visualization system of claim 1, wherein said retractor has proximal and distal ends, said distal end closer to said surgical site than said proximal end, and wherein at least one of said cameras is configured to be disposed toward the distal end of the retractor.

18. The surgical visualization system of claim 1, wherein said at least two cameras disposed on said retractor have field of views with centerlines, and said at least two cameras are configured such that said centerlines converge on an area less than 500 mm².

19. The surgical visualization system of claim 1, wherein output video images from at least two of said plurality of cameras are provided for simultaneous viewing.

20. The surgical visualization system of claim 19, wherein output video images from at least one of said at least two cameras is provided in a thumbnail.

21. The surgical visualization system of claim 1, wherein the retractor comprises a plurality of retractor blades comprising a first retractor blade and a second retractor blade, and wherein the at least two cameras comprise a first camera disposed on the first retractor blade and a second camera disposed on the second retractor blade.