INTERFACE FOR VIEWING VIDEO FROM CAMERAS ON A SURGICAL VISUALIZATION SYSTEM

• US 20140005484A1
• Filed: 03/13/2013
• Published: 01/02/2014
• Est. Priority Date: 06/27/2012
• Status: Active Grant

• Current Assignee: CamPlex, Inc.
• Original Assignee: Camplex, LLC
• Inventors: Charles, Steven T.
• Granted Patent: US 8,882,662 B2
• Time in Patent Office: Days
• US Class Current: 600/201
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/0004 for electronic operation
• CPC Class Codes: A61B 1/00045 Display arrangement
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00149 using articulated arms
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/051 Details of CCD assembly
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61B 1/32 Devices for opening or enlarging the visual field, e.g. of a tube of the body dilators A61M29/00
• CPC Class Codes: A61B 17/00 Surgical instruments, devices or methods, e.g. tourniquets A61B18/00 takes precedence; contraceptive devices, pessaries, or applicators therefor A61F6/00; eye surgery A61F9/007; ear surgery A61F11/00
• CPC Class Codes: A61B 17/02 for holding wounds open; Tractors specula A61B1/32 ; drainage appliances for wounds A61M27/00
• CPC Class Codes: A61B 17/0206 with antagonistic arms as supports for retractor elements
• CPC Class Codes: A61B 17/0218 for minimally invasive surgery A61B17/0281, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence
• CPC Class Codes: A61B 17/025 Joint distractors
• CPC Class Codes: A61B 17/0293 with ring member to support retractor elements
• CPC Class Codes: A61B 17/16 Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans arthroscopic bone cutters A61B17/320016; dental implant drills potentially for other surgical use A61C8/0089; bone grinders A61F2/4644, A22C17/06; A61B17/1662 takes precedence over all other subgroups except A61B17/17
• CPC Class Codes: A61B 17/1604 Chisels; Rongeurs; Punches; Stamps
• CPC Class Codes: A61B 17/1628 Motors; Power supplies
• CPC Class Codes: A61B 17/1644 using fluid other than turbine drive fluid
• CPC Class Codes: A61B 17/3211 : Surgical scalpels, knives; Accessories therefor
• CPC Class Codes: A61B 2017/00207 : with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2017/0256 : for the spine
• CPC Class Codes: A61B 2090/371 : with simultaneous use of two cameras
• CPC Class Codes: A61B 2576/00 : Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 34/20 : Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/0077 : Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/7425 : Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: A61B 5/7475 : User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61B 50/13 : Trolleys, e.g. carts
• CPC Class Codes: A61B 50/15 : Mayo stands; Tables
• CPC Class Codes: A61B 90/20 : Surgical microscopes characterised by non-optical aspects
• CPC Class Codes: A61B 90/30 : Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
• CPC Class Codes: A61B 90/361 : Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation

Abstract

A surgical device includes a plurality of cameras integrated therein. The view of each of the plurality of cameras can be integrated together to provide a composite image. A surgical tool that includes an integrated camera may be used in conjunction with the surgical device. The image produced by the camera integrated with the surgical tool may be associated with the composite image generated by the plurality of cameras integrated in the surgical device. The position and orientation of the cameras and/or the surgical tool can be tracked, and the surgical tool can be rendered as transparent on the composite image. A surgical device may be powered by a hydraulic system, thereby reducing electromagnetic interference with tracking devices.

Claims

1. A surgical visualization system comprising:

a retractor configured to provide access to a surgical site;

a plurality of cameras configured to acquire video images of the surgical site, at least one of the plurality of cameras being disposed on the retractor and configured to acquire video images within an opening to which the retractor provides access; and

an image processing system in communication with the plurality of cameras, the image processing system comprising at least one physical processor,

wherein the image processing system is configured to;

receive the video images acquired by the plurality of cameras;

receive input from a user indicating a selection of at least two of the plurality of cameras, said selection being less than all of said cameras in said plurality of cameras;

provide output video images based on the video images acquired by the selected cameras, the output video images being provided for simultaneous viewing; and

resize or arrange the simultaneously viewable output video images from the selected cameras to present them on a display according to received input.

2. The surgical visualization system of claim 1, wherein the image processing system is configured to increase a size of a first one of the simultaneously viewable output video images in relation to a second one of the simultaneously viewable output video images based at least partly on received input.

3. The surgical visualization system of claim 1, wherein the image processing system is configured to arrange a first one of the simultaneously viewable output video images in a more central location in relation to a second one of the simultaneously viewable output video based at least partly on received input.

4. The surgical visualization system of claim 1, wherein at least one of the simultaneously viewable output video images are represented by a reduced-size real-time video stream that is configured to be presented on a graphical user interface for selection by a user, wherein the graphical user interface includes a representation of a position of the retractor and the plurality of cameras.

5. The surgical visualization system of claim 1, wherein at least one of the simultaneously viewable output video images is represented by a reduced-size real-time video stream that is configured to be presented on a display for selection by a user, the reduced-size real-time video stream comprising video from the respective camera.

6. The surgical visualization system of claim 1, wherein the image processing system is (a) configured to display video images that are from a camera that is not selected and that are not displayed on the display after receiving input from the user indicating a selection thereof, (b) is configured to display video images that are from the camera that is not selected and that are displayed as a reduced-size real-time video stream more prominently after receiving input from the user indicating a selection thereof, or (c) configured as set forth in both (a) and (b).

7. The surgical visualization system of claim 1, wherein the image processing system is configured to the output video images in a tiled format.

8. The surgical visualization system of claim 7, wherein the tiled output images comprise at least three images.

9. The surgical visualization system of claim 7, wherein the tiled output images comprise at least four images.

10. The surgical visualization system of claim 8, wherein the image processor is configured to rotate the tiled output images around a single, common axis.

11. The surgical visualization system of claim 1, wherein the output video images from at least two of the plurality of cameras are discontinuous.

12. The surgical visualization system of claim 1, wherein the plurality of selected cameras comprise at least first and second cameras that are disposed on the retractor in positions opposite one another.

13. The surgical visualization system of claim 12, wherein the image processing system is further configured rotate video images from said first selected camera 180°

with respect to video images from said second selected camera.

14. A surgical visualization system comprising:

a retractor configured to provide access to a surgical site;

a plurality of cameras configured to acquire video images of the surgical site, at least one of the plurality of cameras being disposed on the retractor and configured to acquire video images of said surgical site; and

an image processing system in communication with the plurality of cameras, the image processing system comprising at least one physical processor,

wherein the image processing system is configured to;

receive the video images acquired by the plurality of cameras;

receive input indicating a selection of video images from a camera; and

providing output video images based on video images acquired with the selected camera,

wherein the image processing system is configured to present output video images from a first camera, and

wherein the image processing system is further configured to swap the presentation of the output video images of the first camera with video images from a second camera in response to a request to resize the output video images from the second camera to be larger than a threshold size.

15. The surgical visualization system of claim 14, wherein the image processing system is configured to recognize enlargement by the user of a reduced-size real-time video stream beyond the threshold value as the request to resize the output video images from the second camera.

16. The surgical visualization system of claim 15, wherein image processing system is configured to convert the first image to a reduced-size real-time video stream as part of swapping the presentation of the video images from the second camera with the video images of the first camera.

17. The surgical visualization system of claim 14, wherein, in response to selection by a user, the image processing system is configured to present output video images from a third camera positioned over output video images from the second camera, wherein the output images from the third camera are less than the threshold value.

18. The surgical visualization system of claim 14, wherein, in response to selection by a user after the presentation of the output video images of the first camera is swapped with video images from a second camera, the image processing system is configured to present output video images from the first camera positioned over output video images from the second camera, wherein the output images from the first camera are less than the threshold value.

19. The surgical visualization system of claim 14, further comprising a display in communication with said image processing system, said display configured to display said video images from said first and second cameras, wherein said threshold value is at least 70% and less than 85% of the size of the display.

20. The surgical visualization system of claim 19, wherein said threshold value is at least 85% of the size of the display.