Optical assembly providing a surgical microscope view for a surgical visualization system

• US 9,936,863 B2
• Filed: 03/13/2013
• Issued: 04/10/2018
• Est. Priority Date: 06/27/2012
• Status: Active Grant

• Current Assignee: CamPlex, Inc.
• Original Assignee: CamPlex, Inc.
• Inventors: Tesar, John
• Primary Examiner(s): COLEY, ZADE JAMES
• Application Number:
  US13/802,577
• Publication Number:
  US 20140005555A1
• Time in Patent Office: 1,854 Days
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/0004 for electronic operation
• CPC Class Codes: A61B 1/00045 Display arrangement
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00149 using articulated arms
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/051 Details of CCD assembly
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61B 1/32 Devices for opening or enlarging the visual field, e.g. of a tube of the body dilators A61M29/00
• CPC Class Codes: A61B 17/00 Surgical instruments, devices or methods, e.g. tourniquets A61B18/00 takes precedence; contraceptive devices, pessaries, or applicators therefor A61F6/00; eye surgery A61F9/007; ear surgery A61F11/00
• CPC Class Codes: A61B 17/02 for holding wounds open; Tractors specula A61B1/32 ; drainage appliances for wounds A61M27/00
• CPC Class Codes: A61B 17/0206 with antagonistic arms as supports for retractor elements
• CPC Class Codes: A61B 17/0218 for minimally invasive surgery A61B17/0281, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence
• CPC Class Codes: A61B 17/025 Joint distractors
• CPC Class Codes: A61B 17/0293 with ring member to support retractor elements
• CPC Class Codes: A61B 17/16 Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans arthroscopic bone cutters A61B17/320016; dental implant drills potentially for other surgical use A61C8/0089; bone grinders A61F2/4644, A22C17/06; A61B17/1662 takes precedence over all other subgroups except A61B17/17
• CPC Class Codes: A61B 17/1604 Chisels; Rongeurs; Punches; Stamps
• CPC Class Codes: A61B 17/1628 Motors; Power supplies
• CPC Class Codes: A61B 17/1644 using fluid other than turbine drive fluid
• CPC Class Codes: A61B 17/3211 : Surgical scalpels, knives; Accessories therefor
• CPC Class Codes: A61B 2017/00207 : with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2017/0256 : for the spine
• CPC Class Codes: A61B 2090/371 : with simultaneous use of two cameras
• CPC Class Codes: A61B 2576/00 : Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 34/20 : Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/0077 : Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/7425 : Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: A61B 5/7475 : User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61B 50/13 : Trolleys, e.g. carts
• CPC Class Codes: A61B 50/15 : Mayo stands; Tables
• CPC Class Codes: A61B 90/20 : Surgical microscopes characterised by non-optical aspects
• CPC Class Codes: A61B 90/30 : Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
• CPC Class Codes: A61B 90/361 : Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation

Abstract

A surgical device includes a plurality of cameras integrated therein. The view of each of the plurality of cameras can be integrated together to provide a composite image. A surgical tool that includes an integrated camera may be used in conjunction with the surgical device. The image produced by the camera integrated with the surgical tool may be associated with the composite image generated by the plurality of cameras integrated in the surgical device. The position and orientation of the cameras and/or the surgical tool can be tracked, and the surgical tool can be rendered as transparent on the composite image. A surgical device may be powered by a hydraulic system, thereby reducing electromagnetic interference with tracking devices.

Claims

1. A surgical visualization system comprising:

a binocular viewing assembly comprising a housing and a pair of eyepieces, said eyepieces configured to provide a view of at least one display disposed in the housing;

an optical assembly configured to provide a surgical microscope view of a surgical site, the optical assembly comprising at least one auxiliary camera;

an articulating arm, the binocular viewing assembly disposed on the articulating arm, the articulating arm configured to adjust a position of the binocular viewing assembly; and

an image processing system in communication with the optical assembly and the at least one display, the image processing system comprising at least one physical processor,

wherein the image processing system is configured to;

receive video images acquired by the at least one auxiliary camera,

provide output video images based on the received video images, and

present the output video images on the at least one display so that the output video images are viewable through the pair of eyepieces,

wherein the optical assembly is configured to provide a working distance that is between about 15 cm and about 45 cm, and

wherein the optical assembly is mounted to an isocenter positioning system, the isocenter positioning system comprising an isocenter track, said isocenter positioning system configured to allow the at least one auxiliary camera to be moved along the isocenter track to a plurality of locations and to position the at least one auxiliary camera such that at said plurality of locations, said at least one auxiliary camera remains a fixed distance away from a common point.

2. The surgical visualization system of claim 1, wherein the isocenter positioning system comprises elements configured to allow the optical assembly to be adjusted in three-dimensions such that a field of view of the at least one auxiliary camera always includes a common point.

3. The surgical visualization system of claim 1, wherein said at least one auxiliary camera comprises a Greenough configuration.

4. The surgical visualization system of claim 3, wherein said at least one auxiliary camera comprises a pair of optical paths oriented at an angle with respect to each other that converge at said common point established by said isocenter positioning system.

5. The surgical visualization system of claim 1, further comprising a virtual touch camera configured to image a hand of a user, wherein the image processing system is configured to identify hand gestures based at least partly on the acquired images of the hand of the user.

6. The surgical visualization system of claim 5, wherein said hand gestures include gesturing with a tool held in said hand.

7. The surgical visualization system of claim 5, further comprising a virtual touch sensor attached to the binocular viewing assembly, said image processing system being configured to use information from the virtual touch sensor in conjunction with image data from the virtual touch camera to identify gestures to allow the user to interact with the graphical user interface provided on the at least one display.

8. The surgical visualization system of claim 5, wherein said image processing system is configured to identify the hand gestures to allow the user to interact with a graphical user interface provided on the at least one display.

9. The surgical visualization system of claim 1, wherein said binocular viewing assembly is configured not to provide a surgical microscope view via an optical path from said pair of eyepieces through an aperture in said housing.

10. The surgical visualization system of claim 1, wherein said at least one auxiliary camera includes a turning mirror or turning prism configured to reduce the thickness profile of said optical assembly.

11. The surgical visualization system of claim 1, wherein said at least one auxiliary camera comprises a pair of optical paths that do not share a common objective lens.

12. The surgical visualization system of claim 1, further comprising a virtual touch input device configured to receive user input, wherein the image processing system is configured to identify commands based at least partly on the acquired input from the user.

13. The surgical visualization system of claim 12, wherein the image processing system is configured to identify the commands to allow the user to interact with a graphical user interface provided on the at least one display through a representation of the user'"'"'s hand.

14. The surgical visualization system of claim 1, wherein said at least one auxiliary camera comprises a Galilean configuration.

15. The surgical visualization system of claim 1, wherein the optical assembly is configured to provide a working distance that is adjustable between about 15 cm and about 45 cm.

16. The surgical visualization system of claim 1, wherein said isocenter positioning system is separate from the binocular viewing assembly.

17. The surgical visualization system of claim 1, further comprising a sensor configured to identify gestures of a hand of a user.

18. The surgical visualization system of claim 17, wherein said gestures include gesturing with a tool held in said hand.

19. A surgical visualization system comprising:

a binocular viewing assembly comprising a housing and a plurality of oculars, the plurality of oculars configured to provide display views of at least one display disposed in the housing, the display views corresponding respectively to a left-eye display view and a right-eye display view;

an optical assembly comprising a left-eye camera and a right-eye camera configured to provide a stereoscopic surgical microscope view of a surgical site;

an articulating arm, the binocular viewing assembly disposed on the articulating arm, the articulating arm configured to adjust a position of the binocular viewing assembly; and

an image processing system in communication with the optical assembly and the at least one display, the image processing system comprising at least one physical processor,

wherein the image processing system is configured to;

receive video images acquired by the left-eye camera and the right-eye camera,

provide output video images based on the received video images, and

present the left-eye output video images via the left-eye display view and the right-eye output video images via the right-eye display view so that the output video images are viewable through the plurality of oculars,

wherein the optical assembly provides a convergence angle, the convergence angle being an angle between a left-eye optical path and a right-eye optical path at the surgical site,

wherein the left-eye camera and the right-eye camera are configured to acquire video images of the surgical site at a convergence point,

wherein a distance from the optical assembly to the convergence point comprises a working distance, and

wherein the at least one display has a resolution in excess of 300 ppi.

20. The surgical visualization system of claim 19, wherein the optical assembly is configured to provide a substantially constant convergence angle with changing working distance.

21. The surgical visualization system of claim 19, wherein the left-eye camera comprises:

a left-eye turning prism configured to direct light from the surgical site along a left-eye lens path;

a left-eye lens assembly configured to receive the directed light from the left-eye turning prism and to create a left-eye image;

a left-eye image sensor configured to capture the left-eye image and generate a left-eye video image.

22. The surgical visualization system of claim 19, wherein the right-eye camera comprises:

a right-eye turning prism configured to direct light from the surgical site along a right-eye lens path;

a right-eye lens assembly configured to receive the directed light from the right- eye turning prism and to create a right-eye image;

a right-eye image sensor configured to capture the right-eye image and generate a right-eye video image.

23. The surgical visualization system of claim 19, wherein the optical assembly is configured to provide an adjustable working distance between about 15 cm and about 45 cm.

24. The surgical visualization system of claim 23, wherein the left-eye camera comprises a left-eye turning prism and the right-eye camera comprises a right-eye turning prism, the left-eye turning prism and the right-eye turning prism being configured to change their relative orientations thereby changing the convergence angle to provide the adjustable working distance.

25. The surgical visualization system of claim 19, wherein the optical assembly is configured to provide a substantially constant convergence angle with changing working distance.

26. The surgical visualization system of claim 25, wherein the left-eye camera and the right-eye camera are configured to adjust their relative orientation and position to provide the substantially constant convergence angle.

27. The surgical visualization system of claim 25, wherein the left-eye camera comprises a left-eye prism assembly and the right-eye camera comprises a right-eye prism assembly, the left-eye prism assembly and the right-eye prism assembly being configured to adjust their relative orientation and position to provide the substantially constant convergence angle, wherein other elements of the left-eye camera and the other elements of the right-eye camera remain substantially stationary.

28. The surgical visualization system of claim 23, wherein the optical assembly is configured to provide a sufficiently narrow convergence angle to provide stereoscopic imagery through an insertion tube.

29. The surgical visualization system of claim 28, wherein the insertion tube has a width between about 25 mm and about 50 mm.

30. The surgical visualization system of claim 28, wherein the sufficiently narrow convergence angle is also substantially constant with changes in working distance.

31. The surgical visualization system of claim 19, further comprising a second arm, the optical assembly disposed on the second arm so that the optical assembly can be positioned independently of the binocular viewing assembly.

32. The surgical visualization system of claim 31, wherein both the binocular viewing assembly and the optical assembly are supported by a common support stand.

33. The surgical visualization system of claim 19, wherein the optical assembly is configured to provide a working distance between about 15 cm and about 45 cm.

34. The surgical visualization system of claim 19, further comprising an external monitor.

35. The surgical visualization system of claim 34, wherein the external monitor is disposed on an arm.

36. The surgical visualization system of claim 19, further comprising two external monitors.

37. The surgical visualization system of claim 36, wherein at least one of the two external monitors is disposed on an arm.

38. The surgical visualization system of claim 19, wherein each of the plurality of oculars has a circular cross section.

39. The surgical visualization system of claim 19, wherein the plurality of oculars is adjustable for refractive error.

40. The surgical visualization system of claim 19, wherein the optical assembly is smaller than the binocular viewing assembly.

41. The surgical visualization system of claim 19, further comprising a virtual touch camera configured to image a hand of a user, wherein the image processing system is configured to identify hand gestures based at least partly on the acquired images of the hand of the user.

42. The surgical visualization system of claim 38, wherein said hand gestures include gesturing with a tool held in said hand.

43. The surgical visualization system of claim 41, wherein the image processing system is configured to identify the hand gestures to allow the user to interact with a graphical user interface provided on the at least one display.

44. The surgical visualization system of claim 19, wherein the optical assembly is mounted to an isocenter positioning system, the isocenter positioning system configured to allow the optical assembly to be moved to a plurality of locations and to position the optical assembly such that at said plurality of locations, said optical assembly remains a fixed distance away from a common point.

45. The surgical visualization system of claim 44, wherein said isocenter positioning system comprises an isocenter track, said isocenter positioning system configured to allow the optical assembly to be moved along the isocenter track to the plurality of locations.

46. The surgical visualization system of claim 44, wherein said isocenter positioning system comprises an articulating arm configured to allow the optical assembly to be moved to the plurality of locations.

47. The surgical visualization system of claim 44, wherein said isocenter positioning system comprises a movable arm configured to allow the optical assembly to be moved to the plurality of locations.

48. The surgical visualization system of claim 44, further comprising a gesture recognition system configured to identify gestures of a hand of a user.

49. The surgical visualization system of claim 48, wherein said gestures include gesturing with a tool held in said hand.