Interventional In-Situ Image-Guidance by Fusing Ultrasound and Video

• US 20130218024A1
• Filed: 10/09/2012
• Published: 08/22/2013
• Est. Priority Date: 10/09/2011
• Status: Abandoned Application

• Current Assignee: Clear Guide Medical, Llc
• Original Assignee: Clear Guide Medical, Llc
• Inventors: STOLKA, Philipp Jakob, BOCTOR, Emad Mikhail, HAGER, Gregory Donald, HEISENBERG, Dorothee
• Application Number:
  US13/648,245
• Publication Number:
  US 20130218024A1
• Time in Patent Office: Days
• US Class Current: 600/476
• CPC Class Codes: A61B 2017/00707 Dummies, phantoms; Devices simulating patient or parts of patient
• CPC Class Codes: A61B 2017/00725 Calibration or performance testing
• CPC Class Codes: A61B 2034/2048 using an accelerometer or inertia sensor
• CPC Class Codes: A61B 2034/2063 Acoustic tracking systems, e.g. using ultrasound
• CPC Class Codes: A61B 2046/205 Adhesive drapes
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/366 using projection of images directly onto the body
• CPC Class Codes: A61B 2090/371 with simultaneous use of two cameras
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 46/00 Surgical drapes
• CPC Class Codes: A61B 46/40 Drape material, e.g. laminates; Manufacture thereof
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/062 using magnetic field
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/12 Arrangements for detecting or locating foreign bodies
• CPC Class Codes: A61B 6/4417 : related to combined acquisition of different diagnostic modalities
• CPC Class Codes: A61B 6/4441 : the rigid structure being a C-arm or U-arm
• CPC Class Codes: A61B 8/0841 : for locating instruments
• CPC Class Codes: A61B 8/4254 : using sensors mounted on the probe
• CPC Class Codes: A61B 8/4416 : related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions
• CPC Class Codes: A61B 8/488 : involving Doppler signals
• CPC Class Codes: A61B 8/5261 : combining images from different diagnostic modalities, e.g. ultrasound and X-ray
• CPC Class Codes: A61B 8/587 : Calibration phantoms models for medical purposes G09B23/28

Abstract

An augmentation device for an imaging system has a bracket structured to be attachable to an imaging component, and a projector attached to the bracket. The projector is arranged and configured to project an image onto a surface in conjunction with imaging by the imaging system. A system for image-guided surgery has an imaging system, and a projector configured to project an image or pattern onto a region of interest during imaging by the imaging system. A capsule imaging device has an imaging system, and a local sensor system. The local sensor system provides information to reconstruct positions of the capsule endoscope free from external monitoring equipment.

Claims

1. A system for providing visual information for use in guiding the use of an instrument relative to a body during a procedure, comprising:

a body imaging system configured to image a body along an image plane,

a camera configured to observe a region of imaging during operation of said imaging system, and

a projector aligned with said image plane,

wherein said camera is aligned off-axis relative to said image plane;

wherein said projector is configured to project an image that indicates a location of the image plane;

wherein an image recorded by said camera is displayed on a screen, and

wherein the system is configured to superimpose guidance information on the camera display such that intersection of the image plane and the plane formed by the superimposed guidance forms a line that corresponds to a desired trajectory of the instrument.

23. A system according to claim 1, configured to reference stored prior images of said body to provide guidance concerning for placement of the imaging system for optimal imaging of a desired target.

24. A system according to claim 1, configured to display said guidance information is superimposed over live images from said imaging system.

26. A system according to claim 1, configured to superimpose alignment lines corresponding to desired instrument location and orientation over single, stereo or multiple camera views, and configured to project instrument alignment lines denoting current instrument location and orientation.

29. A system according to claim 1, wherein a thickness of said guidelines may be varied based on detected instrument dimensions, distance to projector, distance to the body.

56. A system according to claim 1, wherein the projector is configured to project a visual interface on a surface, and wherein the camera system is configured to track user interaction with the visual interface according to which the user may provide instructions to the system by interacting with the visual interface.

57. A system according to claim 1, wherein the projector accounts for the three-dimensional structure of a projection surface when projecting a visual interface on said surface.

62. A system according to claim 1, further comprising a display system that maintains registration with the imaging system and which is configured for both visualization and guidance.

63. A system according to claim 1, wherein said imaging system has a detachable display configured to show pre-operative information based on its position in space.

67. A system according to claim 1, further comprising a sterile sheath for at least one of said camera and projector, said sheath containing a transparent solid plastic window to permit projection and camera recording.

2. A system according to 1 wherein the display screen is configured to display the image produced by the imaging system together with the image recorded by said camera.

3. (canceled)

68. A method according to claim 3, comprising projecting said image onto a drape covering at least a portion of said subject.

69. A method according to claim 68, wherein said drape is selected from the group consisting of:

transparent to structured light, IR transparent, and wavelength-specific.

70. A method according to claim 68, wherein said drape comprises a detectable reference frame sufficient to allow direct surface tracking and registration.

73. A method according to claim 3, further comprising time multiplexing the projection image with the camera to optimize projection for tracking, guidance, and surface.

74. A method according to claim 3, further comprising time multiplexing or spatially modulating the projection pattern.

75. A method according to claim 3, further comprising projecting an adaptive pattern according to space and/or time, wherein said adaptive pattern is selected from the group consisting of:

changing spatial frequencies of the pattern according to surface distance, structure size and/or camera resolution, changing pattern color to adapt to surface properties, and randomizing patterns over time.

4. A system for providing visual information for use in guiding the use of an instrument relative to a body during a procedure, comprising:

a body imaging system configured to image a body along an image plane,

a camera configured to observe a region of imaging during operation of said imaging system, and aligned with said image plane, and

a projector aligned off-axis relative to said image plane;

wherein an image recorded by said camera is displayed on a screen, and

wherein information indicating a location of the image plane is superimposed on the displayed camera image;

wherein the projection system projects a line corresponding to a desired instrument trajectory.

5. (canceled)

6. A system for providing visual information for use in guiding the use of an instrument relative to a body during a procedure, comprising:

a body imaging system configured to image a body along an image plane,

a camera configured to observe a region of imaging during operation of said imaging system, and

a projector configured to project an image,

wherein one of said camera and said projector is aligned with said image plane,

wherein another of said camera and said projector is aligned off-axis relative to said image plane;

wherein said projector is configured to project an image corresponding to a calculated location of a shadow cast by said instrument when said instrument is located in a proper location and orientation for said procedure.

7. (canceled)

8. (canceled)

9. (canceled)

10. (canceled)

11. (canceled)

12. A system for providing visual information for use in guiding the use of an instrument relative to a body during a procedure, comprising:

a body imaging system configured to image a body along an image plane,

a first camera configured to observe a region of imaging during operation of said imaging system, and

a second camera configured to observe a region of said imaging during operation of said imaging system, said first and second cameras configured and located for stereoscopic observation of said region of imaging,

said first and second cameras configured to actively track the location and movement of said instrument, and

said system configured to display guidance information concerning the location and orientation of the instrument relative to a desired location and orientation of the instrument for said procedure.

14. A system according to claim 12, wherein said guidance information is projected onto the patient.

16. A system according to claim 12, wherein said guidance information is projected as an overlay on a projection of the image captured by the imaging system.

18. A system according to claim 12, wherein the guidance information is registered to the projected image or to the subject.

19. A system according to claim 12, wherein the guidance information is location independent.

21. A system according to claim 12, further configured to project guidance concerning placement of the imaging system.

22. A system according to claim 12, wherein images acquired by the imaging system are registered with images recorded with the camera, and the projector uses said registered image to project guidance information for improved visualization of a selected target.

30. A system according to claim 12, further comprising:

a projector assembly configured to project, from two different angles, an image from said imaging system,

wherein said system is configured to display guidance information concerning the location and orientation of the instrument relative to a desired location and orientation of the instrument for said procedure using intersecting shadows.

13. (canceled)

15. (canceled)

17. (canceled)

20. (canceled)

25. (canceled)

27. (canceled)

28. (canceled)

31. (canceled)

32. (canceled)

33. (canceled)

34. (canceled)

35. (canceled)

36. (canceled)

37. (canceled)

38. (canceled)

39. (canceled)

40. (canceled)

41. (canceled)

42. (canceled)

43. (canceled)

44. (canceled)

45. (canceled)

46. (canceled)

47. (canceled)

48. (canceled)

49. (canceled)

50. (canceled)

51. (canceled)

52. (canceled)

53. (canceled)

54. (canceled)

55. (canceled)

58. (canceled)

59. (canceled)

60. (canceled)

61. (canceled)

64. (canceled)

65. (canceled)

66. (canceled)

71. (canceled)

72. (canceled)

76. (canceled)

77. (canceled)

78. (canceled)

79. (canceled)