METHOD FOR IMPLANT SURGERY USING AUGMENTED VISUALIZATION

• US 20160324598A1
• Filed: 05/15/2014
• Published: 11/10/2016
• Est. Priority Date: 01/21/2014
• Status: Active Grant

• Current Assignee: Trophy
• Original Assignee: Trophy
• Inventors: Bothorel, Sylvie, Maillet, Philippe
• Granted Patent: US 11,154,379 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61B 2034/104 Modelling the effect of the tool, e.g. the effect of an implanted prosthesis or for predicting the effect of ablation or burring
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/371 with simultaneous use of two cameras
• CPC Class Codes: A61B 2090/372 Details of monitor hardware
• CPC Class Codes: A61B 2090/3937 Visible markers
• CPC Class Codes: A61B 2090/3966 Radiopaque markers visible in an X-ray image
• CPC Class Codes: A61B 2090/502 Headgear, e.g. helmet, spectacles
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 6/03 Computed tomography [CT] echo-tomography A61B8/14
• CPC Class Codes: A61B 6/51 for dentistry
• CPC Class Codes: A61B 6/5229 combining image data of a patient, e.g. combining a functional image with an anatomical image
• CPC Class Codes: A61B 6/5247 combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
• CPC Class Codes: A61B 90/37 Surgical systems with images on a monitor during operation
• CPC Class Codes: A61B 90/50 Supports for surgical instruments, e.g. articulated arms
• CPC Class Codes: A61C 1/084 of implanting tools
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 : comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 : characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 : Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 : Head mounted
• CPC Class Codes: G03B 42/026 : for obtaining three-dimensional pictures

Abstract

A method for guiding the position of a dental drill for implant treatment of a patient, the method acquiring a volume image of patient anatomy; superimposing an image of a planned drill hole on a display of the acquired volume image according to observer instructions to form an implant plan; displaying at least a portion of the implant plan in stereoscopic form on a head-mounted device worn by an observer and tracking patient position so that the displayed portion of the implant plan is registered to the patient anatomy that lies in the observer'"'"'s field of view; and highlighting the location of the planned drill hole on the head-mounted device display.

Claims

1. A method for drill placement for a dental drill procedure for implant treatment of a patient, comprising:

acquiring a volume image of patient anatomy;

superimposing an image of a planned drill hole on a display of the acquired volume image according to observer instructions to form an implant plan;

displaying at least a portion of the implant plan in stereoscopic form on a head-mounted device worn by an observer along with a real-world view from the head mounted device and tracking patient position so that the displayed portion of the implant plan is registered to the patient anatomy that lies in the observer'"'"'s field of view; and

highlighting the location of the planned drill hole on the head-mounted device display.

46. The method of claim 1 further comprising responding to an observer instruction by disabling registration of the implant plan to the patient'"'"'s mouth anatomy and changing the view angle of the implant plan.

47. The method of claim 1 wherein the stereoscopic image of the at least a portion of the implant plan alternates with the real-world view from the head mounted device at least 20 times per second.

48. The method of claim 1 further comprising providing a message that indicates that the drill has reached a predetermined drill depth, wherein displaying the at least a portion of the implant plan on the head-mounted device comprises energizing an emissive display device.

49. The method of claim 1 wherein highlighting the location of the planned drill hole further comprises displaying a drill axis.

50. The method of claim 1 further comprising tracking the position of the dental drill relative to the highlighted location and indicating, on the display, when the dental drill is in position for drilling the planned drill hole, wherein tracking the position of the dental drill comprises analyzing images from one or more cameras on the head-mounted device.

51. The method of claim 1 further comprising changing the stereoscopic display in accordance with a change in a field of view of the observer through the head-mounted device.

52. The method of claim 1 wherein the displayed portion of the implant plan comprises one or more markers.

53. The method of claim 1 further comprising displaying an indicator in the observer'"'"'s field of view from the head-mounted device, wherein the indicator'"'"'s appearance relates to one or more of the relative distance of the dental drill to the displayed drill hole, the angle of the dental drill relative to the displayed drill hole, and the relative depth of the drill hole, wherein the displayed indicator indicates a recommended change in the positioning of the dental drill.

54. The method of claim 53, wherein tracking patient mouth anatomy comprises tracking the visible marker, wherein the marker is radio-opaque, wherein the marker is a first marker and wherein there is a second marker coupled to the dental drill, wherein the displayed indicator appears near the drill in the display from the head-mounted device, wherein the displayed indicator is patterned to change its appearance according to the angle at which it is viewed, wherein the displayed indicator indicates a recommended change in the positioning of the dental drill.

55. The method of claim 54 wherein the visible marker is a first visible marker and further comprising at least a second visible marker in the mouth of the patient and wherein the first and at least the second visible markers are used to locate the planned drill hole of the implant plan.

56. The method of claim 1 further comprising changing the display of the image of the planned drill hole according to the position of the observer relative to the patient'"'"'s mouth.

57. The method of claim 1 wherein the separation distance between a left-eye and a right-eye image in the stereoscopic display is adjustable by the observer.

2-45. -45. (canceled)

58. A dental imaging apparatus, comprising:

a computerized tomography scanning apparatus that obtains a volume image of a patient from a plurality of two-dimensional images taken at different angles relative to the patient;

a host processor that is in signal communication with the computerized tomography scanning apparatus and that is adapted to generate the volume image from the plurality of two-dimensional images;

a first display that is in signal communication with the host processor and that provides an operator interface that is adapted to display positioning of at least a drill hole relative to the volume image; and

a second display of a head mounted device that is in signal communication with the host processor, wherein the second display is worn by an observer and further comprises at least a first camera that is adapted to acquire an image of the visual field of the observer, the second display enabling viewing at least a portion of an implant plan and a real-world view from the head mounted device.

59. The apparatus of claim 58 further comprising a camera for obtaining a visible light image of the patient'"'"'s mouth.