CONTENT PRESENTATION IN HEAD WORN COMPUTING

• US 20160015470A1
• Filed: 07/22/2014
• Published: 01/21/2016
• Est. Priority Date: 07/15/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Border, John N.
• Granted Patent: US 11,103,122 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 1/00 Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes examination of body cavities or body tracts using ultrasonic, sonic or infrasonic waves A61B8/12; endoscopic instruments for taking cell samples or for biopsy A61B10/04; for surgical purposes A61B17/00; endoscopic surgical cutting instruments A61B17/32; surgical instruments using a laser beam being directed along or through a flexible conduit A61B18/22; Illuminating arrangements therefor for the eyes A61B3/00
• CPC Class Codes: A61B 17/00 Surgical instruments, devices or methods, e.g. tourniquets A61B18/00 takes precedence; contraceptive devices, pessaries, or applicators therefor A61F6/00; eye surgery A61F9/007; ear surgery A61F11/00
• CPC Class Codes: A61B 2017/00216 with eye tracking or head position tracking control
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2048 using an accelerometer or inertia sensor
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/363 Use of fiducial points
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/373 using light, e.g. by using optical scanners
• CPC Class Codes: A61B 2090/374 NMR or MRI
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 2090/3945 Active visible markers, e.g. light emitting diodes
• CPC Class Codes: A61B 2090/3979 infrared
• CPC Class Codes: A61B 2090/502 Headgear, e.g. helmet, spectacles
• CPC Class Codes: A61B 3/112 for measuring diameter of pupils
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 3/12 for looking at the eye fundus, e.g. ophthalmoscopes A61B3/13 takes precedence
• CPC Class Codes: A61B 3/1216 for diagnostics of the iris
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/015 : By temperature mapping of body part
• CPC Class Codes: A61B 5/066 : Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging
• CPC Class Codes: A61B 5/067 : using accelerometers or gyroscopes
• CPC Class Codes: A61B 5/1103 : Detecting eye twinkling
• CPC Class Codes: A61B 5/1114 : Tracking parts of the body
• CPC Class Codes: A61B 5/1122 : of movement trajectories
• CPC Class Codes: A61B 5/1128 : using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/14532 : for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/14551 : for measuring blood gases
• CPC Class Codes: A61B 5/6803 : Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/742 : using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 90/39 : Markers, e.g. radio-opaque or breast lesions markers
• CPC Class Codes: A61B 90/50 : Supports for surgical instruments, e.g. articulated arms
• CPC Class Codes: G02B 2027/0138 : comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0141 : characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0198 : System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/017 : Head mounted
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/41 : Medical
• CPC Class Codes: G06V 30/1423 : the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 40/18 : Eye characteristics, e.g. of the iris

Abstract

Aspects of the present invention relate to providing assistance to medical professionals during the performance of medical procedures through the use of technologies facilitated through a head-worn computer.

Claims

1. A method of aligning augmented reality content in a see-through head-worn display with a human body portion, comprising:

a. Detecting a light source that is positioned on the human body portion as a reference point for the human body portion;

b. Establishing a field of view position, within the see-through display, that is along a line of sight that intersects an eye of a person wearing the see-through head-worn display and the light source;

c. Establishing a content position reference that describes the positional relation between the light source and imaged content of the human body portion; and

d. Displaying the imaged content within the field of view at a position that aligns the field of view position and the content position reference.

2. The method of claim 1, wherein the step of detecting the light source involves capturing an image of the human body portion with a camera that is in-line with an optical path described by the eye'"'"'s view through the see-through display.

3. The method of claim 1, wherein the light source produces infrared light.

4. The method of claim 1, wherein the light source produces visible light.

5. The method of claim 4 wherein the see-through display includes a notch filter adapted to absorb the visible light such that the person wearing the see-through display does not see the visible light.

6. A method of aligning augmented reality content in a see-through head-worn display with a human body portion, comprising:

a. Imaging the human body portion during a pre-procedure diagnostic imaging process with the presence of a light emitting marker attached to the human body portion such that the light emitting marker is present in a resulting pre-procedure diagnostic medical image;

b. Capturing an image of the light emitting marker during a medical procedure from the perspective of the see-through head-worn display; and

c. Presenting the pre-procedure diagnostic medical image at a position in the see-through head-worn display that aligns the captured image of the light emitting marker during the medical procedure with the light emitting marker imaged during the pre-procedure diagnostic imaging process.

7. The method of claim 6, wherein the pre-procedure diagnostic is at least one of an X-Ray, MRI, and CAT Scan.

8. A method of aligning augmented reality content in a see-through head-worn display with a human body portion, comprising:

a. Presenting light-emitter marked medical image AR content in the see-through head-worn display; and

b. Presenting a person wearing the see-through head-worn display with a user interface to manually position the content to align with a related light emitter on the human body portion, such that the person can align the content with the human body portion from the person'"'"'s perspective.

9. The method of claim 8, wherein the user interface is voice activated.

10. The method of claim 8, wherein the user interface head-movement activated.

11. The method of claim 8, wherein the user interface is an external device.

12. The method of claim 8, wherein the content is automatically repositioned to account for movements in the see-through head-worn display after the content has been initially manually positioned.

13-14. -14. (canceled)