Augmented reality display integrated with self-contained breathing apparatus

• US 7,110,013 B2
• Filed: 08/09/2001
• Issued: 09/19/2006
• Est. Priority Date: 03/15/2000
• Status: Expired due to Fees

• Current Assignee: Information Decision Technologies LLC
• Original Assignee: Information Decision Technology
• Inventors: Furlong, Todd Joseph, Ebersole, John Franklin, Ebersole, John Franklin Jr.
• Primary Examiner(s): Mengistu, Amare
• Application Number:
  US09/927,043
• Publication Number:
  US 20020039085A1
• Time in Patent Office: 1,867 Days
• Field of Search: 345/7, 345/8, 345/9, 345/53, 345/980, 250/330, 250/359, 359/630, 359/629, 382/103
• US Class Current: 346/8
• CPC Class Codes: A62B 9/006 Indicators or warning devices, e.g. of low pressure, contamination
• CPC Class Codes: A62C 99/0081 Training methods or equipment for fire-fighting
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0176 characterised by mechanical features

Abstract

A system for creating an augmented reality display coupled with a firefighter'"'"'s self-contained breathing apparatus (SCBA) mask. The invention combines a camera, motion tracking sensor, head-mounted display, SCBA mask, and optional head phones into a display suitable for performing exercises, such as training of firefighters or other emergency first responders, in augmented reality.

Claims

1. A system for creating a see-through augmented reality display, comprising:

a self-contained breathing apparatus (SCBA) mask to be worn by a user;

a motion tracker directly or indirectly coupled to the SCBA to track the user'"'"'s field of view;

computer graphics rendered by a computer to be shown to the user, the computer graphics corresponding to the user'"'"'s field of view as tracked by the motion tracker, so that the graphics appear to be anchored in 3-D space; and

a see-through head-mounted display (HMD) mounted in front of the user'"'"'s eyes on which the computer graphics are displayed, to combine the computer graphics with the user'"'"'s view of the real world, wherein the non-augmented reality portion of the user'"'"'s field of view is blocked from view by the user with opaque material such that only augmented reality imagery is visible to the user.

2. The system of claim 1, further comprising user headphones coupled to the SCBA mask.

3. The system of claim 2, further comprising shafts to connect the headphones to the SCBA mask, and wherein the shafts are filled with epoxy or other means to strengthen the shafts.

4. The system of claim 1 wherein the said opaque materials are selected from the group of materials consisting of tape, foam, plastic, rubber, silicone, paint, and combinations of these materials.

5. A system for creating a non-see-through augmented reality display, comprising:

a self-contained breathing apparatus (SCBA) mask to be worn by a user;

a video camera coupled to the SCBA mask, placed proximate the user'"'"'s eyes and pointed away from the user;

a motion tracker coupled to said camera;

computer graphics rendered by a computer to be shown to the user, the computer graphics corresponding to the position and field of view of said camera; and

a non-see-through head-mounted display (HMD) mounted in front of the user'"'"'s eyes on which the computer graphics and the output of said camera is displayed, to combine the computer graphics with a view of the real world captured by said camera, wherein the non-augmented reality portion of the user'"'"'s field of view is blocked from view by the user with opaque material such that only augmented reality imagery is visible to the user.

6. The system of claim 5, further comprising a second video camera coupled to the SCBA mask, for generating a stereoscopic view.

7. The system of claim 5, further comprising one or two mirrors placed in front of said camera to set the viewpoint of said camera to coincide with the user'"'"'s eye location.

8. The system of claim 7, further comprising a rubber bumper placed around the mirror or mirrors.

9. The system of claim 7 wherein each mirror is placed in a mechanical clamp mount.

10. The system of claim 7, further comprising a structure for protecting each mirror from being bumped or hooked.

11. The system of claim 7 wherein each mirror is mounted on a mounting plate.

12. The system of claim 5, further comprising user headphones coupled to the SCBA mask.

13. The system of claim 12, further comprising shafts to connect the headphones to the SCBA mask, and wherein the shafts are filled with epoxy or other means to strengthen the shafts.

14. The system of claim 5 wherein the said opaque materials are selected from the group of materials consisting of tape, foam, plastic, rubber, silicone, paint, and combinations of these materials.

15. A system for creating a non-see-through augmented reality display, comprising:

a self-contained breathing apparatus (SCBA) mask to be worn by a user;

a video camera coupled to the SCBA mask;

at least one mirrored surface placed in front of said camera, to alter the incoming viewing angle of said camera such that the viewpoint of said camera coincides with the user'"'"'s eye location;

a motion tracker coupled to said camera;

computer graphics rendered by a computer to be shown to the user, the computer graphics corresponding to the position and field of view of said camera; and

a non-see-through head-mounted display (HMD) mounted in front of the user'"'"'s eyes on which the computer graphics and the output of said camera is displayed, to combine the computer graphics with a view of the real world captured by said camera.

16. The system of claim 15, further comprising a rubber bumper placed around the mirrored surface.

17. The system of claim 15 wherein each mirrored surface is placed in a mechanical clamp mount.

18. The system of claim 15, further comprising a structure for protecting each mirrored surface from being bumped or hooked.

19. The system of claim 15 wherein each mirrored surface is mounted on a mounting plate.

20. The system of claim 15, further comprising a second video camera coupled to the SCBA mask, for generating a stereoscopic view.

21. The system of claim 15 wherein the non-augmented reality portion of the user'"'"'s field of view is blocked from view by the user with opaque material such that only augmented reality imagery is visible to the user.

22. The system of claim 21 wherein the said opaque materials are selected from the group of materials consisting of tape, foam, plastic, rubber, silicone, paint, and combinations of these materials.

23. The system of claim 15, further comprising user headphones coupled to the SCBA mask.

24. The system of claim 23, further comprising shafts to connect the headphones to the SCBA mask, and wherein the shafts are filled with epoxy or other means to strengthen the shafts.