Head tracking system for a head mounted display system

• US 5,742,263 A
• Filed: 12/18/1995
• Issued: 04/21/1998
• Est. Priority Date: 12/18/1995
• Status: Expired due to Term

• Current Assignee: Symbol Technologies, LLC (Zebra Technologies Corporation)
• Original Assignee: Telxon Corporation (Zebra Technologies Corporation)
• Inventors: O'Hagan, Timothy P., Wang, Ynjiun P.
• Primary Examiner(s): WU, XIAO MIN
• Application Number:
  US08/574,261
• Time in Patent Office: 855 Days
• Field of Search: 345/8, 345/7, 345/9, 345/127, 345/123, 345/139, 348/45, 348/65, 348/77, 348/115, 359/631
• US Class Current: 345/8
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037

Abstract

A head mounted display system includes a frame that can be worn on a user'"'"'s head wherein the frame supports a display and an optical system that projects an enlarged image of video information depicted on the display at a distance from the user. Also mounted on the frame so as to form an integral part of the head mounted display system is a barcode sensor for detecting one or more barcodes in the field of view thereof. A processor of the head mounted display system decodes barcodes detected by the sensor and determines the location of detected barcodes within the sensor'"'"'s field of view. The processor utilizes the decoded barcode values and locations to control the video information depicted on the display for head tracking purposes or the like. The head mounted display system of the present invention has applications in both augmented field of view and virtual reality applications.

Claims

1. A head mounted display system comprising:

a frame to be supported on a user'"'"'s head;

a display for depicting video information, said display being mounted on said frame;

an optical system mounted on said frame with respect to said display for projecting an enlarged image of said video information depicted on said display at a distance from said user;

a barcode sensor mounted on said frame for detecting one or more barcodes in a field of view of said sensor; and

a processor for decoding a barcode detected in said barcode sensor'"'"'s field of view, said processor controlling the video information depicted on said display in accordance with a decoded barcode.

2. A head mounted display system as recited in claim 1 wherein said processor includes a memory for storing information related to a barcode, said processor being responsive to a decoded barcode for displaying information related to said decoded barcode as stored in said memory.

3. A head mounted display system as recited in claim 1 wherein said processor identifies the location of a barcode in said barcode sensor'"'"'s field of view and determines whether the location of said barcode changes to vary the location of video information depicted on said display in accordance with the change in the location of said barcode.

4. A head mounted display system as recited in claim 3 wherein said optical system includes a partially transparent reflector for superimposing displayed information, including at least one symbol, on the real world and said processor changes the location of said symbol on said display so that it appears to be at a fixed location in the real world in response to a determined change in the location of said barcode.

5. A head mounted display system as recited in claim 4 wherein the location of said barcode sensor, said display and the optical system are fixed and said processor maps a location in said barcode sensor field of view onto a display position of said display to superimpose said symbol at a desired location with respect to the real world.

6. A head mounted display system as recited in claim 1 wherein said sensor includes a charged-coupled device image sensor array.

7. A head mounted display system comprising:

a frame to be supported on a user'"'"'s head;

a display for depicting video information, said display being mounted on said frame;

an optical system mounted on said frame with respect to said display for projecting an enlarged image of said video information depicted on said display at an apparent location that appears to be at a distance from said user;

a barcode sensor mounted on said frame for detecting one or more barcodes in a field of view of said sensor, said display, optical system and barcode sensor being mounted on said frame at fixed locations with respect to each other such that a predetermined position on said sensor corresponds to a predetermined position on said display and to a predetermined position on said image of said display at said apparent location; and

a processor for decoding a barcode detected in said barcode sensor'"'"'s field of view and determining the location of said detected barcode in said sensor'"'"'s field of view, said processor controlling the location of information depicted on said display in accordance with the determined location of said detected barcode in said sensor'"'"'s field of view.

8. A head mounted display system as recited in claim 7 wherein said optical system includes a partially transparent reflector for superimposing displayed information, including at least one symbol, on the real world and said processor changes the location of said symbol on said display in response to a determined change in the location of said barcode so that the symbol appears to be at a fixed location with respect to a stationary real world object.

9. A head mounted display system as recited in claim 7 wherein said processor includes a memory for storing information associated with a plurality of barcodes, said processor being responsive to a decoded barcode to display information stored in said memory in association with said decoded barcode at a location on said display determined in accordance with the location of said decoded barcode.

10. A head mounted display system as recited in claim 7 wherein said barcode sensor detects a plurality of barcodes in a field of view of said sensor and said processor controls the location of information depicted on said display based on the determined locations of a plurality of said barcodes in said sensor'"'"'s field of view.

11. A head mounted display system as recited in claim 7 wherein said sensor includes a charged-coupled device image sensor array.

12. A head mounted display system comprising:

a frame to be supported on a user'"'"'s head;

a display for depicting video information including a symbol at a location on said display, said display being mounted on said frame;

an optical system mounted on said frame with respect to said display, said optical system including a collimating element for projecting an enlarged image of said displayed information at a distance from said user and a partial reflector through which said user views said enlarged image so that it is superimposed on the real world;

a barcode sensor mounted on said frame for detecting one or more barcodes in a field of view of said sensor; and

a processor responsive to said barcode sensor for determining a change in a location of a detected barcode to vary the location of said symbol on said display in accordance with said change in the detected barcode'"'"'s location so that the symbol appears to be at a fixed location with respect to stationary real world objects.

13. A head mounted display system as recited in claim 12 wherein said processor is responsive to a detected barcode to decode said barcode and said processor includes a memory for storing information associated with a plurality of barcodes, said processor being responsive to a decoded barcode to display information stored in said memory in association with said decoded barcode at a location on said display determined in accordance with the location of said decoded barcode.

14. A head mounted display system as recited in claim 12 wherein said barcode sensor detects a plurality of barcodes in a field of view of said sensor and said processor controls the location of said symbol depicted on said display based on the determined locations of a plurality of said barcodes in said sensor'"'"'s field of view.

15. A head mounted display system as recited in claim 12 wherein said sensor includes a charged-coupled device image sensor array.

16. A method for tracking the position of a user'"'"'s head in a head mounted display system having a frame for supporting a display depicting video information and optics that project an enlarged image of said video information that appears to be at a location in the real world at a distance from the user, said method employing at least one detectable barcode positioned in the real world and comprising:

detecting a barcode in the field of view of a barcode sensor mounted on said frame of said head mounted display system;

determining a location of a detected barcode in said sensor'"'"'s field of view.

determining a change in said barcode'"'"'s location in said sensor'"'"'s field of view;

varying the position of information depicted on said display in accordance with a change in said barcode'"'"'s location.

17. A method for tracking the position of a user'"'"'s head in a head mounted display system as recited in claim 16 including the steps of decoding a barcode and controlling said display to depict different information for different decoded barcodes.

18. A method for tracking the position of a user'"'"'s head in a head mounted display system having a frame for supporting a display depicting video information and optics that project an enlarged image of said video information that appears to be at a location in the real world at a distance from the user, said method employing at least one detectable barcode positioned in the real world and comprising:

detecting a plurality of barcodes in a field of view of a barcode sensor mounted on said frame of said head mounted display system;

decoding each of said detected barcodes;

determining a location of each of said barcodes in said sensor'"'"'s field of view;

determining a change in at least one of the locations of said barcodes; and

varying the position of information depicted on said display in accordance with the changes in the barcodes'"'"' locations.

19. A method for tracking the position of a user'"'"'s head in a head mounted display system as recited in claim 18 including the step of controlling said display to depict different information in association with the location of each of said different barcodes.

20. A method for varying information depicted on a head mounted display system having a frame for supporting a display depicting video information and optics projecting an enlarged image of said video information, said image appearing to be located at a distance from the user in the real world, said method employing at least one detectable barcode positioned in the real world and comprising:

storing data representing information associated with a plurality of barcodes, said data representing different information for different barcodes;

detecting a barcode in the field of view of a barcode sensor mounted on said frame of said head mounted display system;

decoding a detected barcode; and

controlling said display to depict different information in response to the decoding of different barcodes.