Ambient vision display apparatus and method

• US 6,014,117 A
• Filed: 10/23/1997
• Issued: 01/11/2000
• Est. Priority Date: 07/03/1997
• Status: Expired due to Fees

• Current Assignee: Monterey Technologies, Inc.
• Original Assignee: Monterey Technologies, Inc.
• Inventors: Hennessy, Robert T., Sharkey, Thomas J.
• Primary Examiner(s): Hjerpe, Richard A.
• Assistant Examiner(s): Tran, Henry N.
• Application Number:
  US08/956,330
• Time in Patent Office: 810 Days
• Field of Search: 345/1, 345/7-9, 340/967, 340/974, 340/977, 340/980, 359/630
• US Class Current: 345/8
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements

Abstract

A display system conveys vehicle guidance information in the peripheral field of view of the user by the movement of ambient symbology that is not representational of either symbols or physical objects, and does not require any optics for the purpose of representing the display within the focal range of the eye. The ambient symbology is presented outside the central 30 degrees of the forward field of view of the user, and appeals to the ambient or peripheral mode of processing visual information, in contrast to previous displays which have been designed for focal modes of visual processing.

Claims

1. A method of presenting information on the motion or attitude of an object in an environment, to a user, by means of the motion of an image comprising ambient symbology, the method comprising the steps of:

providing an image display means for displaying an image to the user outside the central 30 degrees of the field of view of the user;

providing data processing means for manipulating image data;

providing ambient symbology image data, the ambient symbology image data being representative of an image including ambient symbology;

capturing a selected one of a motion parameter of the object and an orientation parameter of the object, the motion parameter being related to the motion of the object in the environment and the orientation parameter being related to the orientation of the object in the environment;

processing the ambient symbology image data in the processing means using the selected one of the motion parameter and the orientation parameter and a drive function, to provide motion of the image;

providing the ambient symbology image data to display means, such that a moving image including the ambient symbology is displayed by the display means outside the central 30 degrees of the field of view of the user, the motion of the image including the ambient symbology being based on the selected one of the motion parameter and the orientation parameter.

2. The method of claim 1 wherein the ambient symbology includes areas having at least one characteristic selected from the group consisting of differing contrast, differing color and differing texture, the areas not being representational of objects in the environment.

3. The method of claim 2 wherein the motion of the image including the ambient symbology is opposite in direction to the motion of the object in the environment.

4. The method of claim 3 wherein the motion parameter is selected from the group consisting of horizontal velocity and change in altitude, and wherein rearward motion of the image indicates forward motion of the object, downward movement of the image indicates an increase in altitude, and upward movement of the image indicates a decrease in altitude.

5. The method of claim 3 wherein the attitude parameter is selected from the group consisting of pitch, roll, and yaw, and wherein the movement of the image comprising the ambient symbology is selected from the group consisting of a) rotation of the image, and b) differential translation of the image in different areas of the field of view of the user.

6. The method of claim 5 wherein the display means provides left and right images in left and right areas of the field of view of the user, the attitude parameter is yaw, and the differential translation of the images comprises differential speeds of movement of the left and right images in a longitudinal direction of the object.

7. The method of claim 5 wherein the display means provides left and right images in left and right areas of the field of view of the user, the attitude parameter is pitch, and the movement of the images comprises rotation of the images about a pitch axis of the object.

8. The method of claim 5 wherein the display means provides left and right images in left and right areas of the field of view of the user, the attitude parameter is roll, and the differential translation of the images comprises differential speeds of movement of the left and right images in the direction of a yaw axis of the object.

9. The method of claim 3 wherein the display means is mounted to a head mounted display, the method further comprising the steps of:

tracking the orientation of the head mounted display using head tracking means;

providing a head position signal to the processing means; and

wherein the step of processing the ambient symbology image data in the processing means comprises stabilizing of the movement of the image relative to the environment.

10. The method of claim 3 wherein the motion of the image including the ambient symbology is based on an absolute value of the selected parameter.

11. The method of claim 3 wherein the motion of the image including the ambient symbology is based on a relative value of the selected parameter.

12. The method of claim 3 wherein the motion of the image including the ambient symbology is based on a desired value of the selected parameter.

13. A method of presenting information on the motion or attitude of an object in an environment, to a user, by means of the motion of an image comprising ambient symbology, the method comprising the steps of:

a) providing image data which defines an image including ambient symbology;

b) obtaining a selected one of a motion parameter of the object and an orientation parameter of the object, the motion parameter being related to the motion of the object in the environment and the orientation parameter being related to the orientation of the object in the environment;

c) processing the image data using the selected one of the motion parameter and the orientation parameter and a drive function, thereby to generate updated image data based on the selected one of the parameters;

d) providing the updated image data to display means, such that an image comprising the ambient symbology is displayed by the display means outside the central 30 degrees of the field of view of the user; and

e) executing steps b) to d) repeatedly, thereby to provide motion of the image comprising the ambient symbology, the motion being based on the selected one of the motion parameter and the orientation parameter.

14. The method of claim 13 wherein the ambient symbology includes areas having at least one characteristic selected from the group consisting of differing contrast, differing color and differing texture, the areas not being representational of objects in the environment.

15. The method of claim 14 wherein the motion of the image including the ambient symbology is opposite in direction to the motion of the object in the environment.

16. The method of claim 15 wherein the motion parameter is selected from the group consisting of horizontal velocity and change in altitude, and wherein rearward motion of the image indicates forward motion of the object, downward movement of the image indicates an increase in altitude, and upward movement of the image indicates a decrease in altitude.

17. The method of claim 15 wherein the attitude parameter is selected from the group consisting of pitch, roll, and yaw, and wherein the movement of the image comprising the ambient symbology is selected from the group consisting of a) rotation of the image, and b) differential translation of the image in different areas of the field of view of the user.

18. The method of claim 17 wherein the display means provides left and right images in left and right areas of the field of view of the user, the attitude parameter is yaw, and the differential translation of the images comprises differential speeds of movement of the left and right images in a longitudinal direction of the object.

19. The method of claim 17 wherein the display means provides left and right images in left and right areas of the field of view of the user, the attitude parameter is pitch, and the movement of the images comprises rotation of the images about a pitch axis of the object.

20. The method of claim 17 wherein the display means provides left and right images in left and right areas of the field of view of the user, the attitude parameter is roll, and the differential translation of the images comprises differential speeds of movement of the left and right images in the direction of a yaw axis of the object.

21. The method of claim 15 wherein the display means is mounted to a head mounted display, the method further comprising the steps of:

tracking the orientation of the head mounted display using head tracking means;

providing a head position signal to the processing means; and

wherein the step of processing the ambient symbology image data in the processing means comprises stabilizing of the movement of the image relative to the environment.

22. The method of claim 15 wherein the motion of the image including the ambient symbology is based on an absolute value of the selected parameter.

23. The method of claim 15 wherein the motion of the image including the ambient symbology is based on a relative value of the selected parameter.

24. The method of claim 15 wherein the motion of the image including the ambient symbology is based on a desired value of the selected parameter.

25. Apparatus for presenting information on the motion or attitude of an object in an environment, to a user, by means of the motion of an image comprising ambient symbology, comprising:

means for obtaining a selected one of a motion parameter of the object and an orientation parameter of the object, the motion parameter being related to the motion of the object in the environment and the orientation parameter being related to the orientation of the object in the environment;

data processing means for manipulating ambient symbology image data, the ambient symbology image data being representative of an image including ambient symbology, the data processing means in use processing the ambient symbology image data using the selected one of the motion parameter and the orientation parameter and a drive function, to provide motion of the image; and

image display means for receiving the ambient symbology image data and for displaying an image to the user outside the central 30 degrees of the field of view of the user;

the motion of the image in use being based on the selected one of the motion parameter and the orientation parameter.

26. The apparatus of claim 25 wherein the ambient symbology includes areas having at least one characteristic selected from the group consisting of differing contrast, differing color and differing texture, the areas not being representational of objects in the environment.

27. The apparatus of claim 26 wherein the motion of the image including the ambient symbology in use is opposite in direction to the motion of the object in the environment.

28. The apparatus of claim 27 wherein the motion parameter is selected from the group consisting of horizontal velocity and change in altitude, and wherein rearward motion of the image in use indicates forward motion of the object, downward movement of the image in use indicates an increase in altitude, and upward movement of the image indicates a decrease in altitude.

29. The apparatus of claim 27 wherein the attitude parameter is selected from the group consisting of pitch, roll, and yaw, and wherein the movement of the image comprising the ambient symbology is selected from the group consisting of a) rotation of the image, and b) differential translation of the image in different areas of the field of view of the user.

30. The apparatus of claim 29 wherein the display means in use provides left and right images in left and right areas of the field of view of the user, the attitude parameter is yaw, and the differential translation of the images comprises differential speeds of movement of the left and right images in a longitudinal direction of the object.

31. The apparatus of claim 29 wherein the display means in use provides left and right images in left and right areas of the field of view of the user, the attitude parameter is pitch, and the movement of the images comprises rotation of the images about a pitch axis of the object.

32. The apparatus of claim 29 wherein the display means in use provides left and right images in left and right areas of the field of view of the user, the attitude parameter is roll, and the differential translation of the images comprises differential speeds of movement of the left and right images in the direction of a yaw axis of the object.

33. The apparatus of claim 27 wherein the display means is mounted to a head mounted display, the apparatus further comprising:

head tracking means for tracking the orientation of the head mounted display and for providing a head position signal to the processing means; and

wherein in use the processing means processes the ambient symbology image data to stabilize of the movement of the image relative to the environment.

34. The apparatus of claim 27 wherein in use the motion of the image including the ambient symbology is based on an absolute value of the selected parameter.

35. The apparatus of claim 27 wherein in use the motion of the image including the ambient symbology is based on a relative value of the selected parameter.

36. The apparatus of claim 27 wherein in use the motion of the image including the ambient symbology is based on a desired value of the selected parameter.

37. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for presenting information on the motion or attitude of an object in an environment, to a user, by means of motion of an image comprising ambient symbology, the machine including data processing means for manipulating image data and image display means for displaying an image to the user outside the central 30 degrees of the field of view of the user,

the method comprising the steps of:

capturing a selected one of a motion parameter of the object and an orientation parameter of the object, the motion parameter being related to the motion of the object in the environment and the orientation parameter being related to the orientation of the object in the environment;

processing ambient symbology image data in the processing means using the selected one of the motion parameter and the orientation parameter and a drive function, to provide motion of the image; and

providing the ambient symbology image data to display means, such that a moving image including ambient symbology is displayed by the display means outside the central 30 degrees of the field of view of the user, the motion of the image including the ambient symbology being based on the selected one of the motion parameter and the orientation parameter.

38. A program storage device according to claim 37 wherein, in execution of the method, the ambient symbology includes areas having at least one characteristic selected from the group consisting of differing contrast, differing color and differing texture, the areas not being representational of objects in the environment.

39. A program storage device according to claim 38 wherein, in execution of the method, the areas of the ambient symbology each subtend a minimum of 400 square minutes in the field of view of the user.

40. A computer program product comprising:

a computer usable medium having computer readable program code means for presenting information on the motion or attitude of an object in an environment, to a user, by means of motion of an image comprising ambient symbology, the computer readable program code means being executable by a computer including data processing means for manipulating image data and image display means for displaying an image to the user outside the central 30 degrees of the field of view of the user, the computer program product having;

computer readable program code means for capturing a selected one of a motion parameter of the object and an orientation parameter of the object, the motion parameter being related to the motion of the object in the environment and the orientation parameter being related to the orientation of the object in the environment;

computer readable program code means for processing ambient symbology image data in the processing means using the selected one of the motion parameter and the orientation parameter and a drive function, to provide motion of the image;

computer readable program code means for providing the ambient symbology image data to display means, such that a moving image including ambient symbology is displayed by the display means outside the central 30 degrees of the field of view of the user, the motion of the image including the ambient symbology being based on the selected one of the motion parameter and the orientation parameter.

41. A computer program product according to claim 40 wherein the ambient symbology includes areas having at least one characteristic selected from the group consisting of differing contrast, differing color and differing texture, the areas not being representational of objects in the environment.

42. A computer program product according to claim 41 wherein, in execution of the method, the areas of the ambient symbology each subtend a minimum of 400 square minutes in the field of view of the user.