VOLUMETRIC HEADS-UP DISPLAY WITH DYNAMIC FOCAL PLANE

• US 20140354692A1
• Filed: 08/19/2014
• Published: 12/04/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company), Making Virtual Solid-California, LLC
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company), Making Virtual Solid-California, LLC
• Inventors: Ng-Thow-Hing, Victor, Zamojdo, Tom, Grabowski, Chris
• Granted Patent: US 9,393,870 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 2370/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

A heads-up display device for displaying graphic elements in view of a user while the user views an environment through a display screen. The heads-up display device includes at least one projector that projects a graphic element on a dynamic, frontal focal plane in view of the user while the user views the environment through the display screen, and at least one projector that projects a graphic element on a static, ground-parallel focal plane in view of the user while the user views the environment through the display screen. A controller determines a target graphic element position and a graphic element size based on the target graphic element position for the graphic element projected on the frontal focal plane, so as to provide the user with an immersive three-dimensional heads-up display.

Claims

1. A heads-up display system for displaying a graphic element in view of a user while the user views an environment disposed at a position spaced from the heads-up display system, the heads-up display system comprising:

a projector system comprising a first projector that projects a first graphic element on a dynamic first focal plane in view of the user while the user views the environment, the first focal plane disposed in the environment; and

a controller programmed to determine a first target graphic element position at which the first graphic element is to be displayed, the first target graphic element position being disposed in the environment, and to control the first projector to project the first graphic element on the first focal plane disposed at the first target graphic element position.

2. The heads-up display system according to claim 1, wherein the first focal plane is oriented substantially perpendicularly to a line-of-sight of the user.

3. The heads-up display system according to claim 2, wherein the controller is also programmed to determine a first graphic element size based on the first target graphic element position, and to control the first projector to project the first graphic element on the first focal plane disposed at the determined first target graphic element position, and at the determined first graphic element size.

4. The heads-up display system according to claim 3, wherein the controller is programmed to control the first projector to render the first graphic element in perspective.

5. The heads-up display system according to claim 1, wherein the controller is also programmed to determine a first graphic element size based on the first target graphic element position, and to control the first projector to project the first graphic element on the first focal plane disposed at the determined first target graphic element position, and at the determined first graphic element size.

6. The heads-up display system according to claim 5, wherein the controller is programmed to continuously determine the first target graphic element position and the first graphic element size, and to control the first projector to move the first focal plane on which the first graphic element is displayed and to adjust a size of the displayed first graphic element.

7. The heads-up display system according to claim 1, wherein, in addition to the first projector, the projector system comprises at least one secondary projector that projects a secondary graphic element on a dynamic secondary focal plane in view of the user while the user views the environment, the secondary focal plane disposed in the environment and being different than the first focal plane of the first projector,

wherein the controller is programmed to determine a secondary target graphic element position at which the secondary graphic element is to be displayed, the secondary target graphic element position being disposed in the environment, and to control the secondary projector to project the secondary graphic element on the secondary focal plane disposed at the determined secondary target graphic element position.

8. The heads-up display system according to claim 7, wherein the first focal plane and the secondary focal plane are both oriented substantially perpendicularly to a line-of-sight of the user.

9. The heads-up display system according to claim 8, wherein the controller is programmed to control the first projector and the secondary projector to display a single combined graphic element by determining the first target graphic element position to be near the secondary target graphic element position.

10. The heads-up display system according to claim 7, wherein the controller is also programmed to determine a first graphic element size based on the first target graphic element position, and a secondary graphic element size based on the secondary target graphic element position,

the controller is programmed to control the first projector to project the first graphic element on the first focal plane disposed at the determined first target graphic element position, and at the determined first graphic element size, and

the controller is programmed to control the secondary projector to project the secondary graphic element on the secondary focal plane disposed at the determined secondary target graphic element position, and at the determined secondary graphic element size.

11. The heads-up display system according to claim 10, wherein the projector system comprises a plurality of secondary projectors, and the controller is programmed to independently control each of the secondary projectors.

12. The heads-up display system according to claim 7, wherein, in addition to the first projector and the at least one secondary projector, the projector system further comprises at least one tertiary projector that projects a tertiary graphic element on a static tertiary focal plane disposed in the environment and being different than the first focal plane and the secondary focal plane, the static tertiary focal plane being substantially parallel to a ground surface and disposed at a position that is one of:

above a line-of-sight of the user and below the line-of-sight of the user.

13. The heads-up display system according to claim 12, wherein the controller is also programmed to determine a first graphic element size based on the first target graphic element position, and a secondary graphic element size based on the secondary target graphic element position,

the controller is programmed to control the first projector to project the first graphic element on the first focal plane disposed at the determined first target graphic element position, and at the determined first graphic element size, and

the controller is programmed to control the secondary projector to project the secondary graphic element on the secondary focal plane disposed at the determined secondary target graphic element position, and at the determined secondary graphic element size.

14. The heads-up display system according to claim 13, wherein the projector system comprises a plurality of secondary projectors and a plurality of tertiary projectors, and the controller is programmed to independently control each of the secondary projectors and each of the tertiary projectors.

15. The heads-up display system according to claim 12, wherein the controller is programmed to control at least two of the first projector, the secondary projector, and the tertiary projector to display a single combined graphic element by determining at least one of the first target graphic element position and the secondary target graphic element position to be near the static tertiary focal plane.

16. A controller for controlling a heads-up display device that displays graphic elements in view of a user while the user views an environment disposed at a position spaced from and in front of the heads-up display device, the heads-up display device including a projector system adapted to project a plurality of graphic elements on a plurality of focal planes in view of the user while the user views the environment, with each of the plurality of focal planes being disposed in the environment,

wherein the controller is programmed to determine a target graphic element position for each graphic element, and to control the heads-up display device to project each of the plurality of graphic elements on an associated one of the plurality of focal planes disposed at the target graphic element position determined for the graphic element.

17. The controller according to claim 16, wherein the controller is also programmed to determine a graphic element size for each of the graphic elements based on the target graphic element position determined for each of the graphic elements, and to control the heads-up display device to project each of the plurality of graphic elements on the associated one of the plurality of focal planes disposed at the target graphic element position determined for the graphic element, and at the graphic element size determined for the graphic element.

18. The controller according to claim 17, wherein at least one of the plurality of graphic elements is a perspective rendering.

19. A method for displaying a three-dimensional volumetric heads-up display in view of a user in an environment disposed at a position spaced from the user, comprising:

determining a target graphic element position of a focal plane on which a graphic element is to be displayed, the focal plane oriented substantially perpendicularly to a line-of-sight of the user and disposed in the environment in view of the user; and

projecting the graphic element on the focal plane disposed at the target graphic element position.

20. The method according to claim 19, further comprising:

determining a graphic element size based on the target graphic element position; and

projecting the graphic element on the focal plane disposed at the target graphic element position and at the graphic element size.