Head Wearable Device, System, and Method

• US 20190317718A1
• Filed: 04/17/2018
• Published: 10/17/2019
• Est. Priority Date: 04/17/2018
• Status: Active Grant

• Current Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: George, Christopher L., Flaherty-Woods, Emily M., Shapiro, Geoffrey A.
• Granted Patent: US 10,853,014 B2
• Time in Patent Office: Days
• CPC Class Codes: B64D 43/02 for indicating aircraft speed or stalling conditions
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2300/023 Display panel composed of stacked panels
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

A head wearable device, a method, and a system. The head wearable device may include a transparent display and a non-transparent display. The transparent display may be implemented in or on the head wearable device. The transparent display may be configured to present first content to a user of the head wearable device. The non-transparent display may be implemented in or on the head wearable device. The non-transparent display may be configured to present second content to the user of the head wearable device. The non-transparent display may be viewable at least in part through the transparent display.

Claims

1. A head wearable device, comprising:

at least one transparent display implemented in or on the head wearable device, the at least one transparent display configured to present first content to a user of the head wearable device; and

at least one non-transparent display implemented in or on the head wearable device, the at least one non-transparent display configured to present second content to the user of the head wearable device, wherein each of the at least one non-transparent display is viewable at least in part through one of the at least one transparent display.

2. The head wearable device of claim 1, wherein the at least one transparent display is implemented as at least one augmented reality display, wherein the at least one non-transparent display is implemented as at least one virtual reality display.

3. The head wearable device of claim 2, wherein the at least one non-transparent display is further configured to present at least one of a synthetic or a sensed view of an environment of the user.

4. The head wearable device of claim 1, wherein the at least one transparent display comprises a left transparent display and a right transparent display, wherein the at least one non-transparent display comprises a left non-transparent display and a right non-transparent display, wherein the left transparent display and the right transparent display are configured to present first stereoscopic content to the user, wherein the left non-transparent display and the right non-transparent display are configured to present second stereoscopic content to the user.

5. The head wearable device of claim 1, wherein the at least one non-transparent display is configured to move relative to the head wearable device between a first position and a second position.

6. The head wearable device of claim 5, wherein, when the at least one non-transparent display is in the first position, the at least one transparent display and the at least one non-transparent display are configured to simultaneously present aligned content having perceptible depth to the user.

7. The head wearable device of claim 6, wherein, when the at least one non-transparent display is in the second position, the at least one transparent display is configured to present the first content to the user while allowing the user to view a real world environment outside of the head wearable device through the at least one transparent display.

8. The head wearable device of claim 7, wherein, when the at least one non-transparent display is in the first position, the at least one non-transparent display is powered on, wherein, when the at least one non-transparent display is in the second position, the at least one non-transparent display is not used.

9. The head wearable device of claim 1, further comprising at least one processor communicatively coupled to the at least one transparent display and the at least one non-transparent display, the at least one processor configured to:

output streams of image data to the at least one transparent display and the at least one non-transparent display for presentation to the user as the first content and the second content.

10. The head wearable device of claim 9, wherein the at least one processor is further configured to:

receive data from a vetronics computing device; and

based at least on the received data, generate the streams of the image data.

11. The head wearable device of claim 9, wherein the at least one processor is further configured to:

receive data from an avionics computing device; and

based at least on the received data, generate the streams of the image data.

12. The head wearable device of claim 9, wherein the at least one processor is further configured to:

receive data from at least one of an unmanned or another manned vehicle; and

based at least on the received data, generate the streams of the image data.

13. The head wearable device of claim 12, wherein the at least one non-transparent display is further configured to present a virtual view from a perspective of at least one of the unmanned vehicle or the other manned vehicle.

14. The head wearable device of claim 9, further comprising at least one camera mounted on the head wearable device, the at least one camera communicatively coupled with the at least one processor, wherein the at least one processor is further configured to:

receive video data from the at least one camera; and

based at least on the video data, generate the streams of the image data.

15. The head wearable device of claim 9, wherein the at least one processor is further configured to:

updating the streams of image data such that a portion of the first content presented to the user is moved from the at least one transparent display to the at least one non-transparent display.

16. The head wearable device of claim 9, wherein the at least one processor is further configured to:

updating the streams of image data such that a portion of the second content presented to the user is moved from the at least one non-transparent display to the at least one transparent display.

17. The head wearable device of claim 9, further comprising a head tracking system implemented in or on the head wearable device, the head tracking system communicatively coupled to the at least one processor, the head tracking system configured to:

determine a position and an orientation of a head of the user of the head wearable device relative to an environment; and

output position and orientation data associated with the determined position and the determined orientation of the head of the user relative to the environment;

wherein the streams of the image data are associated with images aligned with the determined position and the determined orientation of the head of the user relative to the environment.

18. The head wearable device of claim 17, further comprising a user input system comprising at least one of an eye tracking system or a voice recognition system, the user input system communicatively coupled to the at least one processor, the user input system configured to:

detect user inputs of the user of the head wearable device; and

output user input data;

wherein the images include at least one user-selectable depiction, wherein the at least one processor is further configured to;

receive the user input data from the user input system, wherein the user input data includes user selection data associated with a selected user-selectable depiction of the at least one user-selectable depiction; and

update the streams of image data associated with the images such that the images further include a depiction of information associated with the selected user-selectable depiction.

19. A method, comprising:

displaying, by at least one transparent display implemented in or on a head wearable device, first content to a user of the head wearable device; and

displaying, by at least one non-transparent display implemented in or on the head wearable device, second content to the user of the head wearable device, wherein each of the at least one non-transparent display is viewable at least in part through one of the at least one transparent display.

20. A system, comprising:

a computing device comprising a processor; and

a head wearable device communicatively coupled to the computing device, the head wearable device comprising;

at least one transparent display implemented in or on the head wearable device, the at least one transparent display configured to present first content to a user of the head wearable device; and

at least one non-transparent display implemented in or on the head wearable device, the at least one non-transparent display configured to present second content to the user of the head wearable device, wherein each of the at least one non-transparent display is viewable at least in part through one of the at least one transparent display.