Utilizing vehicle window shading to improve quality of augmented reality video

• US 10,620,435 B2
• Filed: 01/14/2018
• Issued: 04/14/2020
• Est. Priority Date: 10/26/2015
• Status: Active Grant

• Current Assignee: Atnomity Ltd.
• Original Assignee: Active Knowledge Ltd
• Inventors: Thieberger, Gil, Frank, Ari M
• Primary Examiner(s): Melton, Todd M
• Application Number:
  US15/871,058
• Publication Number:
  US 20180154853A1
• Time in Patent Office: 821 Days
• Field of Search: None
• CPC Class Codes: B60J 3/04 adjustable in transparency
• CPC Class Codes: B60R 2021/0004 Frontal collision
• CPC Class Codes: B60R 2021/0006 Lateral collision
• CPC Class Codes: B60R 2021/0034 lying down
• CPC Class Codes: B60R 2021/0048 Head
• CPC Class Codes: B60R 2021/01013 Means for detecting collision, impending collision or roll-over
• CPC Class Codes: B60R 2021/01034 Controlling a plurality of restraint devices
• CPC Class Codes: B60R 2021/01252 Devices other than bags
• CPC Class Codes: B60R 2021/0273 automatically movable to an operative position, e.g. in case of collision or impending collision
• CPC Class Codes: B60R 2021/343 using deformable body panel, bodywork or components
• CPC Class Codes: B60R 2021/346 means outside vehicle body
• CPC Class Codes: B60R 21/0134 responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/017 including arrangements for providing electric power to safety arrangements or their actuating means, e.g. to pyrotechnic fuses or electro-mechanic valves
• CPC Class Codes: B60R 21/02 Occupant safety arrangements or fittings , e.g. crash pads seat belts with crash pads B60R22/14; removable children's seats having a front guard or barrier B60N2/2839
• CPC Class Codes: B60R 21/04 Padded linings for the vehicle interior ; Energy absorbing structures associated with padded or non-padded linings
• CPC Class Codes: B60R 21/055 Padded or energy-absorbing fittings , e.g. seat belt anchors sun visors B60J3/00; head rests B60N2/80
• CPC Class Codes: B60R 21/06 Safety nets, transparent sheets, curtains, or the like, e.g. between occupants and glass B60R21/026 , B60R21/11, B60R21/12, B60R21/16 take precedence
• CPC Class Codes: B60R 21/36 using airbags
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B62D 21/06 of X-shaped or fork-shaped construction, i.e. having members which form an X or fork as the frame is seen in plan view
• CPC Class Codes: G02B 27/017 : Head mounted
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A light shading module is integrated with a vehicle window and is configured to be in different states that involve different values of Visible Light Transmittance (VLT) of the vehicle window. A camera fixed to the vehicle takes video of the outside environment. A computer generates a video see-through (VST) of the outside environment, which is presented to the vehicle'"'"'s occupant on an augmented reality device (ARD). In order to improve the image quality, the ARD operates according to different modes involving varying intensities, depending on the VLT of the window.

Claims

1. A system comprising:

a light shading module integrated with a vehicle window;

the light shading module is configured to be in at least first and second states, wherein the Visible Light Transmittance (VLT) of the vehicle window in the first state is higher than the VLT in the second state;

a camera, fixed to the vehicle, configured to take video of the outside environment;

a computer configured to generate a video see-through (VST) based on the video; and

a head-mounted display (HMD) configured to operate according to a first mode of operation when an occupant inside the vehicle looks at the direction of the vehicle window and the light shading module is in the first state, and to operate according to a second mode of operation when the occupant looks at the direction of the vehicle window and the light shading module is in the second state;

wherein the total intensity of the VST light, emitted by the HMD and reaching the occupant'"'"'s eyes, is higher in the second mode than in the first mode.

2. The system of claim 1, wherein the vehicle is an autonomous vehicle, and the light shading module covers more than half of the front windshield in the second state.

3. The system of claim 1, wherein in the first state the VLT is above 10% of ambient light entering through the window, in the second state the VLT is below 50% of ambient light entering through the window, and the VLT in the first state is higher than the VLT in the second state.

4. The system of claim 1, wherein in the first state the VLT is above 70% of ambient light entering through the window, in the second state the VLT is below 30% of ambient light entering through the window, and the VLT in the first state is higher than the VLT in the second state.

5. The system of claim 1, wherein the HMD comprises an optical see-through component and a display component;

in the first mode the intensity of light that reaches the occupant'"'"'s eyes via the optical see-through component is higher than the intensity of light from the VST that is emitted by the display component and reaches the occupant'"'"'s eyes; and

in the second mode, the intensity of light from the environment that reaches the occupant'"'"'s eyes via the optical see-through component is lower than the intensity of light from the VST that is emitted by the display component and reaches the occupant'"'"'s eyes.

6. The system of claim 5, wherein the perceived contrast of the optical see-through component is better when the light shading module is in the second state compared to when the light shading module is in the first state.

7. The system of claim 1, wherein the computer is further configured not to generate the VST when the HMD operates in the first mode.

8. The system of claim 1, wherein the light shading module is a movable physical element configured to reduce the intensity of the ambient light entering into the vehicle compartment through the vehicle window.

9. The system of claim 8, wherein the light shading module is unfurled from the inside of the compartment in order to block at least 50% of the ambient light intensity.

10. The system of claim 8, wherein the light shading module is unfurled from the outside of the compartment in order to block at least 50% of the ambient light intensity.

11. The system of claim 1, wherein the light shading module is a curtain.

12. The system of claim 1, wherein the vehicle window is made of a material able to change its transparency properties.

13. The system of claim 1, wherein the VST represents the outside environment from a point of view of the occupant while looking at the outside environment through at least a portion of the vehicle window.

14. The system of claim 1, further comprising an occupant tracking module configured to calculate the point of view of the occupant based on measurements of a sensor.

15. The system of claim 14, wherein the computer is further configured to render the VST based on data received from the occupant tracking module.

16. The system of claim 15, wherein the HMD comprises an optical see-through component and a display component, and the display component is a three dimensional (3D) display configured to show the occupant the VST, such that point of gaze of the occupant, while looking via the 3D display, is most of the time beyond the location of the light shading module.

17. The system of claim 15, wherein the HMD is an augmented reality device.