IN-VEHICLE PROJECTED REALITY MOTION CORRECTION

• US 20180308454A1
• Filed: 04/21/2017
• Published: 10/25/2018
• Est. Priority Date: 04/21/2017
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Gusikhin, Oleg Yurievitch, Makke, Omar, Van Hoecke, Patrick Lawrence Jackson
• Granted Patent: US 10,580,386 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: H04N 9/3179 Video signal processing therefor

Abstract

Method and apparatus are disclosed for stabilizing in-vehicle projected reality. An example in-vehicle projected reality system includes headset for displaying a projected reality image. The system also includes a localizer device for determining a headset pose in the vehicle. The system also includes a computing device for receiving the headset pose, receiving vehicle inertial data, determining a stabilized image based on the received headset pose and vehicle inertial data, and providing the stabilized image to the headset.

Claims

1. A projected reality system comprising:

a sensor for collecting inertial data of a vehicle;

a localizer device for determining a headset pose in the vehicle, the localizer device being positioned such that inertial forces of the localizer device correspond with the inertial data;

a computing device for

determining, based on the headset pose and the inertial data, a stabilized image that synchronizes with the inertial forces; and

a headset for displaying the stabilized image.

2. The projected reality system of claim 1, wherein the localizer device includes a pair of laser devices mounted to the vehicle.

3. The projected reality system of claim 1, wherein the headset pose includes a location and orientation of the headset.

4. The projected reality system of claim 1, wherein the computing device that determines the stabilized image is a smart phone.

5. The projected reality system of claim 1, wherein the inertial data includes vehicle yaw data and vehicle pitch data.

6. The projected reality system of claim 1, wherein the sensor collecting the inertial data includes one or more gyroscopes and accelerometers.

7. The projected reality system of claim 1, wherein the sensor collects the inertial data a rate greater than 90 times per second.

8. The projected reality system of claim 1, wherein the localizer device is positioned such that movement of the vehicle corresponds to movement of the localizer device.

9. The projected reality system of claim 1, wherein the localizer device is positioned based on a model of movement of the vehicle.

10. The projected reality system of claim 1, wherein a position of the localizer device is positioned such that movement of the localizer device matches movement of the sensor collecting the inertial data.

11. The projected reality system of claim 1, wherein the computing device receives the inertial data from a telematics control unit of the vehicle.

12. The projected reality system of claim 1, wherein the computing device provides the stabilized image to the headset occurs at a rate greater than 90 times per second.

13. A method comprising:

detecting inertial data of a vehicle via a sensor;

detecting a headset pose of a headset for projected reality within the vehicle via a localizer device that is positioned such that inertial forces of the localizer device correspond with the inertial data;

determining, via a processor, a stabilized image that synchronizes with the inertial forces based on the headset pose and inertial data; and

presenting the stabilized image via the headset.

14. The method of claim 13, wherein the localizer device includes a pair of laser devices mounted to the vehicle.

15. The method of claim 13, wherein the sensor includes one or more gyroscopes and accelerometers.

16. The method of claim 13, wherein the inertial data is received by the headset at a rate greater than 90 times per second.

17. The method of claim 13, wherein the localizer device is positioned based on a model of movement of the vehicle.

18. The method of claim 13, wherein the localizer device is positioned such that movement of the localizer device matches movement of the sensor.

19. The method of claim 13, wherein the inertial data is received by the processor from a telematics control unit of the vehicle.

20. The method of claim 13, further including providing the stabilized image to the headset occurs at a rate greater than 90 times per second.