In-vehicle projected reality motion correction

• US 10,580,386 B2
• Filed: 04/21/2017
• Issued: 03/03/2020
• Est. Priority Date: 04/21/2017
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Gusikhin, Oleg Yurievitch, Makke, Omar, Van Hoecke, Patrick Lawrence Jackson
• Primary Examiner(s): Sitta, Grant
• Application Number:
  US15/494,053
• Publication Number:
  US 20180308454A1
• Time in Patent Office: 1,047 Days
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: H04N 9/3179 Video signal processing therefor

Abstract

Method and apparatus are disclosed for stabilizing in-vehicle projected reality. An example in-vehicle projected reality system includes headset for displaying a projected reality image. The system also includes a localizer device for determining a headset pose in the vehicle. The system also includes a computing device for receiving the headset pose, receiving vehicle inertial data, determining a stabilized image based on the received headset pose and vehicle inertial data, and providing the stabilized image to the headset.

Claims

1. A system comprising:

a headset comprising a first sensor configured to receive light beams; and

a vehicle comprising;

a second sensor configured to collect inertial data of the vehicle; and

a localizer device fixedly positioned in the vehicle and configured to transmit the light beams in sweeping motions, wherein inertial forces of said localizer device correspond with the inertial data, and movement of said localizer device and said second sensor match; and

a computing device communicatively coupled to the headset, said second sensor, and said localizer device and configured to;

based on the light beams received at said first sensor, determine a headset pose; and

based on the headset pose and the inertial data, generate a headset image that synchronizes with the inertial forces,

wherein said localizer device is further configured to transmit the light beams in a horizontal sweeping motion and in a vertical sweeping motion,

wherein the computing device is further configured to determine the headset pose based on timing differences between a first occurrence of receiving the light beams in the horizontal sweeping motion at said first sensor and a second occurrence receiving the light beams in the vertical sweeping motion at said first sensor.

2. The system of claim 1, wherein said localizer device includes a pair of laser devices fixedly mounted in the vehicle.

3. The system of claim 1, wherein the headset pose includes a location and orientation of the headset.

4. The system of claim 1, wherein the computing device is a smart phone.

5. The system of claim 1, wherein the inertial data includes yaw data, pitch data, and acceleration data.

6. The system of claim 1, wherein said second sensor includes one or more gyroscopes and accelerometers.

7. The system of claim 1, wherein said second sensor collects the inertial data a rate greater than 90 times per second.

8. The system of claim 1, wherein said localizer device is positioned adjacent to said second sensor to cause inertial forces detected by said second sensor to correspond with inertial forces acting on said localizer device.

9. The system of claim 4, wherein the computing device receives the inertial data from a telematics control unit of the vehicle.

10. The system of claim 1, wherein the computing device provides the headset image to the headset at a rate greater than 90 times per second.

17. The system of claim 1, wherein said second sensor is positioned such that the inertial data collected by said second sensor identifies the inertial forces acting on said localizer device.

18. The system of claim 1, wherein headset image presented by the headset includes an augmented reality image.

19. The system of claim 1, wherein headset image presented by the headset is stabilized, based on the headset pose and the inertial data, to move in a manner that corresponds with inertial forces acting on the headset.

11. A method comprising:

receiving, via a first sensor of a headset, light beams;

detecting, via a second sensor of a vehicle, inertial data of the vehicle;

transmitting, via a localizer device fixedly positioned in the vehicle, the light beams in sweeping motions, wherein inertial forces of said localizer device correspond with the inertial data, and movement of said localizer device matches movement of said second sensor;

determining, via a processor communicatively coupled to the headset, said second sensor, and said localizer device, a headset pose based on the light beams received at said first sensor; and

generating, via the processor, a stabilized image that synchronizes with the inertial forces based on the headset pose and inertial data; and

presenting the stabilized image at the headset,

wherein said localizer device is further configured to transmit the light beams in a horizontal sweeping motion and in a vertical sweeping motion,

wherein the computing device is further configured to determine the headset pose based on timing differences between a first occurrence of receiving the light beams in the horizontal sweeping motion at said first sensor and a second occurrence receiving the light beams in the vertical sweeping motion at said first sensor.

12. The method of claim 11, wherein said localizer device includes a pair of laser devices mounted to the vehicle.

13. The method of claim 11, wherein said second sensor includes one or more gyroscopes and accelerometers.

14. The method of claim 11, wherein the inertial data is received by the headset at a rate greater than 90 times per second.

15. The method of claim 11, wherein the inertial data is received by the processor from a telematics control unit of the vehicle.

16. The method of claim 11, further including providing the stabilized image to the headset at a rate greater than 90 times per second.