Position adjustment method of vehicle display device

• US 9,772,496 B2
• Filed: 09/13/2016
• Issued: 09/26/2017
• Est. Priority Date: 03/27/2015
• Status: Active Grant

• Current Assignee: Panasonic Automotive Systems Company of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Kimura, Masayuki
• Primary Examiner(s): CRADDOCK, ROBERT J
• Application Number:
  US15/263,993
• Publication Number:
  US 20160377873A1
• Time in Patent Office: 378 Days
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60R 11/02 for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30268 Vehicle interior
• CPC Class Codes: G06T 3/14 Transformations for image registration, e.g. adjusting or mapping for alignment of images
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness

Abstract

In a vehicle display device including a HUD that displays a virtual image on a front field of a view of a driver and a viewpoint detecting camera that captures an image of the driver, a measuring camera is capable of capturing the virtual image. A calibration pattern is at a predetermined position with respect to a viewing angle of the virtual image and angles of view of the viewpoint detecting and measuring cameras. The calibration pattern is captured by the viewpoint detecting and measuring cameras, and the virtual image is captured by the measuring camera. The relative position and orientation between the viewpoint detecting camera and HUD are calculated as orientation information using an image captured by the viewpoint detecting camera and an image captured by the measuring camera. In addition, the position of the virtual image displayed by the HUD is adjusted using the calculated orientation information.

Claims

1. A position adjustment method of a vehicle display device including:

a display device configured to display a virtual image on a front field of view of a driver, and

a viewpoint detecting camera configured to capture an image of the driver, the method comprising;

installing a measuring camera in a position at which a calibration pattern for acquiring information for the virtual image and position adjustment can be captured, and disposing the calibration pattern in a predetermined position with respect to a viewing angle of the virtual image, an angle of view of the viewpoint detecting camera, and an angle of view of the measuring camera;

capturing the calibration pattern by the viewpoint detecting camera and the measuring camera;

capturing the virtual image by the measuring camera;

calculating a relative position and a relative orientation between the measuring camera and the viewpoint detecting camera, and calculating a relative position and a relative orientation between the measuring camera and the display device by using an image captured by the viewpoint detecting camera and an image captured by the measuring camera, and calculating a relative position and a relative orientation between the viewpoint detecting camera and the display device from the two relative positions and orientations as orientation information; and

adjusting a position of the virtual image displayed by the display device by using the orientation information.

2. The position adjustment method of a vehicle display device according to claim 1, further comprising disposing the calibration pattern within a range where the viewing angle of the virtual image, the angle of view of the viewpoint detecting camera, and the angle of view of the measuring camera overlap.

3. The position adjustment method of a vehicle display device according to claim 2,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

4. The position adjustment method of a vehicle display device according to claim 3, wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

5. The position adjustment method of a vehicle display device according to claim 2, wherein the calibration pattern is translucent.

6. The position adjustment method of a vehicle display device according to claim 5,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

7. The position adjustment method of a vehicle display device according to claim 6, wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

8. The position adjustment method of a vehicle display device according to claim 1, further comprising disposing the calibration pattern extending across a region within a range where the viewing angle of the virtual image and the angle of view of the measuring camera overlap, the region being outside the angle of view of the viewpoint detecting camera and a region within a range where the angle of view of the viewpoint detecting camera and the angle of view of the measuring camera overlap, the region being outside a range of the viewing angle of the virtual image.

9. The position adjustment method of a vehicle display device according to claim 8, wherein the calibration pattern is translucent.

10. The position adjustment method of a vehicle display device according to claim 8,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

11. The position adjustment method of a vehicle display device according to claim 10, wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

12. The position adjustment method of a vehicle display device according to claim 8,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

13. The position adjustment method of a vehicle display device according to claim 12, wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

14. The position adjustment method of a vehicle display device according to claim 1,

wherein in the calculating of the relative position and the relative orientation between the viewpoint detecting camera and the display device, the virtual image displayed by the display device includes a characteristic pattern for identifying which pixel of the virtual image appears in which pixel of an image captured by the measuring camera.

15. The position adjustment method of a vehicle display device according to claim 14, wherein the characteristic pattern for identifying the pixel is a pattern in which a color and brightness are temporally changed.

16. A position adjustment method of a vehicle display device including:

a display device configured to display a virtual image on a front field of view of a driver, and

a viewpoint detecting camera configured to capture an image of the driver, the method comprising;

installing a measuring camera configured to capture the virtual image, and

capturing by the viewpoint detecting camera a calibration pattern for acquiring information for position adjustment, the calibration pattern being attached to a predetermined position with respect to the measuring camera;

capturing the virtual image by the measuring camera;

calculating a relative position and a relative orientation between the measuring camera and the viewpoint detecting camera, and calculating a relative position and a relative orientation between the measuring camera and the display device by using an image captured by the viewpoint detecting camera and an image captured by the measuring camera, and calculating a relative position and a relative orientation between the viewpoint detecting camera and the display device from the two relative positions and orientations as orientation information; and

adjusting a position of the virtual image displayed by the display device by using the orientation information.