Projection type display device, control method of projection type display device, control program of projection type display device

• US 10,642,034 B2
• Filed: 06/19/2019
• Issued: 05/05/2020
• Est. Priority Date: 12/21/2016
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Oshima, Hiroyuki
• Primary Examiner(s): Crawford, Jacinta M
• Application Number:
  US16/445,217
• Publication Number:
  US 20190302453A1
• Time in Patent Office: 321 Days
• Field of Search: 345 7, 345 8, 345418
• CPC Class Codes: B60K 2360/48 Sensors
• CPC Class Codes: B60K 2360/66 Projection screens or combiners
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 11/02 for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
• CPC Class Codes: B60Y 2200/41 Construction vehicles, e.g. graders, excavators
• CPC Class Codes: B60Y 2200/412 Excavators
• CPC Class Codes: B60Y 2400/3044 Vibration sensors
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0183 Adaptation to parameters characterising the motion of the vehicle
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G03B 21/00 Projectors or projection-type viewers; Accessories therefor devices for changing pictures G03B23/00
• CPC Class Codes: G03B 21/10 Projectors with built-in or built-on screen
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: H04N 9/3102 using two-dimensional electronic spatial light modulators micromechanical modulators as such G02B26/0833; liquid crystal modulators as such G02F1/13
• CPC Class Codes: H04N 9/3111 for displaying the colours sequentially, e.g. by using sequentially activated light sources sequential projection in colour photography G03B33/08
• CPC Class Codes: H04N 9/3179 Video signal processing therefor
• CPC Class Codes: H04N 9/3194 : including sensor feedback

Abstract

Provided are a projection type display device, a control method of a projection type display device, and a control program of a projection type display device, capable of being continuously used even in a case where a vehicle vibrates, and performing optimal display depending on the vibration. An HUD 100 includes a projection display section 50 that projects image light obtained by spatially modulating light emitted from a light source onto a combiner 12 to display a virtual image, a first vibration detector 61 that detects a first vibration of the combiner 12, a second vibration detector 62 that detects a second vibration of the projection display section 50, a third vibration detector 63 that detects a third vibration of the projection display section 50 with respect to the combiner 12 on the basis of the first vibration and the second vibration, and a display controller 64 that controls the image to be displayed by the projection display section 50. The display controller 64 changes a display format of content to be displayed by the projection display section 50 on the basis of the third vibration.

Claims

1. A projection type display device comprising:

a projection display section that includes a light modulator that spatially modulates light emitted from a light source on the basis of input image information, and projects image light obtained through spatial modulation using the light modulator onto a combiner that is provided in a vehicle to display an image based on the image light;

a first vibration detector that detects a first vibration of the combiner;

a second vibration detector that detects a second vibration of the projection display section;

a third vibration detector that detects a third vibration of the projection display section with respect to the combiner on the basis of the first vibration and the second vibration; and

a display controller that controls the image information input to the light modulator to control the image to be displayed by the projection display section,

wherein the display controller changes a display format of content to be displayed by the projection display section on the basis of the third vibration.

2. The projection type display device according to claim 1,

wherein in a case where the third vibration satisfies a predetermined condition, the display controller changes the display format of the content to a display format with a visibility higher than a visibility of a display format of the content in a case where the third vibration does not satisfy the condition.

3. The projection type display device according to claim 2,

wherein the first vibration detector detects the first vibration in each of a first direction, a second direction, and a third direction, on the basis of acceleration information in each of the first direction, the second direction, and the third direction detected by a triaxial acceleration sensor fixed to the combiner,

wherein the second vibration detector detects the second vibration in each of the first direction, the second direction, and the third direction, on the basis of acceleration information in each of the first direction, the second direction, and the third direction detected by a triaxial acceleration sensor fixed to a housing including the projection display section,

wherein the third vibration detector detects the third vibration in the first direction on the basis of the first vibration and the second vibration in the first direction, detects the third vibration in the second direction on the basis of the first vibration and the second vibration in the second direction, and detects the third vibration in the third direction on the basis of the first vibration and the second vibration in the third direction,

wherein the condition includes a first condition relevant to the third vibration in the first direction, a second condition relevant to the third vibration in the second direction, and a third condition relevant to the third vibration in the third direction,

wherein at least one condition among the first condition, the second condition, and the third condition is different from other conditions among the first condition, the second condition, and the third condition, and

wherein the display controller changes the display format of the content in a case where the third vibration in the first direction satisfies the first condition, in a case where the third vibration in the second direction satisfies the second condition, or in a case where the third vibration in the third direction satisfies the third condition.

4. The projection type display device according to claim 3,

wherein in a case where an amplitude of the third vibration exceeds a threshold, the display controller continuously moves the content to be displayed by the projection display section in a direction where the third vibration is negated to display the content.

5. The projection type display device according to claim 2,

wherein in a case where an amplitude of the third vibration exceeds a threshold, the display controller continuously moves the content to be displayed by the projection display section in a direction where the third vibration is negated to display the content.

6. The projection type display device according to claim 2,

wherein in a case where an amplitude of the third vibration exceeds a threshold, the display controller causes the projection display section to display information for urging confirmation of a mounting state of the combiner.

7. The projection type display device according to claim 3,

wherein in a case where an amplitude of the third vibration exceeds a threshold, the display controller causes the projection display section to display information for urging confirmation of a mounting state of the combiner.

8. The projection type display device according to claim 1,

wherein in a case where an amplitude of the third vibration exceeds a threshold, the display controller continuously moves the content to be displayed by the projection display section in a direction where the third vibration is negated to display the content.

9. The projection type display device according to claim 1,

wherein in a case where an amplitude of the third vibration exceeds a threshold, the display controller causes the projection display section to display information for urging confirmation of a mounting state of the combiner.

10. A control method of a projection type display device that includes a projection display section that includes a light modulator that spatially modulates light emitted from a light source on the basis of input image information, and projects image light obtained through spatial modulation using the light modulator onto a combiner that is provided in a vehicle to display an image based on the image light, the method comprising:

a first vibration detection step of detecting a first vibration of the combiner;

a second vibration detection step of detecting a second vibration of the projection display section;

a third vibration detection step of detecting a third vibration of the projection display section with respect to the combiner on the basis of the first vibration and the second vibration; and

a display control step of controlling the image information input to the light modulator to control the image to be displayed by the projection display section,

wherein in the display control step, a display format of content to be displayed by the projection display section is changed on the basis of the third vibration.

11. The control method of the projection type display device according to claim 10,

wherein in the display control step, in a case where the third vibration satisfies a predetermined condition, the display format of the content is changed to a display format with a visibility higher than a visibility of a display format of the content in a case where the third vibration does not satisfy the condition.

12. The control method of the projection type display device according to claim 11,

wherein in the first vibration detection step, the first vibration in each of a first direction, a second direction, and a third direction is detected on the basis of acceleration information in each of the first direction, the second direction, and the third direction detected by a triaxial acceleration sensor fixed to the combiner,

wherein in the second vibration detection step, the second vibration in each of the first direction, the second direction, and the third direction is detected on the basis of acceleration information in each of the first direction, the second direction, and the third direction detected by a triaxial acceleration sensor fixed to a housing including the projection display section,

wherein in the third vibration detection step, the third vibration in the first direction is detected on the basis of the first vibration and the second vibration in the first direction, the third vibration in the second direction is detected on the basis of the first vibration and the second vibration in the second direction, and the third vibration in the third direction is detected on the basis of the first vibration and the second vibration in the third direction,

wherein the condition includes a first condition relevant to the third vibration in the first direction, a second condition relevant to the third vibration in the second direction, and a third condition relevant to the third vibration in the third direction,

wherein at least one condition among the first condition, the second condition, and the third condition is different from other conditions among the first condition, the second condition, and the third condition, and

wherein in the display control step, the display format of the content is changed in a case where the third vibration in the first direction satisfies the first condition, in a case where the third vibration in the second direction satisfies the second condition, or in a case where the third vibration in the third direction satisfies the third condition.

13. The control method of the projection type display device according to claim 12,

wherein in the display control step, in a case where an amplitude of the third vibration exceeds a threshold, the content to be displayed by the projection display section is continuously moved in a direction where the third vibration is negated to be displayed.

14. The control method of the projection type display device according to claim 11,

wherein in the display control step, in a case where an amplitude of the third vibration exceeds a threshold, the content to be displayed by the projection display section is continuously moved in a direction where the third vibration is negated to be displayed.

15. The control method of the projection type display device according to claim 11,

wherein in the display control step, in a case where an amplitude of the third vibration exceeds a threshold, the projection display section displays information for urging confirmation of a mounting state of the combiner.

16. The control method of the projection type display device according to claim 12,

wherein in the display control step, in a case where an amplitude of the third vibration exceeds a threshold, the projection display section displays information for urging confirmation of a mounting state of the combiner.

17. The control method of the projection type display device according to claim 10,

wherein in the display control step, in a case where an amplitude of the third vibration exceeds a threshold, the content to be displayed by the projection display section is continuously moved in a direction where the third vibration is negated to be displayed.

18. The control method of the projection type display device according to claim 10,

wherein in the display control step, in a case where an amplitude of the third vibration exceeds a threshold, the projection display section displays information for urging confirmation of a mounting state of the combiner.

19. A non-transitory computer readable medium storing a control program of a projection type display device that includes a projection display section that includes a light modulator that spatially modulates light emitted from a light source on the basis of input image information, and projects image light obtained through spatial modulation using the light modulator onto a combiner that is provided in a vehicle to display an image based on the image light, the control program causing a computer to execute:

a first vibration detection step of detecting a first vibration of the combiner;

a second vibration detection step of detecting a second vibration of the projection display section;

a third vibration detection step of detecting a third vibration of the projection display section with respect to the combiner on the basis of the first vibration and the second vibration; and

a display control step of controlling the image information input to the light modulator to control the image to be displayed by the projection display section,

wherein in the display control step, a display format of content to be displayed by the projection display section is changed on the basis of the third vibration.