PROJECTION TYPE DISPLAY DEVICE AND OPERATION ASSISTANCE METHOD

• US 20170355265A1
• Filed: 06/29/2017
• Published: 12/14/2017
• Est. Priority Date: 03/12/2015
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: FUJITA, Koudai
• Granted Patent: US 10,336,192 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/16 Type of output information
• CPC Class Codes: B60K 2360/18 Information management
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/20 Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60W 50/029 Adapting to failures or work around with other constraints, e.g. circumvention by avoiding use of failed parts
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G09G 2320/10 Special adaptations of display systems for operation with variable images
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/10 : Automotive applications
• CPC Class Codes: G09G 3/002 : to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 5/74 : Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 9/3194 : including sensor feedback

Abstract

Provided are a projection type display device and an operation assistance method that enable an operator to enjoy an operation assistance function even in the case of occurrence of abnormality in an optical modulation unit or an image information input unit during operation of a vehicle. A system control unit 47 of a HUD, if sensing abnormality in an optical modulation device 44 and a drive unit 45, stops a light source unit 40 and, furthermore, in the case of image information generated by a projected image information generation unit 52 including image information that calls attention of the operator to the front field of view, displays an alert image based on the image information on a liquid crystal display device 61 in a meter cluster.

Claims

1. A projection type display device comprising:

an image information generation unit that generates image information;

an optical modulation unit that spatially modulates light emitted from a light source unit in accordance with the image information;

an image information input unit that inputs the image information into the optical modulation unit;

a projection unit that projects the light spatially modulated by the optical modulation unit to a projection surface disposed on a windshield of a vehicle;

an abnormality sensing unit that senses abnormality in at least one of the optical modulation unit or the image information input unit; and

a control unit that

stops at least one of the optical modulation unit or the light source unit in a case of the abnormality sensing unit sensing abnormality in at least one of the optical modulation unit or the image information input unit,

determines whether or not the image information generated by the image information generation unit includes image information which calls attention of an operator of the vehicle to the field of view in a travelling direction of the vehicle, and

produces an output for calling attention of the operator to the field of view in a case of the image information including the image information calling attention.

2. The projection type display device according to claim 1,

wherein the control unit displays, on a display device mounted in the vehicle, an image that corresponds to the image information calling attention.

3. The projection type display device according to claim 2,

wherein the control unit displays, on the display device, the image corresponding to the image information calling attention in a position that corresponds to a projection position, on the projection surface, of light corresponding to the image information calling attention.

4. The projection type display device according to claim 2,

wherein the control unit displays, on the display device, an icon calling attention and a message calling attention as the image corresponding to the image information calling attention.

5. The projection type display device according to claim 2,

wherein the display device further displays an image other than the image corresponding to the image information calling attention, and

the control unit replaces a part of the image, other than the image corresponding to the image information calling attention, displayed on the display device with the image corresponding to the image information calling attention.

6. The projection type display device according to claim 2,

wherein the display device is a projection type display device that has the image information generation unit, the optical modulation unit, the image information input unit, the projection unit, the abnormality sensing unit, and the control unit.

7. The projection type display device according to claim 2,

wherein the control unit further displays an image for notifying the abnormality sensed by the abnormality sensing unit on the display device.

8. The projection type display device according to claim 1,

wherein the control unit outputs audio for calling attention of the operator to the field of view.

9. The projection type display device according to claim 1,

wherein the vehicle is an automobile.

10. An operation assistance method that uses a projection type display device mounted in a vehicle according to claim 1,

the projection type display device including the image information generation unit that generates image information, the optical modulation unit that spatially modulates light emitted from the light source unit in accordance with the image information, the image information input unit that inputs the image information into the optical modulation unit, and the projection unit that projects the light spatially modulated by the optical modulation unit to the projection surface disposed on the windshield of the vehicle, and

the method comprising:

sensing abnormality in at least one of the optical modulation unit or the image information input unit; and

stopping at least one of the optical modulation unit or the light source unit in a case of sensing abnormality in at least one of the optical modulation unit or the image information input unit,

determining whether or not the image information generated by the image information generation unit includes image information which calls attention of an operator of the vehicle to the field of view in a travelling direction of the vehicle, and

producing an output for calling attention of the operator to the field of view in a case of the image information including the image information calling attention.

11. The operation assistance method according to claim 10,

wherein, an image that corresponds to the image information calling attention is displayed on a display device mounted in the vehicle.

12. The operation assistance method according to claim 11,

wherein, the image corresponding to the image information calling attention is displayed on the display device in a position that corresponds to a projection position, on the projection surface, of light corresponding to the image information calling attention.

13. The operation assistance method according to claim 11,

wherein, an icon calling attention and a message calling attention are displayed on the display device as the image corresponding to the image information calling attention.

14. The operation assistance method according to claim 11,

wherein the display device further displays an image other than the image corresponding to the image information calling attention, and

a part of the image, other than the image corresponding to the image information calling attention, displayed on the display device is replaced with the image corresponding to the image information calling attention.

15. The operation assistance method according to claim 11,

wherein the display device is a projection type display device that has the image information generation unit, the optical modulation unit, the image information input unit, and the projection unit.

16. The operation assistance method according to claim 11,

wherein an image for notifying the sensed abnormality is further displayed on the display device.

17. The operation assistance method according to claim 10,

wherein audio for calling attention of the operator to the field of view is output.

18. The operation assistance method according to claim 10,

wherein the vehicle is an automobile.