Vehicle imaging device, vehicle imaging display system, and vehicle

• US 10,358,090 B2
• Filed: 08/07/2015
• Issued: 07/23/2019
• Est. Priority Date: 08/11/2014
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Shiohara, Ryuichi
• Primary Examiner(s): Ustaris, Joseph G
• Assistant Examiner(s): Kim, Matthew David
• Application Number:
  US15/501,484
• Publication Number:
  US 20170225621A1
• Time in Patent Office: 1,446 Days
• Field of Search: 348148
• CPC Class Codes: B60K 2360/16 Type of output information
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8033 for pedestrian protection
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/12 Devices in which the synchronising signals are only operative if a phase difference occurs between synchronising and synchronised scanning devices, e.g. flywheel synchronising
• CPC Class Codes: H04N 7/0127 by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicle imaging device for displaying an image of the outside of a vehicle on a display unit used in the vehicle includes an imaging unit that is attached to the vehicle, images of the outside of the vehicle, and outputs an imaging signal; an image signal generation unit that performs a generation process of generating an image signal indicating an image to be displayed in each line of the display unit based on the imaging signal, and outputs the image signal to the display unit; and a timing control unit that controls a timing when the image signal generation unit outputs the image signal to the display unit.

Claims

1. A vehicle imaging device for displaying an image of the outside of a vehicle on a display unit used in the vehicle, the device comprising:

an imaging unit that is attached to the vehicle, images an image of the outside of the vehicle, and outputs an imaging signal, the imaging unit imaging an image of a rear lateral area of the vehicle; and

an image processing circuit including

an image signal generation unit that performs a generation process of generating an image signal indicating an image to be displayed in each line of the display unit based on the imaging signal, and outputs the image signal to the display unit, and

a timing control unit that controls a timing when the image signal generation unit outputs the image signal to the display unit,

wherein, when a time from when a frame of the imaging signal is started to when a frame of the image signal output to the display unit is started is a phase difference, a frame rate of the imaging unit is a first frame rate, and a highest frame rate at which the display unit is configured to display is a second frame rate,

the timing control unit is configured to perform first timing control for decreasing the phase difference by causing the image signal generation unit to output the image signal such that the frame rate of the display unit is the second frame rate in a case where the phase difference is greater than a predetermined time, and second timing control for causing the image signal generation unit to output the image signal such that the frame rate of the display unit is the first frame rate after the phase difference is equal to or less than the predetermined time,

wherein the generation process includes at least one of a first process or a second process, or both, the first process is a process of relatively further magnifying an area of the image based on the imaging signal which is close to a vehicle body in a left and right direction than an area thereof which is far away from the vehicle body, and the second process is a process of relatively further magnifying an area of the image based on the imaging signal which is located in the center in an up and down direction than an area thereof which is located in an upper or lower area than the center area,

wherein, when a length of the area close to the vehicle body in the left and right direction is X1 and a magnification ratio thereof is H1, and a length of the area far away from the vehicle body in the left and right direction is X2 and a minification ratio thereof is H2, the H1 and the H2 are determined such that X1+X2=X1·

H1+X2·

H2 in the first process, and

when a length of the center area in the up and down direction is Y1 and a magnification ratio thereof is V1, a length of the upper area in the up and down direction is Y2 and a minification ratio thereof is V2, and a length of the lower area in the up and down direction is Y3 and a minification ratio thereof is V3, the V1, the V2 and the V3 are determined such that Y1+Y2+Y3=Y1·

V1+Y2·

V2+Y3·

V3 in the second process.

2. The vehicle imaging device according to claim 1, further comprising:

a display device through which an instruction of a user is configured to be input,

wherein at least one of the magnification ratio of the area close to the vehicle body in the left and right direction and the minification ratio of the area far away from the vehicle body in the left and right direction, and at least one of the magnification ratio of the center area in the up and down direction, the minification ratio of the upper area in the up and down direction, and the minification ratio of the lower area in the up and down direction are input through the display device in the first process.

3. The vehicle imaging device according to claim 1,

wherein the generation process includes a trimming process of trimming the image based on the imaging signal.

4. The vehicle imaging device according to claim 3,

wherein the imaging unit is fixed to and attached to the vehicle, and

in the trimming process, the image based on the imaging signal is trimmed in response to an operation of a display device through which an instruction of a user is input.

5. The vehicle imaging device according to claim 1,

wherein the generation process includes a trimming process of trimming the image based on the imaging signal, and a magnification varying process of magnifying or minifying a first area and a second area of the image based on the imaging signal to cause a magnification of the first area and a magnification of the second area to be different, and

the magnification varying process is performed after the trimming process.

6. The vehicle imaging device according to claim 1,

wherein the generation process includes a process of generating a mirror image acquired by reversing the left and right of the image based on the imaging signal.

7. The vehicle imaging device according to claim 1,

wherein the imaging unit includes a lens, and an image sensor that outputs the imaging signal, and

the generation process includes a process of correcting distortion of the lens.

8. A vehicle imaging display system comprising:

the vehicle imaging device according to claim 1; and

the display unit.

9. The vehicle imaging display system according to claim 8,

wherein the display unit includes a projector, a field lens that adjusts a direction of irradiation light of the projector, and a combiner that reflects light from the field lens to output the reflected light through an opening, and

the projector and the field lens are provided above the opening.

10. The vehicle imaging display system according to claim 8,

wherein three pairs of vehicle imaging devices and display units are provided and

the three pairs include a first vehicle imaging device that outputs the image signal indicating an image of a rear left side of the vehicle, a second vehicle imaging device that outputs the image signal indicating an image of a rear side of the vehicle, a third vehicle imaging device that outputs the image signal indicating an image of a rear right side of the vehicle, a first display unit that displays the image signal output from the first vehicle imaging device, a second display unit that displays the image signal output from the second vehicle imaging device, and a third display unit that displays the image signal output from the third vehicle imaging device,

the first display unit is disposed on a left side of the second display unit,

the third display unit is disposed in a right side of the second display unit, and

the first display unit that displays the image signal output from the first vehicle imaging device is provided.

11. A vehicle comprising the vehicle imaging display system according to claim 8.

12. An imaging device for displaying an image of the outside of a vehicle on a display unit used in the vehicle, the device comprising:

an image sensor that captures an image of the outside of the vehicle, and outputs an imaging signal corresponding to the image, the imaging unit imaging an image of a rear lateral area of the vehicle; and

an image processing circuit including

an image signal generation unit that performs a generation process of generating an image signal indicating an image to be displayed in the display unit based on the imaging signal, and outputs the image signal to the display unit, and

a timing control unit that controls a capturing timing of the imaging signal by the image sensor based on a first frame rate, a display timing of the image signal on the display unit based on a second frame rate, and a phase difference between the capturing timing of the imaging signal and the display timing of the image signal,

wherein the second frame rate is faster than the first frame rate when the phase difference becomes larger than a predetermined time,

wherein the second frame rate is same as the first frame rate when the phase difference becomes smaller than or equal to the predetermined time,

wherein the generation process includes at least one of a first process or a second process, or both, the first process is a process of relatively further magnifying an area of the image based on the imaging signal which is close to a vehicle body in a left and right direction than an area thereof which is far away from the vehicle body, and the second process is a process of relatively further magnifying an area of the image based on the imaging signal which is located in the center in an up and down direction than an area thereof which is located in an upper or lower area than the center area,

wherein, when a length of the area close to the vehicle body in the left and right direction is X1 and a magnification ratio thereof is H1, and a length of the area far away from the vehicle body in the left and right direction is X2 and a minification ratio thereof is H2, the H1 and the H2 are determined such that X1+X2=X1·

H1+X2·

H2 in the first process, and

when a length of the center area in the up and down direction is Y1 and a magnification ratio thereof is V1, a length of the upper area in the up and down direction is Y2 and a minification ratio thereof is V2, and a length of the lower area in the up and down direction is Y3 and a minification ratio thereof is V3, the V1, the V2 and the V3 are determined such that Y1+Y2+Y3=Y1·

V1+Y2·

V2+Y3·

V3 in the second process.

13. A vehicle imaging display system comprising:

the imaging device according to claim 12; and

the display unit.

14. A vehicle comprising the vehicle imaging display system according to claim 13.