Vehicle-mounted image recognition apparatus and method of manufacturing the same

• US 10,318,825 B2
• Filed: 10/25/2017
• Issued: 06/11/2019
• Est. Priority Date: 12/17/2014
• Status: Active Grant

• Current Assignee: Nidec Copal Corporation (Nidec Corporation)
• Original Assignee: Nidec Copal Corporation (Nidec Corporation), Nidec Elesys Corporation (Nidec Corporation)
• Inventors: Nakamura, Yuta, Nagai, Yohei, Takehara, Yushi, Takeda, Naoya
• Primary Examiner(s): Bitar, Nancy
• Application Number:
  US15/792,798
• Publication Number:
  US 20180060678A1
• Time in Patent Office: 594 Days
• Field of Search: None
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/40 characterised by the details of the power supply or the coupling to vehicle components
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

In a vehicle-mounted image recognition apparatus, a resolution of an image projected on an imaging plane of an image sensor is different at a position away from a center between a circumferential direction and a radial direction. To make a circumferential resolution higher than a radial resolution, at least a lower half of the imaging plane is located closer to a circumferential focus than a middle of a radial focus and the circumferential focus at a position off the optical axis center of the image projected on the image sensor through the image-forming optical system. This is achieved by adjusting the position of the imaging plane when manufacturing or by selecting a lens with high circumferential resolution. This apparatus improves recognition accuracy in recognizing traffic lanes without using an expensive lens exhibiting high resolution both in the circumferential direction and in the radial direction.

Claims

1. A vehicle-mounted image recognition apparatus comprising:

a fixed-focus image-forming optical system having an optical axis, the image-forming optical system forming an image of a front scene at a rear position on the optical axis;

an image sensor disposed at the rear position on the optical axis of the image-forming optical system, the optical axis extending through an imaging plane of the image sensor;

a sensor retainer holding the image sensor;

an image-forming optical system retainer holding the image-forming optical system; and

an integrated circuit obtaining data of the image captured by the image sensor and performing an image recognition process;

wherein

at least a portion of a gap between the sensor retainer and the image-forming optical system retainer is filled with an adhesive;

an edge portion of the image-forming optical system retainer is not in contact with the sensor retainer;

at least a lower half of the imaging plane is located closer to a circumferential focus than a middle between a radial focus and the circumferential focus, at a position distant from an optical axis center of the image by about 70% of an image height of the image;

a distance between the circumferential focus and the imaging plane is smaller than a distance between the circumferential focus and the radial focus;

the integrated circuit recognizing a line indicating a traffic lane on a road surface in performing the image recognition process;

the radial focus is defined as a point at which a maximum radial resolving power of light converging through the image-forming optical system is obtained when a projection surface moves along the optical axis;

the circumferential focus is defined as a point at which a maximum circumferential resolving power of the converging light is obtained when the projection surface moves along the optical axis;

the lower half is defined as a portion of the imaging plane on which a lower half of the scene in a vertical direction is projected;

the image height is defined as half a diagonal length of the imaging plane; and

the optical axis center is defined as an intersection of the optical axis and the imaging plane.

2. The vehicle-mounted image recognition apparatus of claim 1, wherein an image captured by the image sensor has generally a rectangular shape;

and

a length from a center of the image to an either one of the horizontal edge of the image is smaller than about 70% of an image height of the image.

3. The vehicle-mounted image recognition apparatus of claim 1, wherein the distance between the circumferential focus and the imaging plane is less than half a distance between the imaging plane and the radial focus at the position distant from the optical axis center by about 70% of the image height.

4. The vehicle-mounted image recognition apparatus of claim 2, wherein the distance between the circumferential focus and the imaging plane is less than half a distance between the imaging plane and the radial focus at the position distant from the optical axis center by about 70% of the image height.

5. The vehicle-mounted image recognition apparatus of claim 1, wherein

at the position distant from the optical axis center on the imaging plane of the image sensor by about 70% of the image height, the circumferential resolving power of the image projected on the imaging plane through the image-forming optical system is higher than the radial resolving power;

the circumferential resolving power is defined as a modulation transfer function value with respect to an image of a plurality of black straight lines arranged in a circumferential direction at an interval of about 1/(9d) lp/mm and extending in a radial direction on the imaging plane, d (mm) being a pixel spacing of the image sensor.

6. The vehicle-mounted image recognition apparatus of claim 2, wherein

at the position distant from the optical axis center on the imaging plane of the image sensor by about 70% of the image height, the circumferential resolving power of the image projected on the imaging plane through the image-forming optical system is higher than the radial resolving power;

the circumferential resolving power is defined as a modulation transfer function value with respect to an image of a plurality of black straight lines arranged in a circumferential direction at an interval of about 1/(9d) lp/mm and extending in a radial direction on the imaging plane, d (mm) being a pixel spacing of the image sensor.

7. The vehicle-mounted image recognition apparatus of claim 3, wherein

at the position distant from the optical axis center on the imaging plane of the image sensor by about 70% of the image height, the circumferential resolving power of the image projected on the imaging plane through the image-forming optical system is higher than the radial resolving power;

the circumferential resolving power is defined as a modulation transfer function value with respect to an image of a plurality of black straight lines arranged in a circumferential direction at an interval of about 1/(9d) lp/mm and extending in a radial direction on the imaging plane, d (mm) being a pixel spacing of the image sensor.

8. The vehicle-mounted image recognition apparatus of claim 4, wherein

at the position distant from the optical axis center on the imaging plane of the image sensor by about 70% of the image height, the circumferential resolving power of the image projected on the imaging plane through the image-forming optical system is higher than the radial resolving power;

the circumferential resolving power is defined as a modulation transfer function value with respect to an image of a plurality of black straight lines arranged in a circumferential direction at an interval of about 1/(9d) lp/mm and extending in a radial direction on the imaging plane, d (mm) being a pixel spacing of the image sensor.

9. The vehicle-mounted image recognition apparatus of claim 5, wherein

the image sensor includes a color filter array on a surface of the imaging plane;

and

the circumferential resolving power has a value greater than or equal to about 50%.

10. The vehicle-mounted image recognition apparatus of claim 6, wherein

the image sensor includes a color filter array on a surface of the imaging plane;

and

the circumferential resolving power has a value greater than or equal to about 50%.

11. The vehicle-mounted image recognition apparatus of claim 7, wherein

the image sensor includes a color filter array on a surface of the imaging plane;

and

the circumferential resolving power has a value greater than or equal to about 50%.

12. The vehicle-mounted image recognition apparatus of claim 8, wherein

the image sensor includes a color filter array on a surface of the imaging plane;

and

the circumferential resolving power has a value greater than or equal to about 50%.

13. The vehicle-mounted image recognition apparatus of claim 9, wherein the image-forming optical system has an F value less than or equal to 2.

14. The vehicle-mounted image recognition apparatus of claim 10, wherein the image-forming optical system has an F value less than or equal to 2.

15. The vehicle-mounted image recognition apparatus of claim 11, wherein the image-forming optical system has an F value less than or equal to 2.

16. The vehicle-mounted image recognition apparatus of claim 12, wherein the image-forming optical system has an F value less than or equal to 2.

17. A vehicle-mounted image recognition apparatus comprising:

a fixed-focus image-forming optical system having an optical axis, the image-forming optical system forming an image of a front scene at a rear position on the optical axis;

an image sensor disposed at the rear position on the optical axis of the image-forming optical system, the optical axis extending through an imaging plane of the image sensor;

a sensor retainer holding the image sensor;

an image-forming optical system retainer holding the image-forming optical system; and

an integrated circuit obtaining data of the image captured by the image sensor and performing an image recognition process;

wherein

at least a portion of a gap between the sensor retainer and the image-forming optical system retainer is filled with an adhesive;

an edge portion of the image-forming optical system retainer is not in contact with the sensor retainer;

at least in the lower half of the imaging plane located at a position of 70% of the image height from the optical axis center, a circumferential resolving power of an image projected on the image sensor by the imaging optical system is higher than a radial resolving power;

the integrated circuit recognizing a line indicating a traffic lane on a road surface in performing the image recognition process;

the radial focus is defined as a point at which a maximum radial resolving power of light converging through the image-forming optical system is obtained when a projection surface moves along the optical axis;

the circumferential focus is defined as a point at which a maximum circumferential resolving power of the converging light is obtained when the projection surface moves along the optical axis;

the lower half is defined as a portion of the imaging plane on which a lower half of the scene in a vertical direction is projected;

the image height is defined as half a diagonal length of the imaging plane; and

the optical axis center is defined as an intersection of the optical axis and the imaging plane.

18. The vehicle-mounted image recognition apparatus of claim 17, wherein

the image sensor includes a color filter array on a surface of the imaging plane;

and

a circumferential resolving power has a value greater than or equal to about 50%;

the circumferential resolving power is defined as a modulation transfer function value with respect to an image of a plurality of black straight lines arranged in a circumferential direction at an interval of about 1/(9d) lp/mm and extending in a radial direction on the imaging plane, d (mm) being a pixel spacing of the image sensor.

19. The vehicle-mounted image recognition apparatus of claim 17, wherein an image captured by the image sensor has generally a rectangular shape;

and

a length from a center of the image to an either one of the horizontal edge of the image is smaller than about 70% of an image height of the image.

20. The vehicle-mounted image recognition apparatus of claim 18, wherein the imaging plane of the image sensor has generally a rectangular shape;

and

a length from a center of the imaging plane to an either one of the horizontal edge of the imaging plane is smaller than about 70% of an image height of the image.

21. The vehicle-mounted image recognition apparatus of claim 17, wherein the image-forming optical system has an F value less than or equal to 2.

22. The vehicle-mounted image recognition apparatus of claim 18, wherein the image-forming optical system has an F value less than or equal to 2.

23. The vehicle-mounted image recognition apparatus of claim 19, wherein the image-forming optical system has an F value less than or equal to 2.

24. The vehicle-mounted image recognition apparatus of claim 20, wherein the image-forming optical system has an F value less than or equal to 2.