In-vehicle image display system and image processing method

• US 10,696,231 B2
• Filed: 02/28/2018
• Issued: 06/30/2020
• Est. Priority Date: 03/31/2017
• Status: Active Grant

• Current Assignee: Mazda Motor Corporation
• Original Assignee: Mazda Motor Corporation
• Inventors: Matsuba, Yoshiaki, Ohtsubo, Tomonori, Nakamura, Seishi, Hashimoto, Naotomo
• Primary Examiner(s): Pontius, James M
• Application Number:
  US16/494,703
• Publication Number:
  US 20200010019A1
• Time in Patent Office: 853 Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/8086 for vehicle path indication
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Disclosed is an in-vehicle image display device equipped in a vehicle to support driving of a driver. The in-vehicle image display system comprises: a side camera installed to a lateral portion of an exterior of the vehicle to face outwardly and configured to take an image of an area lateral to the vehicle by using a wide-angle lens; a processing unit configured to correct a wide-angle image taken by the side camera to generate a planar image, and process the planar image to generate a processed image; and a display unit configured to display the processed image transmitted from the processing unit on a screen, wherein the processing unit is operable to execute a secondary processing of the planar image so as not to include an image region located outward from the reachable position in a vehicle-width direction, in order to generate the processed image.

Claims

1. An in-vehicle image display system equipped in a vehicle to support driving of a driver, comprising:

a side camera installed to a lateral portion of an exterior of the vehicle to face outwardly and configured to take an image of an area lateral to the vehicle by using a wide-angle lens;

a processing unit configured to correct a wide-angle image taken by the side camera to generate a planar image, and process the planar image to generate a processed image; and

a display unit configured to display the processed image transmitted from the processing unit on a screen,

wherein the processing unit is operable to set a position of the vehicle at a predetermined setup vehicle speed, as a reference position,

wherein the processing unit is operable to set a position which is reached by a part of a contour of the vehicle located at a farthermost position with respect to a center of the vehicle in the reference position as a reachable position, in a position of vehicle where the vehicle has stopped by being decelerated from the reference position under a maximum steering angle and a predetermined braking force, and

wherein the processing unit is operable to execute a secondary processing of the planar image so as not to include an image region located outward from the reachable position in a vehicle-width direction, in order to generate the processed image.

2. The in-vehicle image display system as recited in claim 1, wherein the reachable position is defined based on:

a free running distance which is a traveling distance of the vehicle in the vehicle-width direction as measured based on the setup vehicle speed and the maximum steering angle during a time period from a time when the driver recognizes an object through until the driver starts a braking action; and

a braking distance which is a traveling distance of the vehicle in the vehicle-width direction as measured based on the setup vehicle speed and the maximum steering angle during a time period from a time when the driver starts the braking action through until the vehicle is stopped.

3. The in-vehicle image display system as recited in claim 1, wherein an optical axis of the wide-angle lens is set to extend toward a give position of a traveling road surface section, such that a contrast ratio in an image region of the traveling road surface section taken until the part of the contour of the vehicle reaches the reachable position becomes 30% or more.

4. An image processing method for an in-vehicle image display system for supporting driving of a driver, comprising the steps of:

receiving a wide-angle image taken by a side camera configured to take an image of an area lateral to a vehicle, through a wide-angle lens of the side camera;

correcting the wide-angle image to generate a planar image, and processing the planar image to generate a processed image;

setting a position of the vehicle at a predetermined setup vehicle speed, as a reference position;

setting a position which is reached by a part of a contour of the vehicle located at a farthermost position with respect to a center of the vehicle in the reference position as a reachable position, in a position of vehicle where the vehicle has stopped by being decelerated from the reference position under a maximum steering angle and a predetermined braking force; and

executing a secondary processing of the planar image so as not to include an image region located outward from the reachable position in a vehicle-width direction, in order to generate the processed image.