VEHICLE CONTROL SYSTEM, VEHICLE CONTROL METHOD, AND VEHICLE CONTROL PROGRAM

• US 20170336797A1
• Filed: 05/23/2017
• Published: 11/23/2017
• Est. Priority Date: 05/23/2016
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Abe, Masaaki, Hatano, Kunimichi, Asakura, Masahiko, Sen, Naoto
• Granted Patent: US 10,514,703 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/306 using a re-scaling of images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2420/408 Radar; Laser, e.g. lidar
• CPC Class Codes: B60W 2510/202 Steering torque
• CPC Class Codes: B60W 2520/10 Longitudinal speed
• CPC Class Codes: B60W 2520/14 Yaw
• CPC Class Codes: B60W 2540/10 Accelerator pedal position
• CPC Class Codes: B60W 2540/12 Brake pedal position
• CPC Class Codes: B60W 2540/18 Steering angle
• CPC Class Codes: B60W 2540/225 Direction of gaze
• CPC Class Codes: B60W 2554/801 Lateral distance
• CPC Class Codes: B60W 2554/802 Longitudinal distance
• CPC Class Codes: B60W 50/082 Selecting or switching between different modes of propelling
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B60W 60/0051 from occupants to vehicle
• CPC Class Codes: B60W 60/0053 : from vehicle to occupant
• CPC Class Codes: G02B 2027/0138 : comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 : comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 : characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0187 : slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 : with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 : characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0179 : Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G05D 1/0212 : with means for defining a desired trajectory involving a plurality of land vehicles G05D1/0287
• CPC Class Codes: G05D 1/0246 : using a video camera in combination with image processing means
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A vehicle control system includes an imaging section, a surroundings monitoring section, and a display controller. The imaging section is configured to capture an image of surroundings of a vehicle. The surroundings monitoring section is configured to monitor conditions surrounding the vehicle. The display controller is configured to display, on a display present within a cabin of the vehicle and configured to display an image based on an operation by an occupant, an image of surroundings of the vehicle superimposed over part of an image based on an operation by the occupant, and to enlarge the image of the surroundings of the vehicle based on a monitoring result from the surroundings monitoring section.

Claims

1. A vehicle control system comprising:

an imaging device configured to capture an image of surroundings of a vehicle;

a surroundings monitoring controller configured to monitor conditions surrounding the vehicle; and

a display controller configured to;

display, on a display present within a cabin of the vehicle and configured to display an image based on an operation by an occupant, the image of surroundings of the vehicle superimposed over part of the image based on the operation by the occupant, and

enlarge the image of the surroundings of the vehicle in accordance with a monitoring result of the monitoring by the surroundings monitoring controller.

3. The vehicle control system according to claim 1, wherein the display is a mobile display.

4. The vehicle control system according to claim 1, further comprising a detector configured to detect a gaze of the occupant of the vehicle;

wherein the display controller displays the image of surroundings of the vehicle on the display present in a direction corresponding to the gaze of the occupant of the vehicle detected by the detector.

5. The vehicle control system according to claim 4, wherein, when there is a plurality of the displays present in the direction corresponding to the gaze of the occupant detected by the detector, the display controller displays the image of the surroundings on each of the plurality of displays.

6. The vehicle control system according to claim 1, further comprising an automated driving controller configured to execute automated driving in which at least one of speed control and steering control of the vehicle is performed automatically based on the monitoring result of the monitoring by the surroundings monitoring controller;

wherein the display controller displays, on the display, information indicating conditions surrounding the vehicle in accordance with the monitoring result of the monitoring by the surroundings monitoring controller while the automated driving is being executed by the automated driving controller.

11. The vehicle control system according to claim 1, wherein the image based on the operation by the occupant includes an image content selected by the occupant.

12. The vehicle control system according to claim 6, the automated driving controller executes a driving event provided by an action plan to control the vehicle, and the display controller displays, on the display, conditions surrounding the vehicle in the direction in which the driving event occurs.

2. A vehicle control system comprising:

an imaging device configured to capture an image of surroundings of a vehicle;

a surroundings monitoring controller configured to monitor conditions surrounding the vehicle; and

a display controller configured to display, by using a display configured to display an image overlaid onto a mirror provided to the vehicle, the image of surroundings of the vehicle in accordance with a monitoring result of the monitoring by the surroundings monitoring controller.

7. A vehicle control method executed by an on-board computer, the method comprising:

capturing an image of surroundings of a vehicle by an imaging device;

monitoring conditions surrounding the vehicle;

displaying, on a display present within a cabin of the vehicle and configured to display an image based on an operation by an occupant, the image of surroundings of the vehicle superimposed over part of the image based on the operation by the occupant; and

enlarging the image of the surroundings of the vehicle in accordance with a monitoring result of the conditions surrounding the vehicle.

8. A vehicle control method executed by an on-board computer, the method comprising:

capturing an image of surroundings of a vehicle by an imaging device;

monitoring conditions surrounding the vehicle; and

displaying, by using a display configured to display an image overlaid onto a mirror provided to the vehicle, the image of surroundings of the vehicle in accordance with a monitoring result of the conditions surrounding the vehicle.

9. A non-transitory computer readable medium storing a vehicle control program for causing an on-board computer to execute processing, the processing comprising:

processing to capture an image of surroundings of a vehicle by an imaging device;

processing to monitor conditions surrounding the vehicle; and

processing to display, on a display present within a cabin of the vehicle and configured to display an image based on an operation by an occupant, the image of surroundings of the vehicle superimposed over part of the image based on the operation by the occupant, and to enlarge the image of the surroundings of the vehicle in accordance with a monitoring result of the conditions surrounding the vehicle.

10. A non-transitory computer readable medium storing a vehicle control program for causing an on-board computer to execute processing, the processing comprising:

processing to capture an image of surroundings of a vehicle by an imaging device;

processing to monitor conditions surrounding the vehicle; and

processing to display, by using a display configured to display an image overlaid onto a mirror provided to the vehicle, the image of surroundings of the vehicle in accordance with a monitoring result of the conditions surrounding the vehicle.