Apparatus for providing vehicular environment information

• US 10,882,451 B2
• Filed: 08/14/2017
• Issued: 01/05/2021
• Est. Priority Date: 09/08/2016
• Status: Active Grant

• Current Assignee: Knorr-Bremse Systeme Fur Nutzfahrzeuge GMBH (Estate of Heinz Hermann Thiele)
• Original Assignee: Knorr-Bremse Systeme Fur Nutzfahrzeuge GMBH (Estate of Heinz Hermann Thiele)
• Inventors: Nemeth, Huba, Tihanyi, Viktor, Varga, Robert
• Primary Examiner(s): Bee, Andrew W
• Application Number:
  US16/327,163
• Publication Number:
  US 20190225153A1
• Time in Patent Office: 1,240 Days
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

An apparatus for providing vehicular environment information, includes acquiring with at least one sensor vehicular environment data that is external to a vehicle. The at least one sensor comprises at least one camera, and the vehicular environment data comprises image data. The vehicular environment data is provided to a processing unit. The processing unit determines vehicular environment information. The determination of the vehicular environment information comprises use of the vehicular environment data. At least part of the image data is displayed on a display monitor on the basis of the vehicular environment information. The processing unit causes the display monitor to display the at least part of the image data.

Claims

1. A monitoring toggling system for providing vehicular environment information for a vehicle, comprising:

at least one sensor;

a display monitor; and

a processing unit;

wherein the at least one sensor is configured to acquire vehicular environment data that is external to a vehicle,

wherein the at least one sensor includes at least one camera, and the vehicular environment data includes image data,

wherein the at least one sensor is configured to provide the vehicular environment data to the processing unit,

wherein the processing unit is configured to determine vehicular environment information, wherein the determination of the vehicular environment information includes use of the vehicular environment data,

wherein the processing unit is configured to cause the display monitor to display at least part of the image data based on the vehicular environment information,

wherein the at least one camera includes at least two cameras, wherein a first camera is configured to acquire first image data for a first scene associated with the vehicle and a second camera is configured to acquire second image data for a second scene associated with the vehicle, and wherein the image data includes the first image data and the second image data, and wherein the at least part of the image data includes at least a part of the first image data and/or at least a part of the second image data,

wherein the processing unit is configured to automatically toggle between showing a first display image and a second display image on the display monitor and/or to automatically toggle superimposed views on the display monitor, based on the vehicular environment information and whether an object has been detected in the image data,

wherein the at least one sensor includes the at least one camera and at least one active sensor, and the vehicular environment information includes radar data,

wherein environment scene data acquired by the at least one camera is augmented or extended by the active sensor to obtain detection of the object in different weather conditions and improve night-time operation,

wherein a driver is provided with image data from camera views and generated image perspectives depending upon if the object is detected in a sensing zone, and if more than one camera is operating, image data is automatically toggle-able between images depending upon whether the object is detected in one of the camera views,

wherein the toggling monitoring system has an active status and a passive status, wherein in the passive status, the display monitor shows a rearward looking view that is used to replace traditional mirror functionalities during driving on a road, and wherein in the active status, depending on whether the object is present in a first vision zone, in a vicinity of the vehicle, the display monitor toggles to a relevant camera view or image representation to inform the driver about an occurring traffic situation, and

wherein the vehicle is a truck or a bus.

2. The monitoring toggling system of claim 1, wherein the vehicular environment information relates to an object detected within the at least part of the image data.

3. The monitoring toggling system of claim 1, wherein the first image data includes image data for a rearward facing scene relative to the vehicle.

4. The monitoring toggling system of claim 3, wherein the display monitor is internal to the vehicle.

5. The monitoring toggling system of claim 4, where in a default situation the display monitor is configured to display the image data for the rearward scene.

6. The monitoring toggling system of claim 1, wherein the display monitor is a monitor configured to display vehicle telemetry information.

7. The monitoring toggling system of claim 1, wherein, the at least one sensor includes a driver intention sensor configured to acquire driver intention data, wherein the driver intention sensor is configured to provide the driver intention data to the processing unit, and wherein the determination of the vehicular environment information includes use of the driver intention data.

8. A vehicle, comprising:

a monitoring toggling system for providing vehicular environment information for a vehicle, including;

at least one sensor;

a display monitor; and

a processing unit;

wherein the at least one sensor is configured to acquire vehicular environment data that is external to a vehicle,

wherein the at least one sensor includes at least one camera, and the vehicular environment data includes image data,

wherein the at least one sensor is configured to provide the vehicular environment data to the processing unit,

wherein the processing unit is configured to determine vehicular environment information, wherein the determination of the vehicular environment information includes use of the vehicular environment data,

wherein the processing unit is configured to cause the display monitor to display at least part of the image data based on the vehicular environment information,

wherein the at least one camera includes at least two cameras, wherein a first camera is configured to acquire first image data for a first scene associated with the vehicle and a second camera is configured to acquire second image data for a second scene associated with the vehicle, and wherein the image data includes the first image data and the second image data, and wherein the at least part of the image data includes at least a part of the first image data and/or at least a part of the second image data,

wherein the processing unit is configured to automatically toggle between showing a first display image and a second display image on the display monitor and/or to automatically toggle superimposed views on the display monitor, based on the vehicular environment information and whether an object has been detected in the image data,

wherein the at least one sensor includes the at least one camera and at least one active sensor, and the vehicular environment information includes radar data,

wherein environment scene data acquired by the at least one camera is augmented or extended by the active sensor to obtain detection of the object in different weather conditions and improve night-time operation,

wherein a driver is provided with image data from camera views and generated image perspectives depending upon if the object is detected in a sensing zone, and if more than one camera is operating, image data is automatically toggle-able between images depending upon whether the object is detected in one of the camera views,

wherein the toggling monitoring system has an active status and a passive status, wherein in the passive status, the display monitor shows a rearward looking view that is used to replace traditional mirror functionalities during driving on a road, and wherein in the active status, depending on whether the object is present in a first vision zone, in a vicinity of the vehicle, the display monitor toggles to a relevant camera view or image representation to inform the driver about an occurring traffic situation, and

wherein the vehicle is a truck or a bus.

9. A method for providing vehicular environment information for a vehicle by a monitoring toggling system, the method comprising:

acquiring, via at least one sensor, at least one sensor vehicular environment data that is external to a vehicle, wherein, the at least one sensor includes at least one camera, and the vehicular environment data includes image data, and wherein the mintoring toggling system includes the at least one sensor, the processing unit, and the display monitor;

providing the vehicular environment data to a processing unit;

determining with the processing unit vehicular environment information, wherein the determination of the vehicular environment information includes use of the vehicular environment data; and

displaying at least part of the image data on a display monitor based on the vehicular environment information, wherein the processing unit causes the display monitor to display the at least part of the image data;

wherein the at least one camera includes at least two cameras, wherein a first camera is configured to acquire first image data for a first scene associated with the vehicle and a second camera is configured to acquire second image data for a second scene associated with the vehicle, and wherein the image data includes the first image data and the second image data, and wherein the at least part of the image data includes at least a part of the first image data and/or at least a part of the second image data,

wherein the processing unit is configured to automatically toggle between showing a first display image and a second display image on the display monitor and/or to automatically toggle superimposed views on the display monitor, based on the vehicular environment information and whether an object has been detected in the image data,

wherein the at least one sensor includes the at least one camera and at least one active sensor, and the vehicular environment information includes radar data,

wherein environment scene data acquired by the at least one camera is augmented or extended by the active sensor to obtain detection of the object in different weather conditions and improve night-time operation,

wherein a driver is provided with image data from camera views and generated image perspectives depending upon if the object is detected in a sensing zone, and if more than one camera is operating, image data is automatically toggle-able between images depending upon whether the object is detected in one of the camera views,

wherein the toggling monitoring system has an active status and a passive status, wherein in the passive status, the display monitor shows a rearward looking view that is used to replace traditional mirror functionalities during driving on a road, and wherein in the active status, depending on whether the object is present in a first vision zone, in a vicinity of the vehicle, the display monitor toggles to a relevant camera view or image representation to inform the driver about an occurring traffic situation, and

wherein the vehicle is a truck or a bus.