SURROUNDINGS MONITORING SYSTEM FOR A VEHICLE

• US 20150258935A1
• Filed: 03/11/2014
• Published: 09/17/2015
• Est. Priority Date: 03/11/2014
• Status: Active Grant

• Current Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Nagata, Katsumi, Lota, Charan
• Granted Patent: US 9,598,012 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 2300/102 using 360 degree surveillance camera system
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A surroundings monitoring system includes a first sensor subsystem operable to provide image data from around the vehicle; a second sensor subsystem operable to provide non-image data from around the vehicle; a control subsystem in communication with the first sensor subsystem and the second sensor subsystem, the control subsystem operable to generate manipulated image data symbology from the image data and arrange the manipulated image data symbology in response to the non-image data to generate a driver perspective view; and a display in communication with the control subsystem to display the driver perspective view. A method of monitoring surroundings for use in a vehicle includes obtaining image data from around the vehicle; obtaining non-image data from around the vehicle; manipulating the image data in response to the non-image data to generate a driver perspective view; and displaying the driver perspective view.

Claims

1. A surroundings monitoring system for use in a vehicle, comprising:

a first sensor subsystem operable to provide image data from around the vehicle;

a second sensor subsystem operable to provide non-image data from around the vehicle;

a control subsystem in communication with said first sensor subsystem and said second sensor subsystem, said control subsystem operable to generate manipulated image data symbology from said image data and arrange said manipulated image data symbology in response to said non-image data to generate a driver perspective view; and

a display subsystem in communication with said control subsystem to display said driver perspective view.

2. The system as recited in claim 1, wherein said image data includes video.

3. The system as recited in claim 1, wherein said first sensor subsystem includes a multiple of first sensors that respectively provide image data from each of a front passenger side, rear and driver side of the vehicle.

4. The system as recited in claim 3, wherein each of said multiple of first sensors includes at least one of a camera, a charge coupled device, a forward looking infrared, and a thermal system.

5. The system as recited in claim 1, wherein said non-image data includes ranging data.

6. The system as recited in claim 1, wherein said second sensor subsystem includes a multiple of second sensors that respectively provide non-image data from each of a front passenger side, rear and driver side of the vehicle.

7. The system as recited in claim 1, wherein each of said multiple of second sensors includes at least one of RADAR, SONAR, laser and LIDAR.

8. The system as recited in claim 1, wherein said display subsystem is located within the vehicle.

9. The system as recited in claim 1, wherein said display subsystem is located within a human-machine interface within the vehicle.

10. The system as recited in claim 1, wherein said display subsystem is located on a windshield.

11. The system as recited in claim 8, wherein said control subsystem arranges said image data on said display subsystem around a vehicle symbol.

12. The system as recited in claim 1, wherein said control subsystem arranges said image data to focus upon a target in response to said non-image data

13. A method of monitoring surroundings for use in a vehicle, comprising:

obtaining image data from around the vehicle;

obtaining non-image data from around the vehicle;

manipulating the image data in response to the non-image data to generate a driver perspective view; and

displaying the driver perspective view.

14. The method as recited in claim 13, wherein manipulating the image data in response to the non-image data includes extracting a moving target from the image data to generate a perspective view of the target.

15. The method as recited in claim 13, further comprising, positioning the driver perspective view of each target in a relative position on the display.

16. The method as recited in claim 13, further comprising, positioning the driver perspective view of each target in a relative three-hundred and sixty degree position.

17. The method as recited in claim 16, further comprising, displaying the perspective view of the target around the central symbol on the display in the relative position of the target with respect to the central symbol.

18. A method of monitoring surroundings for use in a vehicle, comprising:

obtaining image data from around the vehicle;

obtaining non-image data from around the vehicle;

generating manipulated image data symbology from the image data;

arranging the manipulated image data symbology in response to the non-image data to generate a driver perspective view; and

displaying the driver perspective view.

19. The method as recited in claim 18, wherein manipulating the image data in response to the non-image data includes extracting a target from surroundings.

20. The method as recited in claim 18, further comprising, displaying the perspective view of the target around an icon of the vehicle in the relative position of the target with respect to vehicle.