Image Processing and Display System for Vehicles

• US 20180204072A1
• Filed: 01/13/2017
• Published: 07/19/2018
• Est. Priority Date: 01/13/2017
• Status: Active Grant

• Current Assignee: Denso International America Incorporated (DENSO Corporation)
• Original Assignee: Denso International America Incorporated (DENSO Corporation)
• Inventors: AL RASHEED, Asif, GILLEY, Adam
• Granted Patent: US 10,518,702 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/25 to the sides of the vehicle
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods are provided and include an image processing module configured to receive a set of images of an exterior surrounding of a vehicle from a plurality of cameras. The plurality of cameras is attached to the vehicle. A movement adjustment module is configured to adjust at least one image from the set of images to compensate for movement of the vehicle based on a difference between an original position of each of the plurality of cameras and a current position of each of the plurality of cameras, respectively. A stitching module is configured to connect the set of images to produce a single image of the exterior surrounding of the vehicle. An image display module is configured to display the single image of the exterior surrounding of the vehicle on a display unit.

Claims

1. A system comprising:

an image processing module configured to receive a set of images of an exterior surrounding of a vehicle from a plurality of cameras, the plurality of cameras being attached to the vehicle;

a movement adjustment module configured to adjust at least one image from the set of images to compensate for movement of the vehicle based on a difference between an original position of each of the plurality of cameras and a current position of each of the plurality of cameras, respectively;

a stitching module configured to connect the set of images to produce a single image of the exterior surrounding of the vehicle; and

an image display module configured to display the single image of the exterior surrounding of the vehicle on a display unit.

2. The system of claim 1 wherein the original position of each of the plurality of cameras is stored when the vehicle is started.

3. The system of claim 1 wherein the vehicle includes a tractor and a trailer attached to the tractor and wherein at least one camera of the plurality of cameras is mounted to the trailer.

4. The system of claim 1, wherein the display unit is located in a center stack of the vehicle.

5. The system of claim 1 wherein the plurality of cameras are wide angle view cameras.

6. The system of claim 1 wherein the movement adjustment module is configured to receive data from a plurality of sensors and compensate for the movement of the vehicle based on the data from the plurality of sensors.

7. The system of claim 6 wherein the plurality of sensors includes a vehicle speed sensor.

8. The system of claim 1 wherein the plurality of cameras includes at least one camera mounted on a right side of the vehicle and at least one camera mounted on a left side of the vehicle.

9. The system of claim 1 wherein the vehicle includes a tractor and a trailer attached to the tractor wherein the plurality of cameras include a first camera mounted on a left side of the tractor, a second camera mounted on a right side of the tractor, a third camera mounted on a left side of the trailer, a fourth camera mounted on a right side of the trailer, and a fifth camera mounted on a rear side of the trailer.

10. The system of claim 1 further comprising a storage module configured to record and store the single image for a predetermined period.

11. A method comprising:

receiving, with an image processing module, a set of images of an exterior surrounding of a vehicle from a plurality of cameras, the plurality of cameras being attached to the vehicle;

adjusting, with a movement adjustment module, at least one image from the set of images to compensate for movement of the vehicle based on a difference between an original position of each of the plurality of cameras and a current position of each of the plurality of cameras, respectively;

connecting, with a stitching module, the set of images to produce a single image of the exterior surrounding of the vehicle; and

displaying, with an image display module, the single image of the exterior surrounding of the vehicle on a display unit.

12. The method of claim 11 wherein the original position of each of the plurality of cameras is stored when the vehicle is started.

13. The method of claim 11 wherein the vehicle includes a tractor and a trailer attached to the tractor and wherein at least one camera of the plurality of cameras is mounted to the trailer.

14. The method of claim 11, wherein the display unit is located in a center stack of the vehicle.

15. The method of claim 11 wherein the plurality of cameras are wide angle view cameras.

16. The method of claim 11 wherein the movement adjustment module is configured to receive data from a plurality of sensors and compensate for the movement of the vehicle based on the data from the plurality of sensors.

17. The method of claim 16 wherein the plurality of sensors includes a vehicle speed sensor.

18. The method of claim 11 wherein the plurality of cameras includes at least one camera mounted on a right side of the vehicle and at least one camera mounted on a left side of the vehicle.

19. The method of claim 11 wherein the vehicle includes a tractor and a trailer attached to the tractor wherein the plurality of cameras include a first camera mounted on a left side of the tractor, a second camera mounted on a right side of the tractor, a third camera mounted on a left side of the trailer, a fourth camera mounted on a right side of the trailer, and a fifth camera mounted on a rear side of the trailer.

20. The method of claim 11 further comprising a storage module configured to record and store the single image for a predetermined period.