DRIVING SUPPORT DISPLAY DEVICE

• US 20120170812A1
• Filed: 09/24/2010
• Published: 07/05/2012
• Est. Priority Date: 09/24/2009
• Status: Active Grant

• Current Assignee: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Kamiyama, Hirotaka
• Granted Patent: US 8,655,019 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Disclosed is a driving support display device that composites and displays images acquired from a plurality of cameras, whereby images which are easy for the user to understand and which are accurate in the areas near the borders of partial images are provided. An image composition unit (41) formulates a bird'"'"'s eye perspective image on the basis of a mapping table reference unit (45) using images of the area around the vehicle acquired from a plurality of cameras (31). An obstacle detection unit (42) detects obstacles in the images acquired by the plurality of cameras (31). On the basis of the obstacle information detected by the obstacle detection unit (42), an obstacle trajectory prediction unit (43) predicts the trajectory of the obstacle and determines the borders so that the borders of the obstacle and the composite image from the plurality of cameras (31) do not overlap. The image composition unit (41) acquires necessary information from the mapping table reference unit (45) and creates a bird'"'"'s eye perspective image in which the borders of the obstacle and the images from the plurality of cameras do not overlap.

Claims

1. A driving support display apparatus comprising:

an image combining section that combines images of a plurality of cameras and generates a bird'"'"'s-eye-view image;

an obstacle detection section that detects an obstacle in the vicinity of a vehicle; and

an obstacle movement direction prediction section that predicts a movement direction of an obstacle from a movement direction and movement velocity of an obstacle from the obstacle detection section, and sets a boundary of images of the plurality of cameras so as not to overlap an obstacle,

wherein the image combining section creates a bird'"'"'s-eye-view image in which an obstacle and a boundary of images of the plurality of cameras do not overlap based on information from the obstacle movement direction prediction section.

4. The driving support display apparatus according to claim 1, wherein the combining section generates the bird'"'"'s-eye-view image such that the obstacle and the boundary do not overlap based on information from the prediction section.

5. The driving support display apparatus according to claim 1, further comprising an acquisition section that acquires vehicle information that includes at least one of shift information and steering angle information of the vehicle,

wherein the prediction section sets the boundary so as not to overlap the obstacle, based on the movement direction and the movement velocity, and the vehicle information.

6. The driving support display apparatus according to claim 5, wherein the prediction section sets the boundary so as not to enter an area in which there is a possibility of movement of the obstacle.

7. The driving support display apparatus according to claim 6, wherein the prediction section sets the boundary so as not to enter within a movement radius that is a position to which there is a possibility of movement of the obstacle.

2. A driving support display apparatus comprising:

an image combining section that combines images of a plurality of cameras and generates a bird'"'"'s-eye-view image;

an obstacle detection section that detects an obstacle in the vicinity of a vehicle;

a vehicle movement information acquisition section that acquires shift information and steering angle information of a vehicle; and

an obstacle movement direction prediction section that predicts a movement direction of an obstacle from a movement direction and movement velocity of an obstacle from the obstacle detection section and vehicle information of a vehicle movement information acquisition section, and sets a boundary of images of the plurality of cameras so as not to overlap an obstacle,

wherein the image combining section creates a bird'"'"'s-eye-view image in which an obstacle and a boundary of images of the plurality of cameras do not overlap based on information from the obstacle movement direction prediction section.

3. The driving support display apparatus according to claim 2, wherein the prediction section sets the boundary so as not to enter within a movement radius that is a position to which there is a possibility of movement of the obstacle.