Device and method for monitoring vehicle surroundings
First Claim
1. A vehicle surrounding monitoring device, comprising:
- at least one camera installed in an own vehicle to obtain an image around an own vehicle;
an obstacle detection device installed in the own vehicle configured to detect an obstacle in an obstacle detection range;
an image processing device configured to convert a camera image imaged by the camera into a view point converted image seen from a virtual view point above the own vehicle; and
a display configured to display the view point converted image of the image processing device, the view point converted image being synthesized with an image of the obstacle detection range of the obstacle detection device,wherein, simultaneously when a warning is given upon entry of an obstacle within the obstacle detection range of the obstacle detection device, the image processing device modifies at least one of the image of the obstacle detection range of the obstacle detection device and an obstacle image imaged by the camera and included in the view point converted image so that the image of the obstacle detection range of the obstacle detection device and the obstacle image substantially contact one another,wherein the image processing device is configured to set the image obtained by projecting the obstacle detection range of the obstacle detection device on a ground surface, with an attaching position of the camera set as a view point, as the image of the obstacle detection range, and is configured to modify the image of the obstacle detection range projected on the ground surface with the view point converted image seen from the virtual view point above the own vehicle.
1 Assignment
0 Petitions
Accused Products
Abstract
A vehicle surrounding monitoring device include at least one camera 2 installed in an own vehicle to image a video around the own vehicle, an obstacle sensor 3 for detecting an obstacle within an imaging range of the camera 2, a pixel synthesis unit 13 for receiving a camera image imaged by the camera 2 and converting the camera image into a view point converted image seen from a virtual view point above the own vehicle, and a display device 4 for displaying the view point conversion image converted by the pixel synthesis unit 13. Simultaneously when a warning is given by a warning sound upon entry of an obstacle within an obstacle detection range of the obstacle sensor 3, an image of the obstacle detection range is synthesized with an obstacle image imaged by the camera 2 and included in the view point converted image to be in contact therewith.
65 Citations
10 Claims
-
1. A vehicle surrounding monitoring device, comprising:
-
at least one camera installed in an own vehicle to obtain an image around an own vehicle; an obstacle detection device installed in the own vehicle configured to detect an obstacle in an obstacle detection range; an image processing device configured to convert a camera image imaged by the camera into a view point converted image seen from a virtual view point above the own vehicle; and a display configured to display the view point converted image of the image processing device, the view point converted image being synthesized with an image of the obstacle detection range of the obstacle detection device, wherein, simultaneously when a warning is given upon entry of an obstacle within the obstacle detection range of the obstacle detection device, the image processing device modifies at least one of the image of the obstacle detection range of the obstacle detection device and an obstacle image imaged by the camera and included in the view point converted image so that the image of the obstacle detection range of the obstacle detection device and the obstacle image substantially contact one another, wherein the image processing device is configured to set the image obtained by projecting the obstacle detection range of the obstacle detection device on a ground surface, with an attaching position of the camera set as a view point, as the image of the obstacle detection range, and is configured to modify the image of the obstacle detection range projected on the ground surface with the view point converted image seen from the virtual view point above the own vehicle. - View Dependent Claims (2, 3, 5, 7)
-
-
4. A vehicle surrounding monitoring device, comprising:
-
at least one camera installed in an own vehicle to obtain an image around an own vehicle; an obstacle detection device installed in the own vehicle configured to detect an obstacle in an obstacle detection range; an image processing device configured to convert a camera image imaged by the camera into a view point converted image seen from a virtual view point above the own vehicle; and a display configured to display the view point converted image of the image processing device, the view point converted image being synthesized with an image of the obstacle detection range of the obstacle detection device, wherein, simultaneously when a warning is given upon entry of an obstacle within the obstacle detection range of the obstacle detection device, the image processing device modifies at least one of the image of the obstacle detection range of the obstacle detection device and an obstacle image imaged by the camera and included in the view point converted image so that the image of the obstacle detection range of the obstacle detection device and the obstacle image substantially contact one another, wherein the obstacle detection device is configured to detect an obstacle in space away from a ground surface; and wherein an image of an area where the obstacle detection range is projected on the ground surface, and an image displayed in a position where the obstacle detected by the obstacle detection device is projected on the ground surface and brought into contact with the image of the area where the obstacle detection range is projected on the ground surface are modified as the view point converted image to be displayed, wherein the image processing device is configured to set the image obtained by projecting the obstacle detection range of the obstacle detection device on a ground surface, with an attaching position of the camera set as a view point, as the image of the obstacle detection range, and is configured to modify the image of the obstacle detection range projected on the ground surface with the view point converted image seen from the virtual view point above the own vehicle.
-
-
6. A vehicle surrounding monitoring method, comprising:
-
obtaining an image around an own vehicle by at least one camera installed in the own vehicle; detecting an obstacle in an obstacle detection range by an obstacle detection sensor; converting the image obtained by the at least one camera into a view point converted image seen from a virtual view point above the own vehicle; displaying the view point converted image synthesized with an image of the obstacle detection range of the obstacle detection sensor; when presence of an obstacle is detected by the obstacle detection sensor, giving a warning, and simultaneously modifying at least one of the image of the obstacle detection range of the obstacle detection sensor and an obstacle image included in the view point converted image so that the image of the obstacle detection range of the obstacle detection sensor and the obstacle image substantially contact one another, setting an image obtained by projecting the obstacle detection range of the obstacle detection sensor on a ground surface, with an attaching position of the camera set as a view point, as the image of the obstacle detection range, and modifying the image of the obstacle detection range projected on the ground surface with the view point converted image seen from the virtual view point above the own vehicle.
-
-
8. A vehicle surrounding monitoring device, comprising:
-
at least one camera installed in an own vehicle to obtain an image around the own vehicle; obstacle detection means installed in the own vehicle for detecting an obstacle in an obstacle detection range; image processing means for converting a camera image imaged by the camera into a view point converted image seen from a virtual view point above the own vehicle; and display means for displaying the view point converted image of the image processing means, the view point converted image being synthesized with an image of the obstacle detection range of the obstacle detection means, wherein, simultaneously when a warning is given upon entry of an obstacle within the obstacle detection range of the obstacle detection means, the image processing means modifies at least one of the image of the obstacle detection range of the obstacle detection means and an obstacle image imaged by the camera and included in the view point converted image so that the image of the obstacle detection range of the obstacle detection means and the obstacle image contact one another, wherein the image processing means is for setting an image obtained by projecting the obstacle detection range of the obstacle detection means on a ground surface, with an attaching position of the camera set as a view point, as the image of the obstacle detection range, and is for modifying the image of the obstacle detection range projected on the ground surface with the view point converted image seen from the virtual view point above the own vehicle.
-
-
9. A non-transitory computer readable medium having program code recorded therein, that, when executed on a computing system, causes the computing system to perform steps comprising:
-
obtaining an image around an own vehicle by at least one camera installed in the own vehicle; detecting an obstacle in an obstacle detection range by an obstacle detection sensor; converting the image obtained by the at least one camera into a view point converted image seen from a virtual view point above the own vehicle; displaying the view point converted image synthesized with an image of the obstacle detection range of the obstacle detection sensor; when presence of an obstacle is detected by the obstacle detection sensor, giving a warning, and simultaneously modifying at least one of the image of the obstacle detection range of the obstacle detection sensor and an obstacle image included in the view point converted image so that the image of the obstacle detection range of the obstacle detection sensor and the obstacle image substantially contact one another, setting an image obtained by projecting the obstacle detection range of the obstacle detection sensor on a ground surface, with an attaching position of the camera set as a view point, as the image of the obstacle detection range, and modifying the image of the obstacle detection range projected on the ground surface with the view point converted image seen from the virtual view point above the own vehicle.
-
-
10. A vehicle surrounding monitoring device, comprising:
-
at least one camera installed in an own vehicle to obtain an image around an own vehicle; an obstacle detection device installed in the own vehicle configured to detect an obstacle in an obstacle detection range; an image processing device configured to convert a camera image imaged by the camera into a view point converted image seen from a virtual view point above the own vehicle; and a display configured to display the view point converted image of the image processing device, the view point converted image being synthesized with an image of the obstacle detection range of the obstacle detection device, wherein, simultaneously when a warning is given upon entry of an obstacle within the obstacle detection range of the obstacle detection device, the image processing device modifies at least one of the image of the obstacle detection range of the obstacle detection device and an obstacle image imaged by the camera and included in the view point converted image so that the image of the obstacle detection range of the obstacle detection device and the obstacle image substantially contact one another, wherein the display directly displays the view point converted image at a normal time when the obstacle detection device detects no obstacle, and displays the image of the obstacle detection range synthesized with the view point converted image when the obstacle detection device detects the obstacle, wherein the image processing device is configured to set the image obtained by projecting the obstacle detection range of the obstacle detection device on a ground surface, with an attaching position of the camera set as a view point, as the image of the obstacle detection range, and is configured to modify the image of the obstacle detection range projected on the around surface with the view point converted image seen from the virtual view point above the own vehicle.
-
Specification