Composite image generation apparatus and composite image generation program
First Claim
Patent Images
1. A composite image generation apparatus that is mounted in an own vehicle and generates a composite image which is a combination of captured images acquired by a plurality of imaging units, the composite image generation apparatus comprising:
- a processor configured toacquire each of captured images that have been captured by the plurality of imaging units;
determine a disturbance level for each of the plurality of captured images that have been acquired, the disturbance level indicating an extent of a disturbance;
select, in an overlapping area in which imaging areas of the plurality of captured images overlap, one or more captured images from the plurality of captured images so that the area occupied by a captured image having a higher disturbance level among the plurality captured images is smaller; and
generate a composite image based on the plurality of captured images, and generate the composite image by using the captured image selected based on the disturbance level in the overlapping area, whereinthe processor is configured to deduct a number of points from an allotted score corresponding to each of the plurality of captured images in response to the disturbance level.
1 Assignment
0 Petitions
Accused Products
Abstract
In a composite image generation apparatus that is mounted in an own vehicle, each of captured images, which have been captured by a plurality of imaging units, are acquired. A disturbance level for each of the plurality of captured images that have been acquired is determined. The disturbance level indicates: whether or not a disturbance is present in the captured image; or an extent of the disturbance. In an overlapping area in which imaging areas of the plurality of captured images overlap, one or more captured images is selected from the plurality of captured images so that the area occupied by a captured image having a higher disturbance level among the plurality captured images is smaller. A composite image is generated based on the plurality of captured images. In the overlapping area, the composite image is generated by using the captured image selected based on the disturbance level.
35 Citations
18 Claims
-
1. A composite image generation apparatus that is mounted in an own vehicle and generates a composite image which is a combination of captured images acquired by a plurality of imaging units, the composite image generation apparatus comprising:
-
a processor configured to acquire each of captured images that have been captured by the plurality of imaging units; determine a disturbance level for each of the plurality of captured images that have been acquired, the disturbance level indicating an extent of a disturbance; select, in an overlapping area in which imaging areas of the plurality of captured images overlap, one or more captured images from the plurality of captured images so that the area occupied by a captured image having a higher disturbance level among the plurality captured images is smaller; and generate a composite image based on the plurality of captured images, and generate the composite image by using the captured image selected based on the disturbance level in the overlapping area, wherein the processor is configured to deduct a number of points from an allotted score corresponding to each of the plurality of captured images in response to the disturbance level. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 17)
-
-
11. A composite image generation apparatus that is mounted in an own vehicle and generates a composite image which is a combination of captured images acquired by a plurality of imaging units, the composite image generation apparatus comprising:
-
a processor configured to acquire each of captured images that have been captured by the plurality of imaging units; determine a disturbance level for each of the plurality of captured images that have been acquired, the disturbance level indicating an extent of a disturbance; select, in an overlapping area in which imaging areas of the plurality of captured images overlap, one or more captured images from the plurality of captured images so that the area occupied by a captured image having a higher disturbance level among the plurality captured images is smaller; and generate a composite image based on the plurality of captured images, and generate the composite image by using the captured image selected based on the disturbance level in the overlapping area, wherein the processor is further configured to extract a road surface paint from the composite image, and the processor is further configured to calculate, based on the disturbance level, a proportion of captured images in which a disturbance has occurred, among the plurality of captured images; and prohibit an operation of the processor that extracts road surface paint when determined that the proportion is a threshold or higher.
-
-
12. An image display system comprising:
-
a plurality of imaging units that is mounted in an own vehicle and acquires captured images; a composite image generation apparatus that is mounted in the own vehicle and generates a composite image which is a combination of captured images acquired by the plurality of imaging units; and a display that is mounted in the own vehicle and displays the composite image generated by the composite image generation apparatus, the composite image generation apparatus comprising a processor configured to acquire each of captured images that have been captured by the plurality of imaging units; determine a disturbance level for each of the plurality of captured images that have been acquired, the disturbance level indicating an extent of a disturbance; select, in an overlapping area in which imaging areas of the plurality of captured images overlap, one or more captured images from the plurality of captured images so that the area occupied by a captured image having a higher disturbance level among the plurality captured images is smaller; and generate a composite image based on the plurality of captured images, and generate the composite image by using the captured image selected based on the disturbance level in the overlapping area, wherein the processor is configured to deduct a number of points from an allotted score corresponding to each of the plurality of captured images in response to the disturbance level. - View Dependent Claims (13, 14, 15, 16)
-
-
18. A composite image generation apparatus that is mounted in an own vehicle and generates a composite image which is a combination of captured images acquired by a plurality of imaging units, the composite image generation apparatus comprising:
-
a processor configured to acquire each of captured images that have been captured by the plurality of imaging units; determine a disturbance level for each of the plurality of captured images that have been acquired, the disturbance level indicating an extent of a disturbance; select, in an overlapping area in which imaging areas of the plurality of captured images overlap, one or more captured images from the plurality of captured images so that the area occupied by a captured image having a higher disturbance level among the plurality captured images is smaller; and generate a composite image based on the plurality of captured images, and generate the composite image by using the captured image selected based on the disturbance level in the overlapping area, wherein the processor is further configured to determine the type of disturbance as at least a part of the disturbance level based on a brightness value of each pixel composing each of the captured images; and select one or more captured images from the plurality of captured images based on the disturbance level, and the processor is further configured to select one or more captured images that has the lowest disturbance level, the processor is further configured to determine the disturbance level expressed by numeric values; and set an occupancy ratio of each of the captured images in the overlapping area based on a ratio of the disturbance level expressed by numeric values of each of the captured images, the processor is further configured to generate, as the composite image, a bird'"'"'s-eye view image that is supposed to be viewed from directly above the own vehicle, the processor is further configured to extract a road surface paint from the composite image, and the processor is further configured to calculate, based on the disturbance level, a proportion of captured images in which a disturbance has occurred, among the plurality of captured images; and prohibit an operation of the processor that extracts road surface paint when determined that the proportion is a threshold or higher.
-
Specification
-
- Resources
Litigation Campaign Assessment
Thank you for your request. You will receive a custom alert email when the Litigation Campaign Assessment is available.
×
-
Current AssigneeDENSO Corporation
-
Original AssigneeDENSO Corporation
-
InventorsTakaki, Masanari
-
Primary Examiner(s)Harvey, David
-
Application NumberUS14/643,072Publication NumberTime in Patent Office1,050 DaysField of Search348 36, 348148US Class CurrentCPC Class CodesB60R 1/00 Optical viewing arrangement...B60R 1/27 providing all-round vision,...B60R 2300/303 using joined images, e.g. m...B60R 2300/607 from a bird's eye viewpointG06T 3/4038 Image mosaicing, e.g. compo...H04N 23/698 for achieving an enlarged f...
