Notification control method and notification control device

• US 9,524,644 B2
• Filed: 09/16/2013
• Issued: 12/20/2016
• Est. Priority Date: 11/21/2012
• Status: Expired due to Fees

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Murashita, Kimitaka
• Primary Examiner(s): Bailey, Frederick
• Assistant Examiner(s): Nawaz, Talha M
• Application Number:
  US14/027,806
• Publication Number:
  US 20140139672A1
• Time in Patent Office: 1,191 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A notification control method executed by a computer, the notification control method includes: acquiring image data of a displayable image captured by an imaging device, and controlling a notification concerning detection of an object based on output of a sensor, depending on a determination of visibility for the displayable image based on the image data.

Claims

1. A notification control method executed by a computer, the notification control method comprising:

acquiring image data of a displayable image from an imaging device which captures a capturing area,

acquiring sensing data from an object detection sensor which detects an object within measuring area overlapping the capturing area;

determining a visibility for the displayable image by

generating a luminance histogram based on luminance information of the image data, and

calculating a dynamic range in the luminance histogram to determine the visibility for the displayable image; and

controlling a notification by a device to notify a detection of the object by the object detection sensor, in response to the dynamic range for the determined visibility for the displayable image being equal to or less than a threshold.

2. The notification control method according to claim 1, wherein the determining the visibility for the displayable image comprises:

dividing the image data into a plurality of regions, and

determining the visibility for the displayable image for the plurality of regions.

3. The notification control method according to claim 2, wherein:

at least one region, from among the plurality of regions, is identified as corresponding to a range where the object has been detected based on the sensing data from the object detection sensor, and determining the visibility of the displayable image is determined based on luminance information of the at least one identified region.

4. The notification control method according to claim 1, wherein the imaging device is an in-vehicle camera mounted on a vehicle, the notification control method further comprises acquiring a speed of the vehicle, and the controlling controls the notification based on the speed of the vehicle.

5. The notification control method according to claim 1, wherein the imaging device is an in-vehicle camera mounted on a vehicle, and the notification control method further comprises controlling a timing at which the notification is performed, based on a distance between the object and the vehicle or a predicted period of time of arrival at the object.

6. A notification control device comprising:

a memory; and

a processor coupled to the memory and configured to;

acquire image data of a displayable image from an imaging device which captures a capturing area,

acquire sensing data from an object detection sensor which detects an object within measuring area overlapping the capturing area;

determine a visibility for the displayable image by

generating a luminance histogram based on luminance information of the image data,

calculating a dynamic range in the luminance histogram, and

determining the visibility for the displayable image based on the dynamic range; and

control a notification by a device to notify a detection of the object by the object detection sensor, in response to the dynamic range for the determined visibility for the displayable image being equal to or less than a threshold.

7. The notification control device according to claim 6, wherein the determining the visibility for the displayable image comprises:

dividing the image data into a plurality of regions, and

determining the visibility for the displayable image for the plurality of regions.

8. The notification control device according to claim 7, wherein at least one region, from among the plurality of regions, is identified as corresponding to a range where the object has been detected based on the sensing data from the object detection sensor, and the visibility for the displayable image is determined based on luminance information of the at least one identified region.

9. The notification control device according to claim 6, wherein the imaging device is an in-vehicle camera mounted on a vehicle, the processor is further configured to acquire a speed of the vehicle, and control the notification based on the speed of the vehicle.

10. The notification control device according to claim 6, wherein the imaging device is an in-vehicle camera mounted on a vehicle, and the processor is further configured to control a timing at which the notification is performed, based on a distance between the object and the vehicle or a predicted period of time of arrival at the object.

11. A non-transitory computer-readable recording medium storing a notification control program for causing a computer to execute a procedure, the procedure comprising:

acquiring image data of a displayable image from an imaging device which captures a capturing area, and

acquiring sensing data from an object detection sensor which detects an object within measuring area overlapping the capturing area;

determining a visibility for the displayable image by

dividing the image data into a plurality of regions;

determining the visibility for the displayable image for the plurality of regions,

identifying at least one region among the plurality of regions corresponding to a range where the object has been detected based on the sensing data from the object detection sensor; and

determining the visibility for the displayable image based on luminance information of the at least one identified region;

controlling a notification by a device to notify a detection of the object by the object detection sensor, in response to the determined visibility for the displayable image based on the luminance information of the at least one identified region in the image data.

12. The non-transitory computer-readable recording medium according to claim 11, wherein the determining the visibility for the displayable image comprises:

generating a luminance histogram based on luminance information of the image data, and

calculating a dynamic range in the luminance histogram to determine the visibility for the displayable image.

13. The non-transitory computer-readable recording medium according to claim 12,

wherein the notification by the device is controlled in response to the dynamic range of the determined visibility for the displayable image being equal to or less than a threshold.

14. The non-transitory computer-readable recording medium according to claim 11,

wherein the imaging device is an in-vehicle camera mounted on a vehicle, the procedure further comprises acquiring a speed of the vehicle, and the controlling controls the notification based on the speed of the vehicle.