OPTIMIZING THE DETECTION OF OBJECTS IN IMAGES

• US 20130101157A1
• Filed: 10/20/2011
• Published: 04/25/2013
• Est. Priority Date: 10/20/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: LI, Ying, PANKANTI, Sharathchandra
• Granted Patent: US 9,235,766 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 2556/50 of positioning data, e.g. GPS [Global Positioning System] data
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/582 of traffic signs
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A system and method detect objects in a digital image. At least positional data associated with a vehicle is received. Geographical information associated with the positional data is received. A probability of detecting a target object within a corresponding geographic area associated with the vehicle is determined based on the geographical data. The probability is compared to a given threshold. An object detection process is at least one of activated and maintained in an activated state in response to an object detection process in response to the probability being one of above and equal to the given threshold. The object detection process detects target objects within at least one image representing at least one frame of a video sequence of an external environment. The object detection process is at least one of deactivated and maintained in a deactivated state in response to the probability being below the given threshold.

Claims

1. A method, with an information processing system, for detecting objects in a digital image, the method comprising:

receiving at least positional data associated with a vehicle;

obtaining geographical information associated with the positional data;

determining, based on the geographical information, a probability of detecting a target object within a corresponding geographic area associated with the vehicle;

comparing the probability to a given threshold;

in response to the probability being one of above and equal to the given threshold, at least one of activating and maintaining in an activated state an object detection process, wherein the object detection process detects target objects within at least one image representing at least one frame of a video sequence of an external environment; and

in response to the probability being below the given threshold, at least one of deactivating and maintaining in a deactivated state the object detection process.

2. The method of claim 1, wherein the geographical information comprises a map.

3. The method of claim 1, wherein determining the probability of detecting the target object comprises:

analyzing the geographical information; and

determining, based on the analyzing, an environmental context associated with the corresponding area, wherein the environmental context indicates at least a type of geographic area in which the vehicle is located, wherein the probability of detecting the target object is based on the environmental context.

4. The method of claim of claim 1, wherein determining the probability of detecting the target object comprises:

analyzing the geographical information with respect to the corresponding geographic area; and

determining, based on the analyzing, if the geographical information comprises at least one feature associated with the target object.

5. The method of claim 1, further comprising:

identifying a set of environmental conditions associated with the corresponding geographic area.

6. The method of claim 5, wherein the set of environmental conditions comprises at least one of:

a weather condition associated with the corresponding geographic area;

a time-of-day associated with the corresponding geographic area;

a current season associated with the corresponding geographic area; and

a lighting condition associated with the corresponding geographic area.

7. The method of claim 5, wherein the set of environmental conditions is identified in response to the at least one of activating and maintaining the object detection process.

8. A method, with an information processing system, for detecting objects in a digital image, the method comprising:

receiving at least one image representing at least one frame of a video sequence of an external environment of a vehicle;

identifying a set of environmental conditions associated with a geographic area corresponding to a location of the vehicle;

selecting an illumination model based on the set of environmental factors; and

processing the at least one image with respect to the illumination mode.

9. The method of claim 8, wherein the processing comprises at least one of:

normalizing a set of illumination characteristics of objects within the at least one image;

generating an illumination invariant image from the at least one image;

generating an illumination specific image from the at least one image; and

generating an illumination synthesized image from the at least one image.

10. The method of claim 8, further comprising:

retrieving at least one object template associated with an object of interest;

selecting an object appearance model based on the set of environmental factors;

processing the at least one object template with respect to the illumination model and object appearance model;

analyzing the at least one image that has been processed with respect to the at least one object template that has been processed; and

determining, based on the analyzing, if the at least one image that has been processed comprises the object of interest.

11. The method of claim 10, wherein processing the at least one object template comprises at least one of:

normalizing a set of illumination characteristics of the at least one object template;

generating an illumination invariant object template;

generating an illumination specific object template from the at least one object template;

generating an illumination synthesized object template from the at least one object template; and

generating an appearance-adapted object template.

12. The method of claim 8, wherein the set of environmental conditions comprises at least one of:

a weather condition associated with the corresponding geographic area;

a time-of-day associated with the corresponding geographic area;

a current season associated with the corresponding geographic area; and

a lighting condition associated with the corresponding geographic area.

13. The method of claim 8, wherein the illumination model is one of an illumination invariant model, an illumination specific model, and a synthesized illumination model that is based on at least one other illumination model associated with a different set of environmental conditions.

14. An information processing system for detecting objects in a digital image, the information processing system comprising:

a memory;

a processor communicatively coupled to the memory; and

an object detection system communicatively coupled to the memory and the processor, the object detection system configured to perform a method comprising;

receiving at least positional data associated with a vehicle;

obtaining geographical information associated with the positional data;

determining, based on the geographical information, a probability of detecting a target object within a corresponding geographic area associated with the vehicle;

comparing the probability to a given threshold;

in response to the probability being one of above and equal to the given threshold, at least one of activating and maintaining in an activated state an object detection process, wherein the object detection process detects target objects within at least one image representing at least one frame of a video sequence of an external environment; and

in response to the probability being below the given threshold, at least one of deactivating and maintaining in a deactivated state the object detection process.

15. The information processing system of claim 14, wherein determining the probability of detecting the target object comprises:

analyzing the geographical information; and

determining, based on the analyzing, an environmental context associated with the corresponding area, wherein the environmental context indicates at least a type of geographic area in which the vehicle is located, wherein the probability of detecting the target object is based on the environmental context.

16. The information processing system of claim 14, wherein determining the probability of detecting the target object comprises:

analyzing the geographical information with respect to the corresponding geographic area; and

determining, based on the analyzing, if the geographical information comprises at least one feature associated with the target object.

17. The information processing system of claim 14, the method further comprising:

identifying a set of environmental conditions associated with the corresponding geographic area.

18. The information processing system of claim 17, wherein the set of environmental conditions comprises at least one of:

a weather condition associated with the corresponding geographic area;

a time-of-day associated with the corresponding geographic area;

a current season associated with the corresponding geographic area; and

a lighting condition associated with the corresponding geographic area.

19. A computer program product for detecting objects in a digital image, the computer program product comprising:

a storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising;

receiving at least positional data associated with a vehicle;

obtaining geographical information associated with the positional data;

determining, based on the geographical data, a probability of detecting a target object within a corresponding geographic area associated with the vehicle;

comparing the probability to a given threshold;

in response to the probability being one of above and equal to the given threshold, at least one of activating and maintaining in an activated state an object detection process, wherein the object detection process detects target objects within at least one image representing at least one frame of a video sequence of an external environment; and

in response to the probability being below the given threshold, at least one of deactivating and maintaining in a deactivated state the object detection process.

20. The computer program product of claim 19, wherein determining the probability of detecting the target object comprises:

analyzing the geographical information; and

determining, based on the analyzing, an environmental context associated with the corresponding area, wherein the environmental context indicates at least a type of geographic area in which the vehicle is located, wherein the probability of detecting the target object is based on the environmental context.

21. The computer program product of claim 19, wherein determining the probability of detecting the target object comprises:

analyzing the geographical information with respect to the corresponding geographic area; and

determining, based on the analyzing, if the geographical information comprises at least one feature associated with the target object.

22. The computer program product of claim 19, the method further comprising:

identifying a set of environmental conditions associated with the corresponding geographic area.

23. The computer program product of claim 22, wherein the set of environmental conditions comprises at least one of:

a weather condition associated with the corresponding geographic area;

a time-of-day associated with the corresponding geographic area;

a current season associated with the corresponding geographic area; and

a lighting condition associated with the corresponding geographic area.

24. The computer program product of claim 23, wherein the set of environmental conditions is identified in response to the at least one of activating and maintaining the object detection process.