Optimizing the detection of objects in images

• US 9,235,766 B2
• Filed: 10/20/2011
• Issued: 01/12/2016
• Est. Priority Date: 10/20/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Li, Ying, Pankanti, Sharathchandra
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US13/277,936
• Publication Number:
  US 20130101157A1
• Time in Patent Office: 1,545 Days
• Field of Search: 382/103, 340/905
• US Class Current: 1/1
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 2556/50 of positioning data, e.g. GPS [Global Positioning System] data
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/582 of traffic signs
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A system and method detect objects in a digital image. At least positional data associated with a vehicle is received. Geographical information associated with the positional data is received. A probability of detecting a target object within a corresponding geographic area associated with the vehicle is determined based on the geographical data. The probability is compared to a given threshold. An object detection process is at least one of activated and maintained in an activated state in response to an object detection process in response to the probability being one of above and equal to the given threshold. The object detection process detects target objects within at least one image representing at least one frame of a video sequence of an external environment. The object detection process is at least one of deactivated and maintained in a deactivated state in response to the probability being below the given threshold.

Claims

1. A method, with an information processing system, for detecting objects in a digital image, the method comprising:

receiving at least one image representing at least one frame of a video sequence of an external environment of a vehicle;

identifying a set of environmental conditions associated with a geographic area corresponding to a location of the vehicle;

selecting an illumination model based on the set of environmental conditions;

processing the at least one image with respect to the illumination mode;

retrieving at least one object template associated with an object of interest;

selecting an object appearance model based on the set of environmental conditions;

processing the at least one object template with respect to the illumination model and object appearance model;

analyzing the at least one image that has been processed with respect to the at least one object template that has been processed; and

determining, based on the analyzing, if the at least one image that has been processed comprises the object of interest.

2. The method of claim 1, wherein the processing comprises at least one of:

normalizing a set of illumination characteristics of objects within the at least one image;

generating an illumination invariant image from the at least one image;

generating an illumination specific image from the at least one image; and

generating an illumination synthesized image from the at least one image.

3. The method of claim 1, wherein processing the at least one object template comprises at least one of:

normalizing a set of illumination characteristics of the at least one object template;

generating an illumination invariant object template;

generating an illumination specific object template from the at least one object template;

generating an illumination synthesized object template from the at least one object template; and

generating an appearance-adapted object template.

4. The method of claim 1, wherein the set of environmental conditions comprises at least one of:

a weather condition associated with the corresponding geographic area;

a time-of-day associated with the corresponding geographic area;

a current season associated with the corresponding geographic area; and

a lighting condition associated with the corresponding geographic area.

5. The method of claim 1, wherein the illumination model is one of an illumination invariant model, an illumination specific model, and a synthesized illumination model that is based on at least one other illumination model associated with a different set of environmental conditions.

6. An information processing system for detecting objects in a digital image, the information processing system comprising:

a memory;

a processor communicatively coupled to the memory; and

an object detection system communicatively coupled to the memory and the processor, the object detection system configured to perform a method comprising;

receiving at least one image representing at least one frame of a video sequence of an external environment of a vehicle;

identifying a set of environmental conditions associated with a geographic area corresponding to a location of the vehicle;

selecting an illumination model based on the set of environmental conditions;

processing the at least one image with respect to the illumination mode;

retrieving at least one object template associated with an object of interest;

selecting an object appearance model based on the set of environmental conditions;

processing the at least one object template with respect to the illumination model and object appearance model;

analyzing the at least one image that has been processed with respect to the at least one object template that has been processed; and

determining, based on the analyzing, if the at least one image that has been processed comprises the object of interest.

7. The information processing system of claim 6, wherein the method comprises:

normalizing a set of illumination characteristics of objects within the at least one image;

generating an illumination invariant image from the at least one image;

generating an illumination specific image from the at least one image; and

generating an illumination synthesized image from the at least one image.

8. The information processing system of claim 6, wherein processing the at least one object template comprises at least one of:

normalizing a set of illumination characteristics of the at least one object template;

generating an illumination invariant object template;

generating an illumination specific object template from the at least one object template;

generating an illumination synthesized object template from the at least one object template; and

generating an appearance-adapted object template.

9. The information processing system of claim 6, wherein the set of environmental conditions comprises at least one of:

a weather condition associated with the corresponding geographic area;

a time-of-day associated with the corresponding geographic area;

a current season associated with the corresponding geographic area; and

a lighting condition associated with the corresponding geographic area.

10. The information processing system of claim 6, wherein the illumination model is one of an illumination invariant model, an illumination specific model, and a synthesized illumination model that is based on at least one other illumination model associated with a different set of environmental conditions.

11. A computer program product for detecting objects in a digital image, the computer program product comprising:

a non-transitory storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising;

receiving at least one image representing at least one frame of a video sequence of an external environment of a vehicle;

identifying a set of environmental conditions associated with a geographic area corresponding to a location of the vehicle;

selecting an illumination model based on the set of environmental conditions;

processing the at least one image with respect to the illumination mode;

retrieving at least one object template associated with an object of interest;

selecting an object appearance model based on the set of environmental conditions;

processing the at least one object template with respect to the illumination model and object appearance model;

analyzing the at least one image that has been processed with respect to the at least one object template that has been processed; and

determining, based on the analyzing, if the at least one image that has been processed comprises the object of interest.

12. The computer program product of claim 11, wherein the method comprises:

normalizing a set of illumination characteristics of objects within the at least one image;

generating an illumination invariant image from the at least one image;

generating an illumination specific image from the at least one image; and

generating an illumination synthesized image from the at least one image.

13. The computer program product of claim 11, wherein processing the at least one object template comprises at least one of:

normalizing a set of illumination characteristics of the at least one object template;

generating an illumination invariant object template;

generating an illumination specific object template from the at least one object template;

generating an illumination synthesized object template from the at least one object template; and

generating an appearance-adapted object template.

14. The computer program product of claim 11, wherein the set of environmental conditions comprises at least one of:

a weather condition associated with the corresponding geographic area;

a time-of-day associated with the corresponding geographic area;

a current season associated with the corresponding geographic area; and

a lighting condition associated with the corresponding geographic area.

15. The computer program product of claim 11, wherein the illumination model is one of an illumination invariant model, an illumination specific model, and a synthesized illumination model that is based on at least one other illumination model associated with a different set of environmental conditions.