Image recognition system, image recognition method, and machine readable medium storing thereon an image recognition program

• US 20050226508A1
• Filed: 03/28/2005
• Published: 10/13/2005
• Est. Priority Date: 03/29/2004
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Gotohda, Yukita
• Granted Patent: US 7,444,004 B2
• Time in Patent Office: Days
• US Class Current: 382/190
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Abstract

There is provided an image recognition system which recognizes a subject, which is moving with respect to an image capturing unit, included in an image captured by the image capturing unit, comprising: the image capturing unit; a first recognition unit which recognizes a candidate of the subject included in the image captured by the image capturing unit by comparing the image captured by the image capturing unit with predetermined template data; a template selection unit which selects the template data to be compared with an image captured by the image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by the recognition unit; and a second recognition unit which recognizes the subject by comparing the image, which is captured by the image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by the first recognition unit, with the template data selected by the template selection unit.

Claims

1. An image recognition system which recognizes a subject, which is moving with respect to an image capturing unit, included in an image captured by the image capturing unit, comprising:

the image capturing unit;

a first recognition unit which recognizes a candidate of the subject included in the image captured by said image capturing unit by comparing the image captured by said image capturing unit with predetermined template data;

a template selection unit which selects the template data to be compared with an image captured by said image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by said recognition unit; and

a second recognition unit which recognizes the subject by comparing the image, which is captured by said image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by said first recognition unit, with the template data selected by said template selection unit.

2. The image recognition system as claimed in claim 1, wherein said image capturing unit is provided in a movable body, and captures circumference of the movable body.

3. The image recognition system as claimed in claim 2, wherein the movable body is a vehicle.

4. The image recognition system as claimed in a claim 1, wherein

said first recognition unit recognizes the candidate of the subject when correlation of an image captured by said image capturing unit and the template data is greater than a predetermined first reference value, and

said second recognition unit recognizes the subject when correlation of an image captured by said image capturing unit and the template data selected by said template selection unit is greater than the first reference value and greater than a predetermined second reference value, which is greater than the first reference value.

5. The image recognition system as claimed in claim 1, wherein

said first recognition unit recognizes probability of the candidate by comparing an image captured by said image capturing unit with the predetermined template data, and

said template selection unit selects the template data corresponding to the candidate as the a template data to be compared with an image captured by said image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by said first recognition unit when the probability of the candidate recognized by said first recognition unit is greater than a predetermined reference value.

6. The image recognition system as claimed in claim 1, wherein said template selection unit selects the template data which is different from the template data compared with the captured data as the a template data to be compared with an image captured by said image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by said second recognition unit when the subject could not be recognized by said second recognition unit.

7. The image recognition system as claimed in claim 1, further comprising:

a speed measurement unit which measures speed of the vehicle; and

a region estimate unit which estimate a position of a region indicating the subject in an image captured by said image capturing unit after a predetermined duration has been elapsed after a time of capturing an image used for recognition of the candidate by said first recognition unit based on a region indicating the subject recognized by said first recognition unit in an image captured by said image capturing unit, and on the speed, wherein

said second recognition unit recognizes the subject by comparing a predetermined range of image centering on a position estimated by said region estimate unit among images captured by said image capturing unit with the template data selected by said template selection unit.

8. The image recognition system as claimed in claim 7, further comprising a steering angle measurement section which measures a steering angle of the vehicle, wherein

said region estimate section estimates a position of a region indicating the subject further based on the steering angle.

9. The image recognition system as claimed in claim 7, wherein

said region estimate section further estimates a size of a region indicating the subject in an image captured by said image capturing unit after a predetermined duration has been elapsed after a time of capturing an image used for recognition of the candidate by said first recognition section based on a region indicating the subject recognized by said first recognition unit in an image captured by said image capturing unit, and on the speed, and

said second recognition section recognizes the subject by comparing a predetermined range of an image according to a size estimated by said region estimate section centering on a position estimated by said region estimate section among images captured by said image capturing unit with the template data selected by said template selection section.

10. The image recognition system as claimed in claim 9, wherein

the template data are images, and

the larger a size of a region indicating the subject estimated by said region estimate unit is, the larger size of image said template selection unit selects as the template data to be compared with an image of the region indicating the subject in an image captured by said image capturing unit after a predetermined duration has been elapsed after a time of capturing an image used for recognition of the candidate by said first recognition unit.

11. The image recognition system as claimed in claim 1, further comprising a capturing control unit which controls said image capturing unit, wherein the faster the speed measured by said-speed measurement unit is, the shorter a time interval for capturing an image by said image capturing unit becomes.

12. An image recognition method which recognizes a subject, which is moving with respect to an image capturing unit, included in an image captured by the image capturing unit, comprising:

a first image capturing step of capturing an image by the image capturing unit;

a first recognition step of recognizing a candidate of the subject included in the image captured in said first image capturing step by comparing the image captured in said image capturing step with predetermined template data;

a template selection step of selecting the template data to be compared with an image captured by the image capturing unit after a predetermined duration has been elapsed from a time of capturing an image in said first image capturing step;

a second image capturing step of capturing an image by the image capturing unit after a predetermined duration has been elapsed from a time of capturing an image in said first image capturing step; and

a second recognition step of recognizing the subject by comparing the image captured in said second image capturing unit with the template data selected in said template selection step.

13. A machine readable medium having an image recognition program stored thereon, which when executed by a machine cause the machine to act as an image recognition system which recognizes a subject, which is moving with respect to an image capturing unit, included in an image captured by the image capturing unit, comprising:

the image capturing unit;

a first recognition unit which recognizes a candidate of the subject included in the image captured by said image capturing unit by comparing the image captured by said image capturing unit with predetermined template data;

a template selection unit which selects the template data to be compared with an image captured by said image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by said recognition unit; and

a second recognition unit which recognizes the subject by comparing the image, which is captured by said image capturing unit after a predetermined duration has been elapsed from a time of capturing an image used for recognition of the candidate by said first recognition unit, with the template data selected by said template selection unit.