IMAGE CAPTURING SYSTEM, IMAGE CAPTURING METHOD, AND COMPUTER PROGRAM PRODUCT

• US 20080211916A1
• Filed: 02/29/2008
• Published: 09/04/2008
• Est. Priority Date: 03/02/2007
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Ono, Shuji
• Granted Patent: US 8,212,877 B2
• Time in Patent Office: Days
• US Class Current: 348/164
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/1961 Movement detection not involving frame subtraction, e.g. motion detection on the basis of luminance changes in the image
• CPC Class Codes: G08B 13/19643 wherein the cameras play different roles, e.g. different resolution, different camera type, master-slave camera
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Visible light image capturing is performed at appropriate timing that corresponds to the action of a subject. An image capturing system includes: an infrared light image capturing section that successively captures a plurality of infrared light images of a subject, by means of infrared light; a timing predicting section that predicts timing at which the subject included in the plurality of infrared light images matches a predetermined condition, based on timing at which each of the plurality of infrared light images is captured and image content of the plurality of infrared light images; and a visible light image capturing section that captures a visible light image by means of visible light at the timing predicted by the timing predicting section.

Claims

1. An image capturing system comprising:

an infrared light image capturing section that successively captures a plurality of infrared light images of a subject, by means of infrared light;

a timing predicting section that predicts timing at which the subject included in the plurality of infrared light images matches a predetermined condition, based on timing at which each of the plurality of infrared light images is captured and image content of the plurality of infrared light images; and

a visible light image capturing section that captures a visible light image by means of visible light at the timing predicted by the timing predicting section.

2. The image capturing system as set forth in claim 1, further comprising:

a face-direction specifying section that specifies a direction of a face of a person included in each of the plurality of infrared light images, wherein

the timing predicting section predicts timing at which the face of the person is directed to a predetermined direction, based on the timing at which each of the plurality of infrared light images is captured and the direction of the face specified by the face-direction specifying section.

3. The image capturing system as set forth in claim 2, wherein

the timing predicting section calculates a rotation speed of the head of the person, based on the timing at which each of the plurality of infrared light images is captured and the direction of the face of the person included in each of the plurality of infrared light images specified by the face-direction specifying section, and specifies the timing at which the face of the person is directed to the predetermined direction, based on the calculated rotation speed.

4. The image capturing system as set forth in claim 1, further comprising:

a subject position specifying section that specifies a position of a predetermined subject included in each of the plurality of infrared light images, wherein

the timing predicting section predicts timing at which the predetermined subject exists in a predetermined position, based on the timing at which each of the plurality of infrared light images is captured and the position specified by the subject position specifying section.

5. The image capturing system as set forth in claim 4, wherein

the timing predicting section calculates a speed at which the predetermined subject moves, based on the timing at which each of the plurality of infrared light images is captured and the position of the predetermined subject included in each of the plurality of infrared light images specified by the subject position specifying section, and predicts the timing at which the predetermined subject exists in the predetermined position based on the calculated speed.

6. The image capturing system as set forth in claim 4, further comprising:

a face-direction specifying section that specifies a direction of a face of a person included in each of the plurality of infrared light images, wherein

the subject position specifying section specifies a position of the person included in each of the plurality of infrared light images, and

the timing predicting section predicts timing at which the face of the person is directed to a predetermined direction at a predetermined position, based on the timing at which each of the plurality of infrared light images is captured, the direction of the face specified by the face-direction specifying section, and the position of the person specified by the subject position specifying section.

7. The image capturing system as set forth in claim 1, further comprising:

an image capturing condition determining section that determines an image capturing condition used by the visible light image capturing section in capturing the visible light image at the timing predicted by the timing predicting section, based on the image content of the plurality of infrared light images, wherein

the visible light image capturing section captures the visible light image under the image capturing condition determined by the image capturing condition determining section and at the timing predicted by the timing predicting section.

8. The image capturing system as set forth in claim 7, further comprising:

a subject position specifying section that specifies a position of a predetermined subject included in each of the plurality of infrared light images based on the image content of the plurality of infrared light images; and

a subject position predicting section that predicts a position of the predetermined subject at the timing predicted by the timing predicting section, based on the position specified by the subject position specifying section, wherein

the image capturing condition determining section determines a focal position at which the visible light image capturing section is able to capture an image of the subject in the position predicted by the subject position predicting section, and

the visible light image capturing section performs image capturing by focusing onto the focal position determined by the image capturing condition determining section, at the timing predicted by the timing predicting section.

9. The image capturing system as set forth in claim 7, further comprising:

a subject position specifying section that specifies a position of a predetermined subject included in each of the plurality of infrared light images based on the image content of the plurality of infrared light images; and

a subject position predicting section that predicts a position of the predetermined subject at the timing predicted by the timing predicting section, based on the position specified by the subject position specifying section, wherein

the image capturing condition determining section determines an image capturing direction in which the visible light image capturing section is able to capture an image of the subject in the position predicted by the subject position predicting section, and

the visible light image capturing section performs image capturing in the image capturing direction determined by the image capturing condition determining section, at the timing predicted by the timing predicting section.

10. The image capturing system as set forth in claim 7, further comprising:

a subject position specifying section that specifies a position of a predetermined subject included in each of the plurality of infrared light images based on the image content of the plurality of infrared light images; and

a subject position predicting section that predicts a position of the predetermined subject at the timing predicted by the timing predicting section, based on the position specified by the subject position specifying section, wherein

the image capturing condition determining section determines a field angle in which the visible light image capturing section is able to capture an image of the subject in the position predicted by the subject position predicting section, and

the visible light image capturing section performs image capturing in the field angle determined by the image capturing condition determining section, at the timing predicted by the timing predicting section.

11. The image capturing system as set forth in claim 7, further comprising:

a subject position specifying section that specifies a position of a predetermined subject included in each of the plurality of infrared light images based on the image content of the plurality of infrared light images; and

a subject speed predicting section that predicts a speed at which the predetermined subject moves at the timing predicted by the timing predicting section based on the position specified by the subject position specifying section, wherein

the image capturing condition determining section determines a larger image capturing rate used by the visible light image capturing section in performing image capturing when the subject speed predicting section predicts a faster speed, and

the visible light image capturing section performs image capturing at the image capturing rate determined by the image capturing condition determining section, at the timing predicted by the timing predicting section.

12. The image capturing system as set forth in claim 7, further comprising:

a subject position specifying section that specifies a position of a predetermined subject included in each of the plurality of infrared light images based on the image content of the plurality of infrared light images; and

a subject position predicting section that predicts a position of the predetermined subject at the timing predicted by the timing predicting section, based on

the position specified by the subject position specifying section, wherein the image capturing condition determining section determines a larger resolution used by the visible light image capturing section in performing image capturing when the visible light image capturing section captures a smaller image of the predetermined subject in the position predicted by the subject position predicting section, and

the visible light image capturing section performs image capturing at the resolution determined by the image capturing condition determining section, at the timing predicted by the timing predicting section.

13. The image capturing system as set forth in claim 1, further comprising:

a visible light irradiating section that irradiates visible light to at least a partial region of an image capturing range of the visible light image capturing section, at the timing predicted by the timing predicting section, wherein

the visible light image capturing section captures the visible light image in synchronization with timing at which the visible light irradiating section irradiates visible light.

14. The image capturing system as set forth in claim 13, wherein

a plurality of visible light irradiating sections are provided, and

the image capturing system further comprises:

a visible light irradiating section selecting section that selects one of the plurality of visible light irradiating sections that is caused to irradiate visible light at the timing predicted by the timing predicting section, based on the timing at which each of the plurality of infrared light images is captured and the image content of the plurality of infrared light images; and

a visible light irradiating control section that causes the visible light irradiating section selected by the visible light irradiating section selecting section to irradiate visible light at the timing predicted by the timing predicting section.

15. The image capturing system as set forth in claim 14, wherein

the visible light irradiating section selecting section selects one of the plurality of visible light irradiating sections that is caused to irradiate visible light at the timing predicted by the timing predicting section, based on a motion of a predetermined subject specified based on the timing at which each of the plurality of infrared light images is captured and the image content of the plurality of infrared light images.

16. The image capturing system as set forth in claim 15, wherein

the visible light irradiating section selecting section selects one of the plurality of visible light irradiating sections whose at least one of a positional relation with respect to a position of the predetermined subject and a relation between a direction of the predetermined subject and an irradiation direction of visible light is predicted to match a predetermined condition, based on a motion of the predetermined subject.

17. The image capturing system as set forth in claim 1, wherein

a plurality of visible light image capturing sections are provided, and

the image capturing system further comprises:

a visible light image capturing section selecting section that selects one of the plurality of visible light image capturing sections that is caused to capture the visible light image, based on the timing at which each of the plurality of infrared light images is captured and the image content of the plurality of infrared light images; and

a visible light image capturing control section that causes the visible light image capturing section selected by the visible light image capturing section selecting section to capture the visible light image at the timing predicted by the timing predicting section.

18. The image capturing system as set forth in claim 17, wherein

the visible light image capturing section selecting section selects one of the plurality of visible light image capturing sections that is caused to capture the visible light image, based on a motion of a predetermined subject specified based on the timing at which each of the plurality of infrared light images is captured and the image content of the plurality of infrared light images.

19. The image capturing system as set forth in claim 18, wherein

the visible light image capturing section selecting section selects one of the plurality of visible light image capturing sections whose at least one of a positional relation with respect to a position of the predetermined subject and a relation between a direction of the predetermined subject and an image capturing direction is predicted to match a predetermined condition, as a visible light image capturing section that captures the visible light image, based on the motion of the predetermined subject.

20. The image capturing system as set forth in claim 19, wherein

the timing predicting section predicts timing at which the predetermined subject matches a predetermined condition, based on the motion of the predetermined subject.

21. The image capturing system as set forth in claim 20, wherein

the timing predicting section predicts timing at which at least one of a positional relation between the visible light image capturing section selected by the visible light image capturing section selecting section and the predetermined subject and a relation between an image capturing direction of the visible light image capturing section selected by the visible light image capturing section selecting section and a direction of the predetermined subject matches a predetermined condition, based on the motion of the predetermined subject.

22. An image capturing method comprising:

an infrared light image capturing step of successively capturing a plurality of infrared light images of a subject, by means of infrared light;

a timing predicting step of predicting timing at which the subject included in the plurality of infrared light images matches a predetermined condition, based on timing at which each of the plurality of infrared light images is captured and image content of the plurality of infrared light images; and

a visible light image capturing step of capturing a visible light image by means of visible light at the timing predicted in the timing predicting step.

23. A computer program product for an image capturing system, the product having computer instructions, recordable on a computer readable medium, for enabling a computer executing the computer instructions to cause the image capturing system to function as:

an infrared light image capturing section that successively captures a plurality of infrared light images of a subject, by means of infrared light;

a timing predicting section that predicts timing at which the subject included in the plurality of infrared light images matches a predetermined condition, based on timing at which each of the plurality of infrared light images is captured and image content of the plurality of infrared light images; and

a visible light image capturing section that captures a visible light image by means of visible light at the timing predicted by the timing predicting section.