Image recording apparatus, image recording method and image recording program stored on a computer readable medium

• US 9,498,123 B2
• Filed: 03/26/2007
• Issued: 11/22/2016
• Est. Priority Date: 03/27/2006
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Yamaguchi, Hiroshi, Gotohda, Yukita
• Primary Examiner(s): Fan, Hua
• Application Number:
  US12/294,781
• Publication Number:
  US 20100026803A1
• Time in Patent Office: 3,529 Days
• Field of Search: 348/143
• US Class Current: 1/1
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/442 Evaluating skin mechanical properties, e.g. elasticity, hardness, texture, wrinkle assessment
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris

Abstract

There is provided an image recording apparatus including an image-capturing section that captures an image of the observed person, an observer'"'"'s point of sight measuring section that measures a point of sight of the observer when the image-capturing section captures the image of the observed person, an observer'"'"'s point of sight judging section that judges whether the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section is present within a predetermined area, and an image storing control section that stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section judges that the point of sight of the observer is present within the predetermined area.

Claims

1. An image recording apparatus for assisting an observer who observes an observed person, comprising:

an image-capturing section that captures an image of the observed person within an image-capturing target area;

an observer'"'"'s point of sight measuring section that measures a point of sight of an eye of the observer when the image-capturing section captures the image of the observed person;

an observer'"'"'s point of sight judging section that judges whether the point of sight is within a predetermined area, the predetermined area being within the image-capturing target area and being an area within which a part of the observed person is present; and

an image storing control section that stores the image of the observed person which is captured by the image-capturing section, only when the observer'"'"'s point of sight judging section judges that the point of sight of the eye of the observer is present within the predetermined area, further comprising

a point of sight moving method storing section that prestores thereon information indicating a method of how the observer directs a line of sight towards the observed person, wherein

the observer'"'"'s point of sight measuring section further measures a method of how the observer directs the line of sight towards the observed person, when the image-capturing section captures the image of the observed person,

the observer'"'"'s point of sight judging section further judges whether the method of how to direct the line of sight which is measured by the observer'"'"'s point of sight measuring section coincides with the method of how to direct the line of sight which is prestored on the point of sight moving method storing section, and

the image storing control section stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section further judges that the method of how to direct the line of sight which is measured by the observer'"'"'s point of sight measuring section coincides with the method of how to direct the line of sight which is prestored on the point of sight moving method storing section.

2. The image recording apparatus as set forth in claim 1, further comprising

an observed person'"'"'s position measuring section that measures an area, within a predetermined area, in which the observed person is present, wherein

the observer'"'"'s point of sight judging section judges whether the point of sight of the eye of the observer which is measured by the observer'"'"'s point of sight measuring section is present within the area in which the observed person is present which is measured by the observed person'"'"'s position measuring section, and

the image storing control section stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section judges that the point of sight of the eye of the observer is present within the area in which the observed person is present.

3. The image recording apparatus as set forth in claim 1, further comprising

an observed person'"'"'s position measuring section that measures an area corresponding to an eye of the observed person, wherein

the observer'"'"'s point of sight judging section judges whether the point of sight of the eye of the observer which is measured by the observer'"'"'s point of sight measuring section is present within the area corresponding to the eye of the observed person which is measured by the observed person'"'"'s position measuring section, and

the image storing control section stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section judges that the point of sight of the eye of the observer is present within the area corresponding to the eye of the observed person.

4. The image recording apparatus as set forth in claim 1, wherein

the observer'"'"'s point of sight measuring section further measures a movement rate of a line of sight of the observer when the image-capturing section captures the image of the observed person,

the observer'"'"'s point of sight judging section further judges whether the movement rate of the line of sight of the observer which is measured by the observer'"'"'s point of sight measuring section falls within a predetermined range, and

the image storing control section stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section further judges that the movement rate of the line of sight of the observer falls within the predetermined range.

5. The image recording apparatus as set forth in claim 1, wherein

the image storing control section stores images of the observed person which are captured by the image-capturing section during a first predetermined time period starting from a time that precedes, by a second predetermined time period, a time at which the observer'"'"'s point of sight judging section judges that the point of sight of the eye of the observer is present within the predetermined area.

6. The image recording apparatus as set forth in claim 1, further comprising

an observed person'"'"'s position measuring section that measures an area corresponding to a face of the observed person, wherein

the observer'"'"'s point of sight judging section judges whether the point of sight of the eye of the observer which is measured by the observer'"'"'s point of sight measuring section is present within the area corresponding to the face of the observed person which is measured by the observed person'"'"'s position measuring section, and

the image storing control section stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section judges that the point of sight of the eye of the observer is present within the area corresponding to the face of the observed person.

7. The image recording apparatus as set forth in claim 1, wherein

when the image captured by the image-capturing section includes a plurality of observed persons, the image storing control section extracts and stores a region of the image showing an observed person which includes the point of sight of the eye of the observer which is measured by the observer'"'"'s point of sight measuring section.

8. The image recording apparatus as set forth in claim 1, further comprising

an image-capturing unit that detects the point of sight of the eye of the observer.

9. The image recording apparatus as set forth in claim 8, wherein

the image-capturing unit measures the points of sight of the eye of the observer by means of a corneal reflex method or by detecting a change in light intensity distribution of an image of an eyeball area.

10. The image recording apparatus as set forth in claim 1, wherein

the predetermined area is an area corresponding to an eye or a face of the observed person.

11. An image recording apparatus for assisting an observer who observes an observed person, comprising:

an image-capturing section that captures an image of the observed person within an image-capturing target area;

an observer'"'"'s point of sight measuring section that measures a point of sight of an eye of the observer when the image-capturing section captures the image of the observed person;

an observer'"'"'s point of sight judging section that judges whether the point of sight is within a predetermined area, the predetermined area being within the image-capturing target area and being an area within which a part of the observed person is present; and

an image storing control section that stores the image of the observed person which is captured by the image-capturing section, only when the observer'"'"'s point of sight judging section judges that the point of sight of the eye of the observer is present within the predetermined area, further comprising

an observed person'"'"'s point of sight measuring section that measures a point of sight of the observed person, wherein

the observer'"'"'s point of sight judging section judges whether lines of sight of the observer and observed person coincide with each other, based on the point of sight of the observed person which is measured by the observed person'"'"'s point of sight measuring section and the point of sight of the eye of the observer which is measured by the observer'"'"'s point of sight measuring section, and

the image storing control section stores images of the observed person which are captured by the image-capturing section before and after a time at which the observer'"'"'s point of sight judging section judges that the lines of sight of the observer and observed person coincide with each other.

12. An image recording method for assisting an observer who observes an observed person, comprising:

capturing an image of the observed person within an image-capturing target area using an image-capturing section;

measuring a point of sight of the eye of the observer during the image capturing using an observer'"'"'s point of sight measuring section;

judging whether the point of sight is within a predetermined area using an observer'"'"'s point of sight judging section, the predetermined area being within the image-capturing target area and being an area within which a part of the observed person is present; and

storing the image of the observed person captured in the image capturing in an image storing control section, only when the point of sight of the eye of the observer is judged to be present within the predetermined area in the judging, and

further comprising

prestoring, using a point of sight moving storing section, information indicating a method of how the observer directs a line of sight towards the observed person, wherein

measuring, using the observer'"'"'s point of sight measuring section, a method of how the observer directs the line of sight towards the observed person, when the image-capturing section captures the image of the observed person,

judging, using the observer'"'"'s point of sight judging section, whether the method of how to direct the line of sight which is measured by the observer'"'"'s point of sight measuring section coincides with the method of how to direct the line of sight which is prestored on the point of sight moving method storing section, and

the image storing control section stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section further judges that the method of how to direct the line of sight which is measured by the observer'"'"'s point of sight measuring section coincides with the method of how to direct the line of sight which is prestored on the point of sight moving method storing section.

13. A non-transitory computer readable storage medium storing thereon an image recording program for an image recording apparatus that assists an observer who observes an observed person, the image recording program causing the image recording apparatus to function as:

an image-capturing section that captures an image of the observed person within an image-capturing target area;

an observer'"'"'s point of sight measuring section that measures a point of sight of the eye of the observer when the image-capturing section captures the image of the observed person;

an observer'"'"'s point of sight judging section that judges whether the point of sight is within a predetermined area, the predetermined area being within the image-capturing target area and being an area within which a part of the observed person is present; and

an image storing control section that stores the image of the observed person which is captured by the image-capturing section, only when the observer'"'"'s point of sight judging section judges that the point of sight of the eye of the observer is present within the predetermined area, and

further causing the image recording apparatus to function as;

a point of sight moving method storing section that prestores thereon information indicating a method of how the observer directs a line of sight towards the observed person, wherein

the observer'"'"'s point of sight measuring section further measures a method of how the observer directs the line of sight towards the observed person, when the image-capturing section captures the image of the observed person,

the observer'"'"'s point of sight judging section further judges whether the method of how to direct the line of sight which is measured by the observer'"'"'s point of sight measuring section coincides with the method of how to direct the line of sight which is prestored on the point of sight moving method storing section, and

the image storing control section stores the image of the observed person which is captured by the image-capturing section, when the observer'"'"'s point of sight judging section further judges that the method of how to direct the line of sight which is measured by the observer'"'"'s point of sight measuring section coincides with the method of how to direct the line of sight which is prestored on the point of sight moving method storing section.