IMAGE OUTPUT APPARATUS, IMAGE OUTPUT METHOD AND IMAGE OUTPUT PROGRAM

• US 20100165092A1
• Filed: 03/26/2007
• Published: 07/01/2010
• Est. Priority Date: 03/27/2006
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Yamaguchi, Hiroshi
• Granted Patent: US 8,243,132 B2
• Time in Patent Office: Days
• US Class Current: 348/78
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/103 Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes A61B5/08 takes precedence; measuring aids for tailors A41H1/00; measuring instruments specially adapted for dentistry A61C19/04
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G03B 15/00 Special procedures for taking photographs; Apparatus therefor
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris

Abstract

There is provided an image output apparatus including an image-capturing section that captures an image of the observed person, an observer'"'"'s point of sight measuring section that measures a point of sight of the observer when the image-capturing section captures the image of the observed person, an output section that outputs the image of the observed person which is captured by the image-capturing section, and a point of sight output control section that causes the output section to output information indicating the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section, together with the image of the observed person which is captured by the image-capturing section.

Claims

1. An image output apparatus for assisting an observer who observes an observed person, comprising:

an image-capturing section that captures an image of the observed person;

an observer'"'"'s point of sight measuring section that measures a point of sight of the observer when the image-capturing section captures the image of the observed person;

an output section that outputs the image of the observed person which is captured by the image-capturing section; and

a point of sight output control section that causes the output section to output information indicating the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section, together with the image of the observed person which is captured by the image-capturing section.

2. The image output apparatus as set forth in claim 1, wherein

the point of sight output control section causes the output section to output a mark indicating the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section, in such a state that the mark is overlapped onto the image of the observed person which is captured by the image-capturing section.

3. The image output apparatus as set forth in claim 1, further comprising

a point of sight image extracting section that extracts a partial image including the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section, from the image of the observed person which is captured by the image-capturing section, wherein

the point of sight output control section causes the output section to output an image obtained by enlarging the partial image extracted by the point of sight image extracting section, together with the image of the observed person which is captured by the image-capturing section.

4. The image output apparatus as set forth in claim 3, further comprising

a view measuring section that measures a view of the observer, wherein

the point of sight image extracting section extracts an image corresponding to the view of the observer which is measured by the view measuring section, from the image of the observed person which is captured by the image-capturing section.

5. The image output apparatus as set forth in claim 1, further comprising:

an observed person'"'"'s information storing section that stores thereon the image of the observed person which is captured by the image-capturing section in association with the observed person; and

a previous image output control section that, when the image-capturing section captures a new image of the observed person, causes the output section to output a previous image of the observed person which is stored on the observed person'"'"'s information storing section in association with the observed person, together with the new image of the observed person which is captured by the image-capturing section.

6. The image output apparatus as set forth in claim 5, wherein

the observed person'"'"'s information storing section further stores thereon the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section in association with the observed person, and

the previous image output control section causes the output section to output the information indicating the point of sight of the observer, together with the previous image of the observed person.

7. The image output apparatus as set forth in claim 5, further comprising:

a sound recording section that records sound information of the observer when the image-capturing section captures the image of the observed person;

an image storing section that stores thereon the sound information of the observer which is recorded by the sound recording section, in association with the image of the observed person which is captured by the image-capturing section;

a sound information comparing section that compares sound information of the observer which is newly recorded by the sound recording section with the sound information of the observer which is previously recorded by the sound recording section and stored on the image storing section; and

a previous image extracting section that extracts, based on a result of the comparison done by the sound information comparing section, a previous image of the observed person which is stored on the image storing section in association with previous sound information of the observer which shows a higher coincidence level than a predetermined level with the sound information of the observer which is newly recorded by the sound recording section, wherein

the previous image output control section causes the output section to output the previous image of the observed person which is extracted by the previous image extracting section, together with the new image of the observed person which is captured by the image-capturing section.

8. The image output apparatus as set forth in claim 1, wherein

the output section is a display section,

the image output apparatus further comprises:

an observed person'"'"'s information storing section that stores the image of the observed person which is captured by the image-capturing section in association with the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section;

a previous image output control section that reads the image of the observed person which is stored on the observed person'"'"'s information storing section, and causes the display section to display the read image of the observed person; and

a viewer'"'"'s point of sight measuring section that measures a point of sight of a viewer who views the image of the observed person which is displayed on the display section, wherein

the observed person'"'"'s information storing section further stores thereon information indicating the point of sight of the viewer which is measured by the viewer'"'"'s point of sight measuring section, in association with the image of the observed person which is read by the previous image output control section.

9. The image output apparatus as set forth in claim 8, further comprising:

a viewer'"'"'s point of sight judging section that judges whether the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section coincides with the point of sight of the viewer which is measured by the viewer'"'"'s point of sight measuring section; and

a viewed image extracting section that, when the viewer'"'"'s point of sight judging section judges negatively, extracts an image corresponding to information indicating that the points of sight do not coincide with each other, wherein

the previous image output control section causes the output section to output the image which corresponds to the information indicating that the points of sight do not coincide with each other and is thus extracted by the viewed image extracting section.

10. The image output apparatus as set forth in claim 9, wherein

the viewer'"'"'s point of sight judging section judges that the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section does not coincide with the point of sight of the viewer which is measured by the viewer'"'"'s point of sight measuring section, when the point of sight of the viewer is not present within a predetermined region including the point of sight of the observer.

11. The image output apparatus as set forth in claim 9, wherein

when the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section moves to a plurality of different positions, the viewer'"'"'s point of sight judging section judges that the point of sight of the observer coincides with the point of sight of the viewer which is measured by the viewer'"'"'s point of sight measuring section if the point of sight of the viewer moves to vicinities which respectively correspond to the plurality of different positions.

12. The image output apparatus as set forth in claim 11, wherein

the viewer'"'"'s point of sight judging section judges that the point of sight of the observer coincides with the point of sight of the viewer if the point of sight of the viewer which is measured by the viewer'"'"'s point of sight measuring section moves to the vicinities in a same order as the point of sight of the observer.

13. The image output apparatus as set forth in claim 10, wherein

the viewer'"'"'s point of sight judging section judges that the point of sight of the observer coincides with the point of sight of the viewer if the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section and the point of sight of the viewer which is measured by the viewer'"'"'s point of sight measuring section are both present in a predetermined region of the image of the observed person which is captured by the image-capturing section.

14. The image output apparatus as set forth in claim 13, wherein

the predetermined region of the image includes at least one of an eye, a mouth and a hand of the observed person.

15. The image output apparatus as set forth in claim 8, wherein

the point of sight output control section causes the output section to output at least one of (i) a mark indicating a position of the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section and (ii) a mark indicating a position of the point of sight of the viewer which is measured by the viewer'"'"'s point of sight measuring section, in such a state that the at least one of the marks is overlapped onto the image of the observed person.

16. An image output method for assisting an observer who observes an observed person, comprising:

capturing an image of the observed person;

measuring a point of sight of the observer during the image capturing; and

outputting information indicating the point of sight of the observer which is measured in the point of sight measuring, together with the image of the observed person which is captured in the image capturing.

17. A computer readable medium storing thereon an image output program for an image output apparatus that assists an observer who observes an observed person, the image output program causing the image output apparatus to function as:

an image-capturing section that captures an image of the observed person;

an observer'"'"'s point of sight measuring section that measures a point of sight of the observer when the image-capturing section captures the image of the observed person;

an output section that outputs the image of the observed person which is captured by the image-capturing section; and

a point of sight output control section that causes the output section to output information indicating the point of sight of the observer which is measured by the observer'"'"'s point of sight measuring section, together with the image of the observed person which is captured by the image-capturing section.