Line-of-sight detecting device and apparatus including the same

• US 5,671,447 A
• Filed: 07/25/1995
• Issued: 09/23/1997
• Est. Priority Date: 07/26/1994
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tokunaga, Tatsuyuki
• Primary Examiner(s): Metjahic, Safet
• Assistant Examiner(s): Nelson, Eric
• Application Number:
  US08/506,549
• Time in Patent Office: 791 Days
• Field of Search: 354/400-409, 354/410, 396/51
• US Class Current: 396/51
• CPC Class Codes: G03B 13/02 Viewfinders
• CPC Class Codes: G03B 2213/025 Sightline detection

Abstract

A line-of-sight detecting device includes an area sensor composed of a plurality of photoelectric conversion elements for receiving an image of an eyeball of a viewer. The area sensor is divided into block areas each having some of the plurality of photoelectric conversion elements, each block area outputs a value on the basis of the output of the photoelectric conversion elements constituting that block area. A particular block area satisfying predetermined conditions based on the output values of the block areas is selected from the plurality of block areas. Image processing is performed on those photoelectric conversion elements which are in a predetermined range based on the position of the particular block area to thereby detect the line of sight of the viewer, wherein the number of photoelectric conversion elements constituting each block area is changed in accordance with a predetermined situation.

Claims

1. A line-of-sight detecting device comprising:

a receiving sensor having a plurality of photoelectric conversion elements for receiving an image of an eyeball of a viewer;

block area setting means for setting in said receiving sensor a plurality of block areas, each block area including a number of said plurality of photoelectric conversion elements, and each block area outputting a value on the basis of the output of the photoelectric conversion elements included in that block area;

selection means for selecting a particular block area satisfying a predetermined condition based on the values output from the block areas; and

line-of-sight detecting means for executing image processing at least on those photoelectric conversion elements which are included in the particular block selected by said selection means,

wherein said block area setting means changes the number of photoelectric conversion elements constituting one block in response to a predetermined situation.

2. A line-of-sight detecting device according to claim 1, wherein said selection means selects a block area whose output value is a minimum output value as said particular block area.

3. A line-of-sight detecting device according to claim 1, further comprising photometry means for metering a quantity of light substantially incident upon the eyeball of the viewer, wherein said block area setting means changes a number of photoelectric conversion elements constituting each block area in accordance with the result of a metering by said photometry means.

4. A line-of-sight detecting device according to claim 1, wherein said block area setting means changes a number of photoelectric conversion elements constituting each block area in accordance with a reception preparing operation of said receiving means.

5. A line-of-sight detecting device according to claim 1, wherein said block area setting means changes a number of photoelectric conversion elements constituting each block area in accordance with the result of a gain setting operation of said receiving means.

6. A line-of-sight detecting device according to claim 1, wherein said line-of-sight detecting means performs image processing on the photoelectric conversion elements included in a predetermined range surrounding said particular block.

7. A line-of-sight detecting device according to claim 6, wherein the size of the range surrounding said particular block area changes in response to a predetermined condition.

8. A line-of-sight detecting device according to claim 7, wherein the size of the range surrounding said particular block area varies with a number of photoelectric conversion elements constituting each block area set by said block area setting means.

9. A line-of-sight detecting device comprising:

a receiving sensor having a plurality of photoelectric conversion elements for receiving an image of an eyeball of a viewer;

first selection means for setting, in said receiving means, a plurality of first block areas, each of said first block areas including a number of said plurality of photoelectric conversion elements, each of said plurality of first block areas outputting a value on the basis of the output of the photoelectric conversion elements included in the block area, and for selecting a first particular block area, satisfying a predetermined condition based on the values output from said plurality of first block areas;

second selection means which, when said first selection means determines that there is no first particular block area satisfying the predetermined condition among said plurality of first bock areas, sets, in said receiving sensor, a plurality of second block areas, each of said second block areas including a smaller number of photoelectric conversion elements as compared to each said first block area, each of said plurality of second block areas outputting a value on the basis of the outputs of the photoelectric conversion elements included in that block area, and selects a second particular block area, satisfying a predetermined condition based on the output values from said plurality of second block areas; and

line-of-sight detection means for performing image processing at least on those photoelectric conversion elements which are included in one of said first and second particular block areas, respectively, selected by said first and second selection means.

10. A line-of-sight detecting device according to claim 9, wherein each of said first and second block areas outputs a value based on the output of said photoelectric conversion elements of one block area, said first and second selection means selecting that block area in which the output value is a minimum of said first and second particular block area output values.

11. A line-of-sight detecting device according to claim 9, wherein said line-of-sight detecting means performs image processing on the photoelectric conversion elements included in a predetermined range surrounding one of said first and second particular blocks.

12. A line-of-sight detecting device according to claim 11, wherein the range surrounding said first particular block area differs from the range surrounding said second particular block area in the size of the surrounding range.

13. A line-of-sight detecting device comprising:

a receiving sensor having a plurality of photoelectric conversion elements for receiving an image of an eyeball of a viewer;

first selection means for setting, in said receiving sensor, a plurality of first block areas, each of said first block areas including a number of said plurality of photoelectric conversion elements, each of said plurality of first block areas outputting a value on the basis of the output of the photoelectric conversion elements included in that block area, and for selecting a first particular block area satisfying a predetermined condition, based on the values output from said plurality of first block areas;

second selection means for setting in said receiving sensor, a plurality of second block areas, each of said second block areas including a smaller number of photoelectric conversion elements as compared to each said first block area, each of said plurality of second block areas outputting a value on the basis of the outputs of the photoelectric conversion elements included that block area, and for selecting a second particular block area satisfying the predetermined condition, based on the output values from said plurality of second block areas;

determination means for determining one of said first and second selection means in response to a predetermined situation; and

line-of-sight detection means for performing image processing at least on those photoelectric conversion elements which are included in one of said first and second particular block areas respectively selected by said first and second selection means.

14. A line-of-sight detecting device according to claim 13, wherein each of said first and second block areas outputs a value based on the output of the photoelectric conversion elements of one block area, said first and second selection means selecting that block area in which the output value is a minimum of said first or second particular block area output values.

15. A line-of-sight detecting device according to claim 13, further comprising photometry means for metering the quantity of light incident upon the eyeball of the viewer, wherein said selection means selects one of said first and second selection means in accordance with the results of metering by said photometry means.

16. A line-of-sight detecting device according to claim 13, wherein said selection means selects one of said first and second selection means in accordance with a reception preparing operation of said receiving means.

17. A line-of-sight detecting device according to claim 13, said selection means selects one of said first and second selection means in accordance with the results of a gain setting operation of said receiving means.

18. A line-of-sight detecting device according to claim 13, wherein said line-of-sight detecting means performs image processing on the photoelectric conversion elements which are included in a predetermined range surrounding one of said first and second particular blocks.

19. A line-of-sight detecting device according to claim 18, wherein said predetermined range varies in the size of the range surrounding one of said first and second block area in accordance with the result of selection of said selection means.

20. An apparatus having a line-of-sight detecting device comprising:

a receiving sensor having a plurality of photoelectric conversion elements for receiving an image of an eyeball of a viewer;

block area setting means for setting in said receiving sensor a plurality of block areas, each block area including a number of said plurality of photoelectric conversion elements, and each block area outputting a value on the basis of the output of the photoelectric conversion elements constituting that block area;

selection means for selecting a particular block area satisfying a predetermined condition based on the values output from said block areas; and

line-of-sight detecting means for executing image processing at least on those photoelectric conversion elements which are included in said particular block selected by said selection means,

wherein said block area setting means changes the number of photoelectric conversion elements constituting one block area in response to another predetermined condition.

21. An apparatus having a line-of-sight detecting device according to claim 20, wherein said selection means selects a block area whose output value is a minimum value of said particular block area output values.

22. An apparatus having a line-of-sight detecting device according to claim 20, further comprising photometry means for metering a quantity of light substantially incident upon the eyeball of the viewer, wherein said block area setting means changes the number of said photoelectric conversion elements constituting each block area in accordance with the result of metering by said photometry means.

23. An apparatus having a line-of-sight detecting device according to claim 20, wherein said block area setting means changes the number of said photoelectric conversion elements in accordance with a reception preparing operation of said receiving means.

24. An apparatus having a line-of-sight detecting device according to claim 20, wherein said block area setting means changes the number of said photoelectric conversion elements in accordance with the result of a gain setting operation of said receiving means.

25. An apparatus having a line-of-sight detecting device according to claim 20, wherein said line-of-sight detecting means performs image processing on the photoelectric conversion elements included in a predetermined range surrounding said particular block.

26. An apparatus having a line-of-sight detecting device according to claim 25, wherein a size of said range surrounding said particular block area changes in response to a predetermined condition.

27. An apparatus having a line-of-sight detecting device comprising:

a receiving sensor having a plurality of photoelectric conversion elements for receiving an image of an eyeball of a viewer;

first selection means for setting, in said receiving sensor, a plurality of first block areas, each of said first block areas including a number of said plurality of photoelectric conversion elements, and each block area outputting a value of the photoelectric conversion elements included in that block area, and for selecting a first particular block area satisfying a predetermined condition, based on the values output from said plurality of first block areas;

second selection means which, when said first selection means determines that there is no first particular block area satisfying the predetermined condition among said plurality of first block areas, sets, in said receiving sensor, a plurality of second block areas, each of said second block areas including a smaller number of photoelectric conversion elements as compared to each said first block area, each of said plurality of second block areas outputting a value on the basis of the outputs of the photoelectric conversion elements included in that block area, and selects a second particular block area, satisfying the predetermined condition, based on output values from said plurality of second block areas; and

line-of-sight detection means for performing image processing on those photoelectric conversion elements, which are included in one of said first and second particular block areas respectively selected by said first and second selection means.

28. An apparatus having a line-of-sight detecting device according to claim 27, wherein each of said first and second block areas outputs a value based on the output of said photoelectric conversion elements of one block area, said first and second selection means selecting that block area in which the output value is a minimum of said first and second particular block area output values.

29. An apparatus having a line-of-sight detecting device according to claim 27, wherein said line-of-sight detecting means performs image processing on the photoelectric conversion elements included in a predetermined range surrounding one of said first and second particular blocks.

30. An apparatus having a line-of-sight detecting device according to claim 29, wherein a size of the range surrounding said first particular block area differs from a size of the range surrounding said second particular block area in the size of the surrounding range.

31. A line-of-sight detecting device comprising:

a receiving sensor having a plurality of photoelectric conversion elements for receiving an image of an eyeball of a viewer;

block area setting means for setting in said receiving sensor a plurality of block areas each having a predetermined unit area, each block area including a number of said plurality of photoelectric conversion elements, and each block area outputting a value;

selection means for selecting a particular block area satisfying a predetermined condition, based on the values output from said block areas; and

line-of-sight detection means for performing image processing at least on those photoelectric conversion elements which are included in said particular block area to thereby detect the line-of-sight of the viewer,

wherein said block area setting means changes said unit area with which said receiving sensor is divided into said plurality of block areas in accordance with a predetermined situation.

32. A line-of-sight detecting device according to claim 31, wherein said selection means selects, out of said plurality of block areas, a block area outputting a minimum value as said particular block area.

33. A line-of-sight detecting device according to claim 31, further comprising a light measuring means for measuring the amount of light substantially incident on an eyeball of a viewer, wherein said block area setting means changes said unit area with which said receiving sensor is divided into said plurality of block areas in accordance with the result of the light measurement by said light measuring means.

34. A line-of-sight detecting device according to claim 31, wherein said block area setting means changes said unit area with which said receiving sensor is divided into said plurality of block areas in accordance with a preliminary receiving operation by said receiving sensor.

35. A line-of-sight detecting device according to claim 31, wherein said block area setting means changes said unit with which said receiving sensor is divided into said plurality of block areas in accordance with the result of a gain-setting operation by said receiving sensor.

36. A line-of-sight detecting device according to claim 31, wherein said line-of-sight detecting means performs image processing on the photoelectric converting elements included in the predetermined range surrounding said particular block area.

37. A line-of-sight detecting device according to claim 36, wherein the extent of the range surrounding said particular block area changes in accordance with the predetermined situation.

38. A line-of-sight detecting device according to claim 37, wherein the extent of the range surrounding said particular block area changes in accordance with said unit area with which said receiving sensor is divided into said plurality of block areas.