Visual-axis entry transmission apparatus and method therefor

• US 6,426,740 B1
• Filed: 08/26/1998
• Issued: 07/30/2002
• Est. Priority Date: 08/27/1997
• Status: Expired due to Term

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Yoshida, Masaaki, Goto, Hironori
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): Laneau, Ronald
• Application Number:
  US09/140,761
• Time in Patent Office: 1,434 Days
• Field of Search: 345/157, 345/146, 345/171, 345/902, 345/158, 345/173, 345/7, 345/8, 345/9
• US Class Current: 345/157
• CPC Class Codes: A61F 4/00 Methods or devices enabling patients or disabled persons to operate an apparatus or a device not forming part of the body operating or control means for prostheses A61F2/48, A61F2/68
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

A visual axis entry transmission apparatus and method enables a physically handicapped person who can not depress a foot button to easily transmit the selection of a character to be input. 50 characters are displayed, via a display controller, on the liquid crystal device of a head-mounted display unit and on an external monitor. The visual axis position of a user is detected by a visual axis detection circuit, and a character at the visual axis position is obtained based on the detected visual axis position data. Selection character data for the past 100 selections are then updated. When the condition for the entry of a character is satisfied by this new character selection, the character is added to an input character string, and the newly input character is pronounced to notify the user that the character entry has been completed. The visual axis position data are employed to determine the detection result, such as a condition where the visual axis detection was successful, the visual axis detection failed, the eyes were blinking, or the same option was selected. In accordance with the result of the determination, the color of the selection frame for a character is changed to provide the user detection result information that represents the detection result condition, thereby confirming the results of a detection of a line of sight and avoiding having to unnecessarily repeat an operation.

Claims

1. A visual line detecting apparatus comprising:

display means for displaying a plurality of icons on a display panel;

visual line detection means for detecting a visual line of a user facing said display panel;

determination means for determining an icon corresponding to a position of the visual line of the user detected by said visual line detection means;

external image input means for receiving an external image signal; and

display control means for controlling said display means so as to display an external image corresponding to the external image signal received by said external image input means, wherein, when the external image is displayed by said display means, said display control means is capable of controlling said display means so as to display, overlapping each other, the external image and the icon corresponding to the position of the visual line of the user determined by said determination means.

2. An apparatus according to claim 1, further comprising:

head position detection means for detecting a head position of the user; and

compensation means for compensating the position of the visual line that is detected by said visual line detection means.

3. An apparatus according to claim 1,

wherein said display means includes projection means for projecting a video image on said display panel.

4. An apparatus according to claim 3, wherein said video image includes said plurality of icons.

5. An apparatus according to claim 3, wherein, when the visual line is positioned on the same icon or video image for a predetermined period of time or longer, said determination means determines that the icon or video image has been selected.

6. An apparatus according to claim 5, further comprising change means for, upon receipt of an instruction by the user, changing the predetermined period of time required to determine that a video image is selected.

7. An apparatus according to claim 3, wherein, when the visual line is positioned on an icon or video image and the user closes his or her eyes for a predetermined period of time, said determination means determines that the icon or video image has been selected.

8. An apparatus according to claim 7, further comprising change means for, upon receiving an instruction from the user, changing the predetermined period of time the eyes of the user must remain closed before a video image to be selected is determined.

9. An apparatus according to claim 3, wherein, when the visual line is positioned on an icon or video image and the user depresses and holds a switch for a predetermined period of time, said determination means determines that the icon or video image has been selected.

10. An apparatus according to claim 9, further comprising change means for, upon receiving an instruction from the user, changing the predetermined period of time said switch must be depressed and held before a video image to be selected is determined.

11. An apparatus according to claim 10, further comprising change means for changing the specific ratio upon receiving an instruction from the user.

12. An apparatus according to claim 3, wherein said determination means includes:

means for identifying an icon or video image when the visual line is positioned on the same icon or video image for a predetermined period of time or longer;

means for identifying an icon or video image when the visual line is positioned on the icon or video image and the user'"'"'s eyes are closed and held closed for a predetermined period of time;

means for identifying an icon or video image when the visual line is positioned on the icon or video image and the user depresses and holds a switch for a predetermined period of time; and

switching means for changing the one of said identifying means for determining an icon or video image has been selected.

13. An apparatus according to claim 4, further comprising change means for, upon receipt of an instruction by the user, changing the predetermined period of time required to determine that an icon or video image is selected.

14. An apparatus according to claim 3, wherein, when the visual line is positioned on the same icon or video image at a specific ratio for a predetermined period of time, said determination means identifies the icon or video image to be selected.

15. An apparatus according to claim 14, further comprising change means for changing the specific ratio upon receiving an instruction from the user.

16. An apparatus according to claim 3, further comprising change means for changing the number of icons or video images included in said display panel upon receiving an instruction from the user.

17. An apparatus according to claim 3, further comprising switching means for, upon receiving an instruction from the user, switching an icon or video image on said display panel and an external image.

18. An apparatus according to claim 17, wherein the external image is a video image received from a television, a video recorder, a computer, a video-on-demand device, a clock, a crime prevention device or a video telephone.

19. An apparatus according to claim 18, wherein said external environment device is a lighting apparatus, a television, an audio device, a video recorder, a computer, a video-on-demand device, a telephone, a video telephone, a clock, an electric blind, an electric curtain, an electric window opening/closing device, an air conditioner, a crime prevention device, an electric reclining bed, a device for handling body excretions, a lifter or a nurse calling device.

20. An apparatus according to claim 17, further comprising operation means for operating an external environment device upon receiving an instruction from the user.

21. An apparatus according to claim 3, further comprising visibility adjustment means for adjusting visibility of the video image or the plurality of icons on said display panel.

22. An apparatus according to claim 3, further comprising deletion means for deleting an icon or video image on said display panel.

23. An apparatus according to claim 22, further comprising switching means for, upon receiving an instruction from the user, switching the display or deleting a video image on said display panel.

24. An apparatus according to claim 23, further comprising change means for changing said predetermined period of time that the eyes of the user must be held closed.

25. An apparatus according to claim 3, further comprising printing means for performing printing in accordance with an icon or video image selected by using the visual line.

26. An apparatus according to claim 25, wherein paper is not discharged each time printing is performed.

27. An apparatus according to one of claims 1 and 2, wherein, when the visual line is positioned on the same icon for a predetermined period of time or longer, said determination means determines that the icon has been selected.

28. An apparatus according to claim 27, further comprising change means for, upon receipt of an instruction by the user, changing the predetermined period of time required to determine that an icon is selected.

29. An apparatus according to one of claims 1 and 2, wherein, when the visual line is positioned on an icon and the user closes his or her eyes for a predetermined period of time, said determination means determines that the icon has been selected.

30. An apparatus according to claim 29, further comprising change means for, upon receiving an instruction from the user, changing the predetermined period of time the eyes of the user must remain closed before an icon to be selected is determined.

31. An apparatus according to one of claims 1 and 2, wherein, when the visual line is positioned on an icon and the user depresses and holds a switch for a predetermined period of time, said determination means determines that the icon has been selected.

32. An apparatus according to claim 31, further comprising change means for, upon receiving an instruction from the user, changing the predetermined period of time said switch must be depressed and held before an icon to be selected is determined.

33. An apparatus according to one of claims 1 and 2, wherein said determination means includes:

means for identifying an icon when the visual line is positioned on the same icon for a predetermined period of time or longer;

means for identifying an icon when the visual line is positioned on the icon and the user'"'"'s eyes are closed and held closed for a predetermined period of time;

means for identifying an icon when the visual line is positioned on the icon and the user depresses and holds a switch for a predetermined period of time; and

switching means for changing the one of said identifying means for determining that an icon has been selected.

34. An apparatus according to one of claims 1 and 2, wherein, when the visual line is positioned on the same icon at a specific ratio for a predetermined period of time, said determination means identifies the icon to be selected.

35. An apparatus according to claim 34, further comprising change means for changing the specific ratio upon receiving an instruction from the user.

36. An apparatus according to one of claims 1 and 2, further comprising change means for changing the number of icons included in said display panel upon receiving an instruction from the user.

37. An apparatus according to one of claims 1 and 2, further comprising switching means for, upon receiving an instruction from the user, switching an icon on said display panel and an external image.

38. An apparatus according to claim 37, wherein the external image is a video image received from a television, a video recorder, a computer, a video-on-demand device, a clock, a crime prevention device or a video telephone.

39. An apparatus according to claim 37, further comprising operation means for operating an external environment device upon receiving an instruction from the user.

40. An apparatus according to claim 39, wherein said external environment device is a lighting apparatus, a television, an audio device, a video recorder, a computer, a video-on-demand device, a telephone, a video telephone, a clock, an electric blind, an electric curtain, an electric window opening/closing device, an air conditioner, a crime prevention device, an electric reclining bed, a device for handling body excretions, a lifter or a nurse calling device.

41. An apparatus according to claim 1, further comprising visibility adjustment means for adjusting visibility of the plurality of icons on said display panel.

42. An apparatus according to one of claims 1 and 2, further comprising deletion means for deleting an icon on said display panel.

43. An apparatus according to claim 42, further comprising switching means for, upon receiving an instruction from the user, switching the display or deleting the icon on said display panel.

44. An apparatus according to claim 43, wherein said deletion means deletes the icon on said display panel when the eyes of the user have been closed for a predetermined period of time.

45. An apparatus according to claim 44, further comprising change means for changing said predetermined period of time that the eyes of the user must be held closed.

46. An apparatus according to claim 43, wherein said deletion means deletes the icon on said display panel when the user sets the visual line along a predetermined direction line.

47. An apparatus according to claim 46, further comprising change means for changing said predetermined direction line along which the user sets the visual line.

48. An apparatus according to one of claims 1 and 3 to 5, further comprising area restriction means for restricting an area to which entry by the visual line is permissible.

49. An apparatus according to claim 48, further comprising switching means for, upon receiving an instruction from the user, determining whether the area to which entry by the visual line is permissible is to be restricted.

50. An apparatus according to claim 49, further comprising change means for, upon receiving an instruction from the user, changing the area to which entry by the visual line is permissible.

51. An apparatus according to claim 48, wherein the area to which entry by the visual line is permissible is restricted after the eyes of the user have been closed for a predetermined period of time.

52. An apparatus according to claims 51, further comprising change means for changing the predetermined period of time that the eyes of the user must remain closed.

53. An apparatus according to claim 48, wherein the area to which entry by the visual line is permissible is restricted by the user setting the visual line along a predetermined direction line.

54. An apparatus according to claim 53, further comprising change means for changing the predetermined direction line along which the user sets the visual line.

55. An apparatus according to claim 48, wherein the position of the visual line is not displayed in the area to which entry by the visual line is restricted.

56. An apparatus according to claim 48, further comprising change means for, upon receiving an instruction from the user, changing a setup that establishes whether the position of the visual line is to be displayed in the area to which entry by the visual line is restricted.

57. An apparatus according to one of claims 1 or 3 to 5, further comprising change means for changing the size of said display panel to be displayed.

58. An apparatus according to claim 57, further comprising change means for, upon receiving an instruction from the user, changing the size of said display panel.

59. An apparatus according to one of claims 1 or 3 to 5, further comprising change means for employing the visual line to change a cursor position in a sentence display portion that is displayed.

60. An apparatus according to claim 59, further comprising switching means for, upon receiving an instruction from the user, switching a setup that establishes whether the cursor position is to be changed using the visual line.

61. An apparatus according to one of claims 1 or 3 to 5, wherein, after an entry by the visual line has been established, another entry using the visual line is not accepted for a predetermined period of time.

62. An apparatus according to claim 61, further comprising change means for changing the predetermined period of time during which, after an entry by the visual line has been established, another entry using the visual line is not accepted.

63. An apparatus according to one of claims 1 and 2, further comprising printing means for performing printing in accordance with an icon selected by using the visual line.

64. An apparatus according to claim 63, wherein paper is not discharged each time printing is performed.

65. An apparatus according to claim 64, further comprising change means for, upon receiving an instruction from the user, changing a setup that establishes whether paper is to be discharged each time printing is permitted.

66. A visual line detecting apparatus comprising:

projection means for projecting a video image on a display screen;

visual line detection means for detecting a visual line of a user facing said display screen;

head position detection means for detecting a head position of the user;

compensation means for compensating a position of the visual line detected by said visual line detection means;

determination means for determining a video image on said display screen which the user is viewing, on the basis of a visual line position compensated by said compensation means;

external image input means for receiving an external image signal; and

display control means for controlling said projection means so as to project an external image corresponding to the external image signal received by said external image input means, wherein, when the external image is projected by said projection means, said display control means is capable of controlling said projection means so as to project, overlapping each other, the external image and the video image determined by said determination means.

67. An apparatus according to claim 66, wherein, when the visual line is positioned on the same video image for a predetermined period of time or longer, said determination means determines that the video image has been selected.

68. An apparatus according to claim 67, further comprising change means for, upon receiving an instruction from the user, changing the predetermined period of time the eyes of the user must remain closed before an icon or video image to be selected is determined.

69. An apparatus according to claim 66, wherein, when the visual line is positioned on a video image and the user closes his or her eyes for a predetermined period of time, said determination means determines that the video image has been selected.

70. An apparatus according to claim 69, further comprising change means for, upon receiving an instruction from the user, changing the predetermined period of time said switch must be depressed and held before an icon or video image to be selected is determined.

71. An apparatus according to claim 66, wherein, when the visual line is positioned on a video image and the user depresses and holds a switch for a predetermined period of time, said determination means determines that the video image has been selected.

72. An apparatus according to claim 66, wherein said determination means includes:

means for identifying a video image when the visual line is positioned on the same video image for a predetermined period of time or longer;

means for identifying a video image when the visual line is positioned on the video image and the user'"'"'s eyes are closed and held closed for a predetermined period of time;

means for identifying a video image when the visual line is positioned on the video image and the user depresses and holds a switch for a predetermined period of time; and

switching means for changing the one of said identifying means for determining a video image has been selected.

73. An apparatus according to claim 66, wherein, when the visual line is positioned on the same video image at a specific ratio for a predetermined period of time, said determination means identifies the video image to be selected.

74. An apparatus according to claim 66, further comprising change means for changing the number of video images included in said display panel upon receiving an instruction from the user.

75. An apparatus according to claim 74, wherein the external image is a video image received from a television, a video recorder, a computer, a video-on-demand device, a clock, a crime prevention device or a video telephone.

76. An apparatus according to claim 74, further comprising operation means for operating an external environment device upon receiving an instruction from the user.

77. An apparatus according to claim 76, wherein said external environment device is a lighting apparatus, a television, an audio device, a video recorder, a computer, a video-on-demand device, a telephone, a video telephone, a clock, an electric blind, an electric curtain, an electric window opening/closing device, an air conditioner, a crime prevention device, an electric reclining bed, a device for handling body excretions, a lifter or a nurse calling device.

78. An apparatus according to claim 66, further comprising switching means for, upon receiving an instruction from the user, switching a video image on said display panel and an external image.

79. An apparatus according to claim 66, further comprising visibility adjustment means for adjusting visibility of the video image on said display panel.

80. An apparatus according to claim 79, further comprising switching means for, upon receiving an instruction from the user, switching the display or deleting an icon or video image on said display panel.

81. An apparatus according to claim 80, wherein said deletion means deletes the video image on said display panel when the eyes of the user have been closed for a predetermined period of time.

82. An apparatus according to claim 80, wherein said deletion means deletes the video image on said display panel when the user sets the visual line along a predetermined direction line.

83. An apparatus according to claim 66, further comprising deletion means for deleting a video image on said display panel.

84. An apparatus according to claim 83, wherein said deletion means deletes the icon or video image on said display panel when the eyes of the user have been closed for a predetermined period of time.

85. An apparatus according to claim 84, further comprising change means for changing said predetermined period of time that the eyes of the user must be held closed.

86. An apparatus according to claim 85, further comprising change means for changing said predetermined direction line along which the user sets the visual line.

87. An apparatus according to claim 83, wherein said deletion means deletes the icon or video image on said display panel when the user sets the visual line along a predetermined direction line.

88. An apparatus according to claim 87, further comprising change means for changing said predetermined direction line along which the user sets the visual line.

89. An apparatus according to claim 88, wherein paper is not discharged each time printing is performed.

90. An apparatus according to claim 89, further comprising change means for, upon receiving an instruction from the user, changing a setup that establishes whether paper is to be discharged each time printing is permitted.

91. An apparatus according to claim 66, further comprising printing means for performing printing in accordance with a video image selected by using the visual line.

92. An apparatus according to claim 91, further comprising change means for, upon receiving an instruction from the user, changing a setup that establishes whether paper is to be discharged each time printing is permitted.

93. A visual line detecting method comprising the steps of:

displaying a plurality of icons on a display panel;

detecting a visual line of a user facing the display panel;

determining an icon corresponding to a position of the visual line detected in said detecting step;

receiving an external image signal input externally; and

controlling the display panel so as to display, overlapping each other, an external image corresponding to the external image signal externally input in said receiving step and the icon that is determined by the visual line of the user.

94. A memory medium on which is stored a program to be executed by a computer in a visual line detecting apparatus for detecting the intent of a user in accordance with the visual line, said program including the procedures of:

displaying a plurality of icons on a display panel;

detecting the visual line of the user facing the display panel;

determining an icon corresponding to a position of the visual line detected in said detecting step;

receiving an external image signal input externally; and

controlling the display panel so as to display, overlapping each other, an external image corresponding to the external image signal externally input in said receiving step and the icon that is determined by the visual line of the user.

95. A visual line detecting apparatus comprising:

image observation means for displaying a display panel that is easy for a user to see;

external image input means for receiving an external video image;

visual line detection means for detecting a visual line of the user facing said display panel displayed by said image observation means;

visual line entry means for entering the visual line of the user, which is detected by said visual line detection means, as input information for display by said image observation means on said display panel, and for employing the input information to transmit the intent of the user; and

display control means for permitting said image observation means to arrange in parallel said display panel and the external video image.

96. An apparatus according to claim 95, wherein said image observation means has one screen on which said display panel and the external video image is capable of being displayed in parallel, and wherein, upon receiving an instruction from the user, said display control means sets an arbitrary display area ratio of said display panel to the external video image on said screen of said image observation means.

97. A visual line detecting apparatus comprising:

image observation means for displaying a video image that is easy for a user to see;

visual line detection means for entering a visual line of the user, which is detected by said visual line detection means, as input information for the video image that is displayed by said image observation means, and for employing the input information to transmit the intent of the user;

external video image entry means for receiving an external video image; and

display control means for controlling said image observation means so as to display the external video image received by said external video image entry means,

wherein, when the external video image is displayed by said image observation means, said display control means is capable of controlling said image observation means so as to display, overlapping each other, the external video image and an icon that is selected by the visual line of the user.

98. An apparatus according to claim 97, further comprising selection means for, upon receiving an instruction from the user, determining whether the icon displayed by said image observation means is to overlap the external video image.

99. A visual line detecting apparatus comprising:

image observation means for so displaying a display panel in which icons are included that a user easily sees said icons;

visual line detection means for detecting a visual line of the user facing said display panel displayed by said image observation means;

visual line entry means for entering, as input information for said display panel, the visual line of the user that is detected by said visual line detection means, and for employing the input information to transmit an intent of the user;

external image input means for receiving an external video image; and

display control means for controlling said image observation means so as to display, overlapping each other, the icons and the externally input video image, and changing a display form of the icons displayed by said image observation means on said display panel, upon receiving an instruction from the user.

100. An apparatus according to claim 99, wherein, upon receiving an instruction from the user, said display control means changes the background color of an icon displayed on said display panel.

101. An apparatus according to claim 99, wherein, upon receiving an instruction from the user, said display control means changes the character color of an icon on said display panel.

102. A visual line detecting apparatus comprising:

visual line entry means for detecting a visual line of a user facing a display panel, and for entering the result of the detection of the visual line of the user as information input to said display panel to transmit an intent of the user in accordance with the input information,

connection means for connecting an external device to said visual line entry means;

display control means for controlling the display, on said display panel, of one or more icons corresponding to said external device; and

output means for, when the input information that is transmitted by said visual line entry means reflects an intent of the user to sequentially vary the control degree of the one or more icons, sequentially outputting a command through said connection means to said external device so as to sequentially vary the control degree of the one or more icons.

103. A visual line detecting apparatus comprising:

visual line entry means for detecting a visual line of a user facing a display panel, and for entering the result of the detection of the visual line of the user as information input to said display panel to transmit an intent of the user in accordance with the input information; and

display control means for controlling the display of one or more icons in layers on said display panel,

wherein, while the icons that are located below a selected icon are traced in order, the input information is entered from said visual line entry means in the order of display of the icons, thereby enabling a mode in which said user is capable of establishing a specific intent.

104. An apparatus according to claim 103, wherein an arbitrary layer structure for the icons is set by the user.

105. A visual line detecting method comprising the steps of:

employing image observation means to display a display panel a user easily sees;

detecting a visual line of the user facing the display panel that is displayed by said image observation means;

entering the visual line of the user as input information for the display panel, and employing the input information to transmit an intent of the user;

receiving an external video image; and

controlling said image observation means, by a display control means, so as to display the external video image in parallel with the display panel.

106. A method according to claim 105, whereby said image observation means has one screen on which the display panel and the external video image are displayed in parallel, and whereby, upon receiving an instruction from the user, said display control means sets an arbitrary display area ratio of the display panel to the external video image on the screen of said image observation means.

107. A visual line detecting method comprising the steps of:

displaying, using image observation means, a video image that is easy for a user to see;

detecting a visual line of the user facing the video image displayed by said image observation means;

entering the visual line of the user as input information for the video image that is displayed by said image observation means;

employing the input information to transmit an intent of the user;

receiving an external video image;

controlling said image observation means so as to display the external video image; and

displaying the external video image by said image observation means, so that the external video image and the video image that is selected by the visual line of the user overlap each other.

108. A method according to claim 107, further comprising the step of, upon receiving an instruction from the user, determining whether the video image displayed by said image observation means is to overlap the external video image.

109. A visual line detecting method comprising the steps of:

displaying, using image observation means, a display panel in which icons are included so that a user easily sees the icons;

detecting a visual line of the user facing the display panel displayed by said image observation means;

entering the visual line of the user as input information for the display panel that is displayed by said image observation means, and employing the input information to transmit an intent of the user;

receiving an external video image; and

controlling said image observation means so as to display, overlapping each other, the icons and the external video image, and to change a display form for the icons on the display panel upon receiving an instruction from the user.

110. A method according to claim 109, whereby, upon receiving an instruction from the user, the background color for an icon displayed on the display panel is changed.

111. A method according to claim 109, whereby, upon receiving an instruction from the user, the character color of an icon on the display panel is changed.

112. A visual line detecting method comprising the steps of:

detecting a visual line of a user facing a display panel;

entering the result of the detection of the visual line of the user as information input to the display panel to transmit an intent of the user in accordance with the input information;

connecting an external device to a visual line entry transmission apparatus through connection means;

displaying, on the display panel, icons for the external device; and

sequentially outputting, when the transmitted input information reflects an intent of the user to sequentially vary the control degree of the icon a command through said connection means to the external device so as to sequentially vary the control degree.

113. A visual line detecting method comprising the steps of:

detecting a visual line of a user facing a display panel;

entering the result of the detection of the visual line of the user as information input to the display panel to transmit an intent of the user in accordance with the input information;

displaying options in layers on the display panel; and

while icons that are located below a selected icon are traced in order, entering the input information in the order of the display of the icons, thereby enabling a mode in which the user is capable of establishing a specific intent.

114. A method according to claim 113, whereby an arbitrary layer structure for the icons is set by the user.

115. A memory medium storing a computer readable program for controlling a visual line detecting method, said program comprising the steps of:

employing image observation means to display a display panel that a user easily sees;

detecting a visual line of the user facing the display panel that is displayed by said image observation means;

entering the visual line of the user as input information for the display panel that is displayed by said image observation means, and employing the input information to transmit an intent of the user;

receiving an external video image; and

controlling said image observation means to display the external video image in parallel with the display panel.

116. A memory medium according to claim 115, wherein said image observation means has one screen on which the display panel and the external video image are capable of being displayed in parallel, and wherein, upon receiving an instruction from the user, said display control step sets an arbitrary display area ratio of the display panel to the external video image on the screen of said image observation means.

117. A memory medium on which is stored a program for building a visual line entry transmission system, which comprises:

image observation means for displaying a video image that is easy for a user to see;

visual line detection means for detecting a visual line of the user facing the video image displayed by said image observation means; and

visual line entry means for entering the visual line of the user, which is detected by said visual line detection means, as input information for the video image that is displayed by said image observation means, and for employing the input information to transmit an intent of the user, said program including;

an external video image entry module for receiving an external video image; and

a display control module for controlling said image observation means so as to display the external video image received by said external video image entry module,

wherein, when the external video image is displayed by said image observation means, said display control module displays, overlapping each other, the external video image and an icon that is selected by the visual line of the user.

118. A memory medium according to claim 117, wherein said program further comprises a selection module for, upon receiving an instruction from the user, determining whether the icon displayed by said image observation means is to overlap the external video image.

119. A memory medium storing a computer readable program for controlling a visual line detecting method, said program comprising the steps of:

employing image observation means to display a display panel in which icons are included such that a user easily sees the icons;

detecting a visual line of the user facing the display panel that is displayed by said image observation means;

entering the visual line of the user as input information for the display panel that is displayed by said image observation means, and employing the input information to transmit an intent of the user;

receiving an external video image; and

controlling the display of the icons and the external video image so that they overlap each other, and so that a change of a display form of the icons on the display panel can be made upon receiving an instruction from the user.

120. A memory medium according to claim 119, wherein, upon receiving an instruction from the user, said display control step changes the background color of an icon displayed on the display panel.

121. A memory medium according to claim 119, wherein, upon receiving an instruction from the user, said display control step changes the character color of an icon on the display panel.

122. A memory medium on which is stored a program for building a visual line entry transmission system, which comprises:

visual line entry means for detecting a visual line of a user facing a display panel, and for entering the result of the detection of the visual line of the user as information input to said display panel to transmit an intent of the user in accordance with the input information, said program including;

a display control module for displaying, on said display panel, icons for an external device that is connected to said visual line entry transmission system through connection means; and

an output module for, when input information reflects an intent of the user to sequentially vary the control degree of the icon, sequentially outputting a command through said connection means to the external device so as to sequentially vary the control degree of the icon.

123. A memory medium on which is stored a program for building a visual line entry transmission system, which comprises:

visual line entry means for detecting a visual line of a user facing a display panel, and for entering the result of the detection of the visual line of the user as information input to said display panel to transmit an intent of the user in accordance with the input information, said program including;

a display control module for displaying icons in layers on said display panel; and

a mode execution module for, while icons that are located below a selected icon are traced in order, entering the input information from said visual line entry means in the order of the display of the icons, and for enabling a mode in which the user is capable of establishing a specific intent.