Display apparatus which detects an observer body part motion in correspondence to a displayed element used to input operation instructions to start a process

• US 6,346,929 B1
• Filed: 04/20/1995
• Issued: 02/12/2002
• Est. Priority Date: 04/22/1994
• Status: Expired due to Term

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Fukushima, Nobuo, Sekine, Masayoshi, Muramoto, Tomotaka
• Primary Examiner(s): Saras, Steven
• Assistant Examiner(s): BELL, PAUL A
• Application Number:
  US08/425,793
• Time in Patent Office: 2,490 Days
• Field of Search: 345/7, 345/8, 345/9, 345/156, 345/157, 345/158, 345/168, 345/326, 345/351, 345/355, 345/358, 345/419, 345/425, 345/473, 345/972, 345/632, 351/209, 351/210, 351/211, 351/158, 382/100, 382/103, 382/291, D16/309, 396/373
• US Class Current: 345/8
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A display apparatus comprises a displaying device for displaying video information for an observer, a detecting device for detecting a motion of at least a part of the body of the observer, and a controlling device for making the displaying device display a display element for input of an operation instruction, and starting a process corresponding to the display element when the detecting device detects a specified motion in correspondence to the display element.

Claims

1. A display apparatus comprising:

displaying means mounted on the head of an observer, for displaying image information for an observer;

image pick-up means, mounted on the observer, for picking up an image of a field surrounding said observer;

detecting means for detecting a predetermined motion of the body of said observer from an image signal output from said image pick-up means; and

controlling means for making said displaying means display a display element for input of an operation instruction, and starting a process corresponding to said display element when said detecting means the predetermined motion in correspondence to said display element.

2. The apparatus according to claim 1, wherein said detecting means further includes visual axis detecting means for detecting a visual axis of the observer.

3. The apparatus according to claim 2, wherein said controlling means has means for comparing a direction corresponding to said display element with a direction of the visual axis detected by said visual axis detecting means.

4. The apparatus according to claim 1, wherein said controlling means has means for displaying a display element moving in accordance with the motion detected by said detecting means, on said displaying means.

5. The apparatus according to claim 4, wherein said controlling means has means for changing a display property of said display element moving in accordance with the motion detected by said detecting means.

6. The apparatus according to claim 1, further comprising sound generating means for generating a sound, wherein said controlling means makes said sound generating means function when said detecting means detects the specified motion.

7. The apparatus according to claim 1, wherein said detecting means comprises image taking means for taking in an image of at least a part of the body of said observer, and means for detecting a motion of the at least part of the body of said observer from an image signal from said image taking means.

8. The apparatus according to claim 7, wherein said image taking means has a plurality of image taking means with parallax.

9. The apparatus according to claim 8, wherein, if said detecting means do not detect motion of at least one portion of the body of said observer for a predetermined time or more, then power is interrupted to one of said plurality of image taking means.

10. The apparatus according to claim 9, wherein, if one of said plurality of image taking means other than the one of said plurality of image taking means to which the power was interrupted, detects said motion, then power is restored to the one of said plurality of image taking means to which power had been interrupted.

11. The apparatus according to claim 7, wherein said detecting means has means for detecting a hand or a finger of said observer within a spatial range preliminarily determined.

12. The apparatus according to claim 7, wherein said controlling means comprises means for preliminarily storing features of an object, and means for comparing said image signal with the features stored.

13. The apparatus according to claim 1, comprising communicating means for transmitting a signal to a device installed outside the apparatus, wherein said controlling means makes said displaying means display a display element corresponding to said device, and transmits a predetermined signal through said communicating means to said device when said detecting means detects the specified motion in correspondence to said device.

14. A display apparatus comprising:

displaying means for displaying a symbol corresponding to a function;

image pick-up means, mounted on an observer, for picking up an image of a field of view of an observer;

detecting means for detecting a motion of the observer from an image signal output from said image pick-up means;

recognizing means for recognizing a specific motion of the observer relative to the symbol; and

controlling means for executing a predetermined process corresponding to the function in the case that said recognizing means recognizes the specific motion.

15. The apparatus according to claim 14, wherein said displaying means is a head-mounted display device.

16. The apparatus according to claim 14, wherein said recognizing means recognizes the specific motion of a hand or a finger of the observer.

17. The apparatus according to claim 14, wherein said displaying means superimposes the image signal output from said image pick-up means over an image screen on which the symbol is displayed.