INFORMATION INPUT APPARATUS

• US 20010012001A1
• Filed: 07/06/1998
• Published: 08/09/2001
• Est. Priority Date: 07/07/1997
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: MATSUSHITA, NOBUYUKI, REKIMOTO, JUNICHI
• Granted Patent: US 6,414,672 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

There are provided an infrared LED panel for always applying infrared light to the back surface of a semi-transparent screen, a CCD camera for capturing only infrared light coming from the semi-transparent screen, and a projector for projecting an image onto the semi-transparent screen (with light not including infrared light). When a user performs a manipulation on the front side of the semi-transparent screen, the quantity of reflected infrared light varies. A control device picks up a variation in reflection light quantity as detection image information based on an imaging signal of the CCD camera. Further, in accordance with manipulation information that is obtained based on the detection image information, the control device executes controls necessary for, for instance, switching of an interface image to be displayed on the semi-transparent screen. A manipulation method may be in such a form as to cause a variation in detection image information through reflection of infrared light. Interactive input/output with various manipulation methods is thus enabled.

Claims

1. An information input apparatus comprising:

a semi-transparent screen that functions as an operator input manipulation surface;

pickup means for picking up an input manipulation of an operator on the semi-transparent screen by capturing only light or electromagnetic waves in a predetermined wavelength range that comes through the semi-transparent screen, to thereby produce a pickup signal; and

control processing means for generating detection image information corresponding to the input manipulation of the operator based on the pickup information, and for executing a control process based on input manipulation information that is recognized based on the detection image information.

2. The information input apparatus according to

claim 1

, wherein the control processing means is so configured as to be able to recognize plural pieces of input manipulation information based on image states of the detection image information and to execute different control processes based on the respective pieces of input manipulation information.

3. The information input apparatus according to

claim 1

, wherein the control processing means is so configured as to recognize the input manipulation information based on a particular image shape that is obtained as an image state of the detection image information.

4. The information input apparatus according to

claim 1

, wherein the control processing means is so configured as to be able to recognize a hand or a finger of a human body as a subject of detection of the input manipulation information.

5. The information input apparatus according to

claim 1

, further comprising projection display means provided so as to be able to project, onto the semi-transparent screen, an image of visible light in an wavelength range excluding the predetermined wavelength range of light or electromagnetic waves to be captured by the pickup means, wherein the control processing means executes, as the control process, a display image generation process for causing the projection display means to project a display image and a control on the projection display means.

6. The information input apparatus according to

claim 5

, wherein a menu picture for causing the control processing means to execute a prescribed process is set as the display image.

7. The information input apparatus according to

claim 5

, wherein an initial image having a predetermined content is set as the display image.

8. The information input apparatus according to

claim 7

, wherein the control processing means has attribute information relating to an image content of a particular region in the initial image, and wherein when it has been judged that the particular region has been designated as the input manipulation information, the control processing means executes a control process so that the projection display means projects an image indicating the attribute information relating to the designated region.

9. The information input apparatus according to

claim 5

, wherein the control processing means is so configured as to be able to generate the display image by using the detection image information.

10. The information input apparatus according to

claim 5

, wherein the control processing means executes the display image generation process so that the display image is displayed in an area on the semi-transparent screen corresponding to a located position of a physical object on the semi-transparent screen or in a space near the semi-transparent screen.

11. The information input apparatus according to

claim 1

, wherein the pickup means comprises irradiating means for always irradiating the semi-transparent screen with light or electromagnetic waves in the predetermined wavelength range that are to be captured by the pickup means.

12. The information input apparatus according to

claim 1

, wherein the semi-transparent screen is formed by combining a material for forming a transparent screen and a material for forming a semi-transparent screen.

13. The information input apparatus according to

claim 1

, wherein the semi-transparent screen constitutes a wall surface.

14. The information input apparatus according to

claim 1

, wherein the semi-transparent screen has a curved surface.

15. The information input apparatus according to

claim 1

, wherein the semi-transparent screen is disposed so as to constitute a table surface.

16. The information input apparatus according to

claim 1

, further comprising pointing device means capable of causing a state variation in light or electromagnetic waves in the predetermined wavelength range to be captured by the pickup means by irradiating the semi-transparent screen with light or electromagnetic waves.

17. The information input apparatus according to

claim 1

, wherein the pickup means comprises a plurality of imaging means for producing imaging signals through photographing with different magnification factors, and wherein the control processing means executes the control process based on the detection image information that is generated based on imaging signals that are supplied from the plurality of imaging means.

18. The information input apparatus according to

claim 17

, wherein the control processing means selects, according to a predetermined rule, a particular imaging region of an area of detection image information that is obtained based on an imaging signal produced by a predetermined one of the plurality of imaging means, and executes a control so that one of the imaging means that is different from the predetermined imaging means photographs an image in the particular imaging region with a varied magnification factor.