Touchless computer input device to control display cursor mark position by using stereovision input from two video cameras

• US 20030132913A1
• Filed: 01/11/2002
• Published: 07/17/2003
• Est. Priority Date: 01/11/2002
• Status: Abandoned Application

• Current Assignee: Anton Issinski
• Original Assignee: Anton Issinski
• Inventors: Issinski, Anton
• Application Number:
  US10/042,364
• Publication Number:
  US 20030132913A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

Computer peripheral touchless input device to control display cursor mark position by operator'"'"'s finger located in the front of the display screen surface using stereovision input from two or more video cameras aimed along the screen surface. Cursor marker follows the operator'"'"'s finger with a minimal spatial displacement providing a natural feeling of controlling marker position by the finger. The device further uses a translation velocity direction and an angular rotation speed of the finger to trigger equivalents of mouse buttons pressing and releasing events.

Claims

1. Computer peripheral input device to control display cursor mark position by a pointing subject comprising

(a) a computer display screen (2)

(b) a region (4) in the front of the said display screen surface where the pointing subject (5) is to be navigated

(c) two or more video cameras (1a)-(1b) taking images of the said region (4)

(d) means for calculating two projected coordinates (6) of the pointing subject (5) in the two-dimensional display screen surface space by stereovision geometry methods for a set of two or more images of the same scene taken at the same time from different view points received from the said video cameras

(e) a display cursor marker or its operating system functional equivalent (3)

(f) means for positioning said cursor marker (3) on the said display screen (2) at the obtained coordinates (6).

2. Computer peripheral input device of claim 1 further comprising

(a) means for determining a translation velocity of the pointing subject (5) by differential methods using two or more sets of video images taken at different time by the video cameras (1a)-(1b)

(b) means for triggering a computer event when an angle (α

) between the said velocity vector (8) and the vector (7) orthogonal to the display surface (2) falls into a predetermined diapason.

3. Computer peripheral input device of claim (2) where computer event (b) is further exposed to the computer software as a mouse button manipulation event.

4. Computer peripheral input device of claim 1 further comprising

(a) means for determining an angular rotation speed (9) of the pointing subject against an axis perpendicular to the display screen surface by differential methods using two or more sets of video images taken at different time by the video cameras (1a)-(1b)

(b) means for triggering a computer event when the said speed falls into a predetermined diapason.

5. Computer peripheral input device of claim (4) where computer event (b) is further exposed to the computer software as a mouse button manipulation event.

6. Computer peripheral input device of claim 1 where means (f) for positioning cursor marker include an operating system mouse driver interface.

7. Computer peripheral input device of claim 1 further comprising pointing subject recognition method comprising

(a) for an image obtained from one of the said video cameras (1a)-(1b) locating a sub-image area where the current image is different from one or more images taken by the same camera at the previous time

(b) further recognition of the pointing subject in the said located area of the current video image.

8. Computer peripheral input device of claim 1 further comprising pointing subject recognition method comprising

(a) accumulating images of the pointing subject

(b) further recognition of the pointing subject using said accumulated set of images (a).

9. Computer peripheral input device of claim 1 where the pointing subject (5) is the operator'"'"'s finger.

10. Computer peripheral input device of claim 1 where one or more said video cameras are linear video cameras.

11. Computer peripheral input device of claim 1 further comprising a light source to illuminate pointing subject.

12. Computer peripheral input device of claim 1 where said computer display screen (2) is a display screen of a personal desktop computer.

13. Computer peripheral input device of claim 1 where said computer display screen (2) is a display screen of a personal portable computer.

14. Computer peripheral input device of claim 1 where said computer display screen (2) is a display screen of a workstation.

15. Computer peripheral input device of claim 1 where said computer display screen (2) is a display screen of a mainframe computer.

16. Computer peripheral input device of claim 1 where one or more said video cameras are webcams.