Method for interacting with computer using a video camera image on screen and system thereof
First Claim
1. A method of facilitating human interaction with a computer having a keyboard and a display device, comprising the steps of:
- a) identifying registration marks in a reference-image from an initialization video signal of a keyboard, b) relating the reference image to a predetermined graphic keyboard representation using the identified registration marks;
c) processing data from post-initialization images of a keyboard in use by a user, the data including at least one of;
i) at least one registration mark, and ii) differences between the reference-image and the post-initialization images;
d) overlaying at least a portion of the data processed in step c) onto the keyboard representation for at least a plurality of the post-initialization images; and
e) transmitting the overlaid portion to a graphics display device.
1 Assignment
0 Petitions
Accused Products
Abstract
A method, device, and system for facilitating the use of and data entry into a computer having a data entry device such as a keyboard and a display device such as a monitor. A camera is disposed above the keyboard and captures a moving image of the keyboard. The image of the keyboard is shown on th display device, preferably in a small portion of the display device. In this way, a person can look at the display device and see both the subject matter he is typing or entering and the keyboard at the same time. An image of the user'"'"'s hands is made transparent and overlaid onto the image of the keyboard. The image of the keyboard can be manipulated, e.g., made smaller or larger, corrected for parallax and movement, the characters on the keys can be changed, and the like.
-
Citations
50 Claims
-
1. A method of facilitating human interaction with a computer having a keyboard and a display device, comprising the steps of:
-
a) identifying registration marks in a reference-image from an initialization video signal of a keyboard, b) relating the reference image to a predetermined graphic keyboard representation using the identified registration marks;
c) processing data from post-initialization images of a keyboard in use by a user, the data including at least one of;
i) at least one registration mark, and ii) differences between the reference-image and the post-initialization images;
d) overlaying at least a portion of the data processed in step c) onto the keyboard representation for at least a plurality of the post-initialization images; and
e) transmitting the overlaid portion to a graphics display device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A software-driven application keyboard imaging method comprising the steps of:
-
taking data from a video stream showing a keyboard associated with a computer and a display device; and
transposing a graphic equivalent of that data from the video stream onto a portion of the display device, wherein an image of the keyboard is depicted on the display device. - View Dependent Claims (14, 15)
-
-
16. A method of facilitating human interaction with a computer having a data entry device and a display device, comprising the steps of:
-
projecting an image of the data entry device as the data entry device is being used onto a portion of the display device, wherein the user can see both the image of the data entry device and the subject matter being created on the display device by the user'"'"'s manipulation of the data entry device substantially simultaneously. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A system for facilitating human interacting with a computer having a display device and a keyboard, comprising;
-
a moving image camera disposed over and pointed at the keyboard, said camera generating a video signal indicative of the keyboard;
means for displaying data from said video signal of the keyboard onto the display device as an image of the keyboard. - View Dependent Claims (26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37)
-
-
38. A system for facilitating use of a computer, comprising:
-
a computer including a display device and a keyboard;
a moving image camera disposed near and pointed at said keyboard, said camera generating a video signal indicative of said keyboard;
means for displaying said video signal of said keyboard onto said display device as an image of said keyboard. - View Dependent Claims (39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50)
-
Specification