Camera assisted pen tablet
First Claim
1. A method for providing visual feedback to a user operating a pointing device on a tablet for controlling a cursor within a window of a display, the user using a physical hand to operate the pointing device, the tablet defining a tablet region corresponding to the window, the tablet region comprising dimensions proportionally the same as the window, said method using an imaging device, said method comprising:
- acquiring with the tablet a pointing device position of the pointing device relative to the tablet region;
substantially simultaneously to acquiring said pointing device position, capturing with the imaging device a hand image of the physical hand of the user operating the pointing device;
positioning the cursor in the window using said pointing device position, the cursor being positioned so that the position of the cursor relative to the window corresponds to the pointing device position relative to the tablet region; and
substantially simultaneously to positioning the cursor in the window, overlaying on the display said hand image in a manner such that the position and orientation of said hand image relative to the cursor and to the window corresponds to the position and orientation of the hand relative to the pointing device position and to the tablet region;
whereby visual feedback regarding the position, orientation and shape of the physical hand of the user operating the pointing device is provided directly on the display by overlaying on the display the hand image acquired of the physical hand of the user operating the pointing device.
5 Assignments
0 Petitions
Accused Products
Abstract
An x-y user input device, such as a pen tablet or digitizing tablet, used to control a cursor on a display of a data processing system, comprises an imaging device or camera and an image processor for displaying a captured image of a user'"'"'s hand operating the input device within a window of the display. The input device is generally operated using a pointing device that controls the cursor position on the display while being synchronously imaged and displayed with the user'"'"'s hand on the display. The position of the captured image of the user'"'"'s hand and pointing device in the window relative to the cursor corresponds to a position of the hand relative to the pointing device, thereby providing a visualization effect that increases user comfort and proficiency with the input device.
-
Citations
44 Claims
-
1. A method for providing visual feedback to a user operating a pointing device on a tablet for controlling a cursor within a window of a display, the user using a physical hand to operate the pointing device, the tablet defining a tablet region corresponding to the window, the tablet region comprising dimensions proportionally the same as the window, said method using an imaging device, said method comprising:
-
acquiring with the tablet a pointing device position of the pointing device relative to the tablet region; substantially simultaneously to acquiring said pointing device position, capturing with the imaging device a hand image of the physical hand of the user operating the pointing device; positioning the cursor in the window using said pointing device position, the cursor being positioned so that the position of the cursor relative to the window corresponds to the pointing device position relative to the tablet region; and substantially simultaneously to positioning the cursor in the window, overlaying on the display said hand image in a manner such that the position and orientation of said hand image relative to the cursor and to the window corresponds to the position and orientation of the hand relative to the pointing device position and to the tablet region; whereby visual feedback regarding the position, orientation and shape of the physical hand of the user operating the pointing device is provided directly on the display by overlaying on the display the hand image acquired of the physical hand of the user operating the pointing device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 43, 44)
-
-
10. A user input device for providing visual feedback to a user operating a pointing device for controlling a cursor within a window of a display of a data processing system, the user using a physical hand to operate the pointing device, said user input device comprising:
- a tablet, said tablet defining a tablet region corresponding to the window, said tablet region comprising dimensions proportionally the same as the window, said tablet including an active surface, said active surface providing pointing device position information indicative of the pointing device position relative to said tablet region an imaging device for capturing a hand image of the physical hand of the user operating the pointing device substantially simultaneously to acquiring said pointing device position; and
an image processor for positioning the cursor in the window using said pointing device position, the cursor being positioned so that the position of the cursor relative to the window corresponds to the pointing device position relative to the tablet region and, substantially simultaneously to positioning the cursor in the window, overlaying on the display said hand image in a manner such that the position and orientation of said hand image relative to the cursor and to the window corresponds to the position and orientation of the hand relative to the pointing device position and to the tablet region whereby visual feedback regarding the position, orientation and shape of the physical hand of the user operating the pointing device is provided directly on the display by overlaying on the display the hand image acquired of the physical hand of the user operating the pointing device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)
- a tablet, said tablet defining a tablet region corresponding to the window, said tablet region comprising dimensions proportionally the same as the window, said tablet including an active surface, said active surface providing pointing device position information indicative of the pointing device position relative to said tablet region an imaging device for capturing a hand image of the physical hand of the user operating the pointing device substantially simultaneously to acquiring said pointing device position; and
Specification