Pressure and position sensing pointing devices and methods

• US 9,141,234 B2
• Filed: 08/29/2011
• Issued: 09/22/2015
• Est. Priority Date: 08/29/2011
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Nakamura, Fusanobu, Agata, Hiroaki, Wada, Takahide, Hosoya, Satoshi
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): AU, SCOTT D
• Application Number:
  US13/219,893
• Publication Number:
  US 20130050078A1
• Time in Patent Office: 1,485 Days
• Field of Search: 345173-179, 178 1801- 1811, 178/19.01
• US Class Current: 1/1
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

Pointing devices and related methods are disclosed that generally involve manipulation of a cursor or other user interface component based on inputs from a user. In one embodiment, an image sensor captures an image of the underside of a transparent contact surface and determines whether an object (e.g., a user'"'"'s finger) is present in the image. Cursor movement information comprising direction and velocity components can be calculated from a single image by equating the size of a detected object with a desired velocity and by equating the position of the detected object relative to a fixed reference point with a desired direction. Thus, detection of user motion is not required, nor is comparison of successive image frames relative to a time reference. As a result, a device having few or no moving parts can be provided while at the same time permitting continuous cursor motion without repetitive swiping by a user.

Claims

1. A pointing device for providing an output direction and an output velocity to a computer system to control a user interface of the computer system, comprising:

a contact surface mounted to a support;

a camera positioned beneath the contact surface and configured to capture an image of a lower side of the contact surface and an object that is in contact with an upper side of the contact surface;

a velocity calculation unit configured to calculate the output velocity based on a size of the object within the image; and

a direction calculation unit configured to calculate the output direction based on a position of the object within the image;

wherein the direction calculation unit calculates the output direction by comparing a position of a center point of the contact surface within the image to a position of a center point of the object within the image.

2. The device of claim 1, further comprising a light source positioned beneath the contact surface and configured to illuminate the lower side of the contact surface.

3. The device of claim 1, wherein the contact surface comprises a frosted dome.

4. The device of claim 1, wherein the object comprises a finger of a user.

5. The device of claim 1, further comprising a protective cover mounted adjacent to the contact surface.

6. The device of claim 5, wherein the object comprises a portion of the protective cover.

7. The device of claim 1, wherein the velocity calculation unit calculates the output velocity as zero when the size of the object within the image is less than a first threshold value.

8. The device of claim 7, wherein the velocity calculation unit calculates the output velocity as being proportional to the size of the object within the image when the size of the object within the image is greater than the first threshold value and less than a second threshold value.

9. The device of claim 8, wherein the velocity calculation unit calculates the output velocity as being a fixed speed limit velocity when the size of the object within the image is greater than the second threshold value.

10. The device of claim 1, further comprising an output unit configured to output the output velocity and the output direction to the computer system.

11. The device claim 1, further comprising a display unit, wherein a cursor displayed on the display unit moves at a speed corresponding to the output velocity and in a direction corresponding to the output direction.

12. The device of claim 1, wherein the velocity calculation unit is configured to calculate the output velocity based on a single image and the direction calculation unit is configured to calculate the output direction based on the same single image.

13. A method of calculating movement information for manipulating a graphical user interface, comprising:

obtaining a captured image of a bottom side of a contact surface;

determining whether the captured image includes an image of an object in contact with a top side of the contact surface; and

if the captured image includes an image of an object in contact with the top side of the contact surface,

calculating an output velocity based on a size of the object within the captured image; and

calculating an output direction based on a position of the object within the captured image;

wherein calculating the output direction comprises determining a center point of the object within the captured image, determining a center point of the captured image, and calculating a direction vector that extends between the two center points.

14. The method of claim 13, further comprising moving an on-screen cursor at a speed corresponding to the output velocity and in a direction corresponding to the output direction.

15. The method of claim 13, wherein calculating the output velocity comprises calculating an output velocity of zero when the size of the object within the captured image is less than a first threshold value.

16. The method of claim 15, wherein calculating the output velocity comprises calculating an output velocity proportional to the size of the object within the captured image when the size of the object within the captured image is greater than the first threshold value and less than a second threshold value.

17. The method of claim 16, wherein calculating the output velocity comprises calculating an output velocity as a fixed speed limit velocity when the size of the object within the captured image is greater than the second threshold value.

18. The method of claim 13, wherein the contact surface comprises a frosted dome.

19. The method of claim 13, wherein the object comprises a finger of a user.

20. The method of claim 13, wherein the object comprises a portion of a protective cover mounted adjacent to the contact surface.

21. The method of claim 13, wherein the output velocity and the output direction are calculated based on a single captured image.