Compact optical pointing apparatus and method

• US 8,049,720 B2
• Filed: 07/11/2006
• Issued: 11/01/2011
• Est. Priority Date: 12/30/2002
• Status: Expired due to Fees

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola Mobility, Inc. (Lenovo Group Ltd.)
• Inventors: Gust, Lawrence Alan
• Primary Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US11/456,719
• Publication Number:
  US 20060244722A1
• Time in Patent Office: 1,939 Days
• Field of Search: 345156-158, 345/165, 345/166, 345/173, 345/179, 345/204, 455/556.1, 455/556.2
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface

Abstract

A display pointing device (10) includes a fingerprint sensing circuit (18) that optically senses, for example, a portion of a fingerprint or other skin texture, and a fingerprint movement detection circuit (20), operatively coupled to the fingerprint sensing circuit (18), that is operative to determine a direction of movement and a rate of movement of skin texture being sensed by the fingerprint sensing circuit (18) to produce pointing output data (24) for a display (12). The pointing output data (24) may be, for example, data representing a visual indication of a position on a display screen, such as a position of a cursor or of highlighted text, or any other suitable position indication. A method for providing pointing information for display includes sensing a fingerprint, determining a direction of movement and a rate of movement of the fingerprint and producing a pointing output for display based on a determined direction of movement and rate of movement of the sensed fingerprint.

Claims

1. A mobile device comprising:

a display;

a fingerprint sensing circuit mounted within a depressible key; and

a fingerprint movement detection circuit, operatively coupled to the fingerprint sensing circuit and to the display, and operative to determine a direction of movement independent of depression of the depressible key and a rate of movement, of skin texture being sensed by the fingerprint sensing circuit and to produce pointing output data for the display;

wherein the fingerprint movement detection circuit determines at least one of a rate and a direction of movement of the skin texture by;

modifying at least one of the previously stored images to produce a plurality of candidate displacement images each with an associated respective displacement movement vector;

and compares by correlating the resolved first image against each of the plurality of candidate displacement images to produce a plurality of respectively associated displacement correlation scores;

and wherein determining at least one of a rate and a direction of movement further includes;

choosing the highest displacement correlation score and providing the associated respective displacement movement vector to determine the direction of movement of the skin texture.

2. The mobile device of claim 1 including a wireless telephone subsystem operatively coupled to the display.

3. The mobile device of claim 1 wherein the fingerprint sensing circuit includes a sensing array including at least one of:

a plurality of charge coupled devices (CCD'"'"'s) and a plurality of thermal sensors.

4. The mobile device of claim 1 wherein the fingerprint sensing circuit includes an illumination source operatively positioned to provide illumination of the skin texture wherein sensing of the skin texture is responsive to the illumination.

5. The mobile device of claim 1 wherein the fingerprint sensing means includes a sensing array focusing mechanism operatively coupled to focus charge coupled devices to detect the skin texture.

6. The mobile device of claim 5 wherein the fingerprint sensing circuit includes an optical filter positioned interstitially between the skin texture and the charged coupled devices to filter visible light from the charge coupled devices.

7. The mobile device of claim 1 wherein the fingerprint movement detection circuit further comprises:

memory to store at least one previously stored image,

and wherein the fingerprint movement detection circuit iteratively;

resolves data received from the fingerprint sensing circuit to produce a new image;

compares the resolved new image to a previously stored image;

determines at least one of a rate and a direction of movement of the skin texture responsive to the comparison; and

stores the new image as a previously stored image.

8. The mobile device of claim 7 wherein the fingerprint movement detection circuit uses ridges and furrows in skin texture as a reference pattern when comparing the resolved new image to the previously stored image.

9. The mobile device of claim 7 wherein the fingerprint movement detection circuit:

modifies the first image to produce a plurality of candidate origination images each with an associated respective origination movement vector;

correlates at least one stored image against each of the plurality of candidate origination images to produce a plurality of respectively associated origination correlation scores; and

chooses the highest origination correlation score and provides the associated respective origination movement vector to determine the direction of movement of the skin texture.

10. The mobile device of claim 9 wherein the fingerprint movement detection circuit:

timestamps each resolved first image with an associated timestamp;

wherein the storing further;

records the timestamp associated with a respective stored image;

wherein the determining further;

computes the difference in time between the timestamp associated with at least one of the previously stored images and the timestamp associated with the first image and uses the computed time difference and the magnitude of the associated respective origination movement vector to determine the rate of movement of the skin texture.

11. The mobile device of claim 1 wherein the fingerprint movement detection circuit modifies by at least one of the image operations of translation, rotation, and scaling of the image.

12. The mobile device of claim 1 wherein the fingerprint movement detection circuit:

timestamps each resolved first image with an associated time stamp;

records the timestamp associated with a respective stored image;

computes the difference in time between the timestamp associated with at least one of the previously stored images and the timestamp associated with the first image and uses the computed time difference and the magnitude of the associated respective displacement movement vector to determine the rate of movement of the skin texture.

13. The mobile device of claim 1 including a housing and wherein the fingerprint sensing circuit further comprises a sensing window located on a non-bottom surface of the housing.

14. The mobile device of claim 13 wherein the sensing window is located within a depressible button.

15. The mobile device of claim 13 wherein the sensing window is located within a specific user control of the mobile device, wherein the fingerprint sensing circuit is otherwise unrelated to the function of the specific user control.

16. The mobile device of claim 1 wherein the modifying includes at least one of the image operations of translation, rotation, and scaling.

17. The mobile device of claim 1 wherein the depressible key is a control key.

18. The mobile device of claim 17 wherein the depressible key comprises a generally flat overall top surface and a frame surrounding the sensing window.

19. A mobile device comprising:

a display;

a depressible multi-function key, comprising a sensing window co-located on the depressible key, the sensing window being part of a surface texture sensing circuit; and

a surface texture movement detection circuit, operatively coupled to the surface texture sensing circuit and operative to determine direction of movement independent of depression of the depressible key, and operative to determine rate of movement of a texture over the sensing window and to produce pointing output data for the display and wherein the depressible key also functions as a non-pointing device based key.

20. The mobile device of claim 19 wherein the surface texture movement detection circuit comprises a sensing array focusing mechanism operative to detect texture of a finger wherein the sensing array focusing mechanism is adapted so that light emitted within a predetermined height above a top surface of the sensing window is focused on the sensing array.