System and method of emulating mouse operations using finger image sensors

• US 20050179657A1
• Filed: 02/10/2005
• Published: 08/18/2005
• Est. Priority Date: 02/12/2004
• Status: Abandoned Application

• Current Assignee: AuthenTec Incorporated (Apple Inc.)
• Original Assignee: Atrua Technologies Incorporated (Apple Inc.)
• Inventors: Russo, Anthony P., Weigand, David L., Pradenas, Ricardo Dario
• Application Number:
  US11/056,820
• Publication Number:
  US 20050179657A1
• Time in Patent Office: Days
• US Class Current: 345/163
• CPC Class Codes: G06F 2203/0338 Fingerprint track pad, i.e. fingerprint sensor used as pointing device tracking the fingertip image
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

A system and method in accordance with the present emulate a computer mouse operation. The system comprises a finger image sensor for capturing images relating to a finger and generating finger image data, a controller, and an emulator. The controller is coupled to the finger image sensor and is configured to receive the finger image data and generate movement and presence information related to the finger on the finger image sensor. The emulator is configured to receive the movement and presence information, determine duration corresponding to the presence of the finger on the finger image sensor, and generate data corresponding to a mouse output. In a preferred embodiment, the finger image sensor comprises one or more logical regions, each region corresponding to a positional mouse button. In this way, the system is able to emulate a left mouse click and, optionally, a right mouse click and a center mouse click.

Claims

1. A system for emulating mouse operations comprising:

a. a finger image sensor for capturing images relating to a finger and generating finger image data;

b. a controller configured to receive the finger image data and generate movement and presence information related to the finger on the finger image sensor; and

c. an emulator configured to receive the movement and presence information, determine durations corresponding to the presence of the finger on the finger image sensor, and generate data corresponding to a mouse operation.

2. The system of claim 1, wherein the finger image sensor comprises one or more logical regions each corresponding to a positional mouse button.

3. The system of claim 2, wherein the emulator is configured to determine that a finger is off the finger image sensor for a predetermined duration and that the finger is maintained within an area of a first region from the one or more logical regions for a time within a predetermined range of durations.

4. The system of claim 3, wherein the emulator is configured to generate data corresponding to a single mouse click in the event that the finger is off the finger image sensor for at least a first predetermined duration, the finger is maintained within the area of the first region within a first predetermined range of durations, and the finger is off the finger image sensor for at least a second predetermined duration.

5. The system of claim 4, wherein the first predetermined duration is approximately 2 seconds, the first predetermined range of durations is 10 ms to 2 seconds, and the second predetermined duration is approximately 2 seconds.

6. The system of claim 4, wherein determining that the finger is maintained within the area of the first region comprises determining that the finger has moved no more than a first linear distance in a first direction within the first region and no more than a second linear distance in a second direction within the first region.

7. The system of claim 6, wherein the first linear distance and the second linear distance are approximately 10 mm.

8. The system of claim 6, wherein the first linear distance and the second linear distance are determined using a row-based correlation.

9. The system of claim 4, wherein the one or more logical regions comprise a left region corresponding to a left mouse button such that the single mouse click corresponds to a left mouse button click.

10. The system of claim 9, wherein the one or more logical regions further comprise at least one of a right region corresponding to a right mouse button and a center region corresponding to a center mouse button.

11. The system of claim 3, wherein the emulator is configured to generate data corresponding to a double mouse click in the event that the finger is off the finger image sensor for at least a first predetermined duration, the finger is maintained within an area of the first region within a first predetermined range of durations, the finger is off the finger image sensor for at least a second predetermined duration, the finger is maintained within the area of the first region within a third predetermined range of durations, and the finger is off the finger image sensor for at least a third predetermined duration.

12. The system of claim 4, wherein the emulator is further configured to generate data corresponding to relocating an object displayed on a screen.

13. The system of claim 12, wherein the data corresponding to relocating the object comprises:

a. first data corresponding to selecting the object using an onscreen cursor;

b. second data corresponding to capturing the object;

c. third data corresponding to moving the object along the screen; and

d. fourth data corresponding to unselecting the object.

14. The system of claim 13, wherein the first data are generated by moving the finger across the finger image sensor and tapping the finger image sensor, the second data are generated by placing and maintaining the finger within the area of the first region for a predetermined time, the third data are generated by moving the finger across the finger image sensor, and the fourth data are generated by tapping the finger on the finger image sensor.

15. The system of claim 1, further comprising an electronic device having a screen for displaying data controlled by the mouse operation, the electronic device any one of a portable computer, a personal digital assistant, and a portable gaming device.

16. The system of claim 1, wherein the finger image sensor is a swipe sensor.

17. The system of claim 16, wherein the swipe sensor is one of a capacitive sensor, a thermal sensor, and an optical sensor.

18. The system of claim 1, wherein the finger image sensor is a placement sensor.

19. A method of emulating a mouse operation comprising:

a. determining a sequence of finger placements on and off a finger image sensor and their corresponding durations; and

b. using the sequence and corresponding durations to generate an output for emulating the mouse operation.

20. The method of claim 19, wherein the finger image sensor comprises one or more regions, each region corresponding to a positional mouse button.

21. The method of claim 20, wherein determining a sequence of finger placements comprises:

a. determining that a finger is off the finger image sensor for at least a first predetermined duration;

b. determining that the finger is maintained within an area of a first region from the one or more regions within a first predetermined range of durations; and

c. determining that the finger is off the finger image sensor for at least a second predetermined duration.

22. The method of claim 21, wherein the mouse operation corresponds to a single mouse click.

23. The method of claim 22, wherein the first predetermined duration is approximately 2 seconds, the first predetermined range of durations is 10 ms to 2 seconds, and the second predetermined duration is approximately 2 seconds.

24. The method of claim 22, wherein determining that the finger is maintained within an area of the first region comprises determining that the finger has moved no more than a first linear distance in a first direction within the first region and no more than a second linear distance in a second direction within the first region.

25. The method of claim 24, wherein the first linear distance and the second linear distance are 10 mm.

26. The method of claim 24, wherein the first linear distance and the second linear distance are determined using a row-based correlation.

27. The method of claim 21, wherein the one or more regions comprise a left region corresponding to a left mouse button.

28. The method of claim 27, wherein the one or more regions further comprise at least one of a right region corresponding to a right mouse button and a center region corresponding to a right mouse button.

29. The method of claim 21, wherein determining a sequence of finger placements further comprises:

a. determining that the finger is maintained within the area of the first region within a third predetermined range of durations; and

b. determining that the finger is off the finger image sensor for at least a third predetermined duration.

30. The method of claim 29, wherein the mouse operation corresponds to a double mouse click.

31. The method of claim 19, wherein the finger image sensor is a swipe sensor.

32. The method of claim 31, wherein the swipe sensor is one of a capacitive sensor, a thermal sensor, and an optical sensor.

33. The method of claim 19, wherein the finger image sensor is a placement sensor.

34. The method of claim 20, further comprising determining a sequence of finger movements on the finger image sensor, wherein the output corresponds to data for relocating an object displayed on a screen.

35. The method of claim 34, wherein the sequence comprises:

a. moving the finger across the finger image sensor and tapping the finger image sensor, thereby generating data corresponding to selecting the object using an onscreen cursor;

b. placing the finger on the finger image sensor within an area of the first region from the one or more regions for a predetermined time, thereby generating data corresponding to capturing the object;

c. moving the finger across the finger image sensor, thereby generating data corresponding to moving the object; and

d. tapping the finger on the finger image sensor, thereby generating data corresponding to unselecting the object.

36. The method of claim 35, further comprising generating an audible sound corresponding to capturing the object.

37. The method of claim 34, wherein the sequence comprises:

a. performing one of rotating and rolling the finger along the finger image sensor, thereby generating data corresponding to select the object using an onscreen cursor;

b. moving the finger across the finger image sensor, thereby generating data corresponding to moving the object; and

c. performing one of rotating and rolling the finger along the finger image sensor, thereby generating data corresponding to unselect the object.

38. The method of claim 19, wherein the mouse operation is performed on an electronic computing platform selected from the group consisting of a portable computer, a personal digital assistant, and a portable gaming device.