Handheld pointer device and pointer positioning method thereof

• US 9,804,689 B2
• Filed: 11/10/2014
• Issued: 10/31/2017
• Est. Priority Date: 02/19/2013
• Status: Active Grant

• Current Assignee: PixArt Imaging Incorporated
• Original Assignee: PixArt Imaging Incorporated
• Inventors: Cheng, Han-Ping, Huang, Chao-Chien
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): TESHOME, KEBEDE T
• Application Number:
  US14/536,769
• Publication Number:
  US 20150054745A1
• Time in Patent Office: 1,086 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device

Abstract

A pointer positioning method for a handheld pointer device includes: capturing a first frame containing a reference point when the handheld pointer device updates a first tilt angle presently used to a second tilt angle; computing a first pointing coordinate according to the image position of the reference point in the first frame and the first tilt angle; computing a second pointing coordinate according to the image position of the reference point in the first frame and the second tilt angle; capturing a second frame containing the reference point to compute a third pointing coordinate according to the image position of the reference point in the second frame and the second tilt angle; generating a cursor parameter for controlling a display position of a cursor on a display apparatus according to the first pointing coordinate, the second pointing coordinate, and the third pointing coordinate.

Claims

1. A pointer positioning method of a handheld pointer device, comprising:

capturing a first frame containing a reference point when the handheld pointer device updates a first tilt angle presently used to a second tilt angle;

computing a first pointing coordinate according to the image position of the reference point formed in the first frame and the first tilt angle;

computing a second pointing coordinate according to the image position of the reference point formed in the first frame and the second tilt angle;

capturing a second frame containing the reference point and computing a third pointing coordinate according to the image position of the reference point formed in the second frame and the second tilt angle; and

computing a cursor position according to the first pointing coordinate, the second pointing coordinate, and the third pointing coordinate and correspondingly generating a cursor parameter controlling a display position of a cursor on a display apparatus, wherein the step of computing the cursor position comprises;

generating the cursor parameter controlling the display position of the cursor on the display apparatus according to the third pointing coordinate when a first displacement vector between the first and the second pointing coordinates is computed to be less than a first predetermined threshold;

computing the cursor position according to the first displacement vector and the third pointing coordinate when the first displacement vector between the first and the second pointing coordinates is greater than the first predetermined threshold; and

further comprising;

a) setting a number of calibrations as N, a compensation vector as C and a calibration coordinate, wherein the calibration coordinate is the third pointing coordinate;

b) determining whether the first displacement vector is greater than a second predetermined threshold;

c) setting N equal to the first displacement vector divided by C when determines that the first displacement vector is greater than the second predetermined threshold, wherein C is a predetermined compensation value;

setting C equal to the first displacement vector divided by N when determines that the first displacement vector is less than the second predetermined threshold, wherein N is a predetermined number of calibrations;

d) computing the sum of the calibration coordinate and C to generate a compensated pointing coordinate;

e) generating the cursor parameter to correspondingly control the display position of the cursor on the display apparatus according to the compensated pointing coordinate;

f) executing N−

1 and determining whether N is equal to zero; and

g) setting a fourth pointing coordinate to be the calibration coordinate and returning to step d) upon determined that N is not equal to zero;

wherein the forth pointing coordinate is computed according to the image position of the reference point formed in a third frame and the second tilt angle.

2. The pointer positioning method according to claim 1, wherein the step of computing the cursor position comprises:

generating the cursor parameter controlling the display position of the cursor on the display apparatus according to the third pointing coordinate when an angle difference between the first and the second tilt angles is computed to be smaller than a preset angle.

3. The pointer positioning method according to claim 2, wherein the preset angle is set according to the type of a software application executed on the display apparatus.

4. The pointer positioning method according to claim 1, wherein the step of computing the cursor position further comprises:

h) when determines that N is equal to zero, causes the handheld pointer device to compute the cursor position in the subsequent movement of the handheld pointer device according to the image position of the reference point formed in a succeeding frame captured and the second tilt angle.

5. The pointer positioning method according to claim 1, wherein steps before the step d) comprise:

i) determining whether to update the second tilt angle to a third tilt angle;

j) computing a second displacement vector generated as the handheld pointer device rotates when determines that the handheld pointer device has updated the second tilt angle presently used to the third tilt angle; and

k) computing the sum of the calibration coordinate, the second displacement vector, and C to generate the compensated pointing coordinate.

6. The pointer positioning method according to claim 1, wherein the predetermined number of calibrations is set according to a frame capturing rate of the handheld pointer device used for capturing frames containing the reference point.

7. The pointer positioning method according to claim 6, wherein the frame capturing rate is configured by a user according to a preset calibration time.

8. The pointer positioning method according to claim 1, wherein first predetermined threshold is set according to the type of a software application executed on the display apparatus.

9. The pointer positioning method according to claim 1, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the reference point has not substantially moved.

10. The pointer positioning method according to claim 9, wherein the handheld pointer device determines whether the reference point has substantially moved by determining whether the image position of the reference point formed in the consecutive frames has moved.

11. The pointer positioning method according to claim 10, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the position displacement computed between the image position of the reference point formed in any two consecutive frames captured by the handheld pointer device is less than a predefined displacement threshold.

12. The pointer positioning method according to claim 10, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the velocity computed between the image position of the reference point formed in any two consecutive frames captured by the handheld pointer device is less than a predefined velocity threshold.

13. The pointer positioning method according to claim 1, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the magnitude of a acceleration vector of the handheld pointer device is equal to a gravitational acceleration of the handheld pointer device, wherein the acceleration vector is generated by the handheld pointer device according to accelerations of the handheld pointer device detected over the multiple axes.

14. The pointer positioning method according to claim 1, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the pointing coordinate, being computed based on the image position of the reference point formed in multiple consecutive frames using the first tilt angle, has not substantially moved.

15. A pointer positioning method of a handheld pointer device, comprising:

capturing a first frame containing a reference point when the handheld pointer device updates a first tilt angle presently used to a second tilt angle;

computing an angle difference between the first and the second tilt angles;

computing a first pointing coordinate according to the image position of the reference point formed in the first frame and the first tilt angle when the angle difference is larger than a preset angle;

computing a second pointing coordinate according to the image position of the reference point formed in the first frame and the second tilt angle;

causing the handheld pointer device to compute a cursor position of a cursor in the subsequent movement of the handheld pointer device on the basis of a first displacement vector between the first and the second pointing coordinates along with the pointing coordinate generated responsive to the movement of the handheld pointer device;

wherein the step of computing the cursor position comprises;

a) setting a number of calibrations as N, a compensation vector as C and a calibration coordinate, wherein the calibration coordinate is a third pointing coordinate computed according to the image position of the reference point formed in a second frame and the second tilt angle;

b) determining whether the first displacement vector is larger than a predetermined threshold;

c) setting N equal to the first displacement vector divided by C when determines that the first displacement vector is greater than the predetermined threshold, wherein C is a predetermined compensation value;

setting C equal to the first displacement vector divided by N when determines that the first displacement vector is smaller than the predetermined threshold, wherein N is a predetermined number of calibrations;

d) computing the sum of the calibration coordinate and C to generate a compensated pointing coordinate;

e) generating the cursor parameter to correspondingly control the display position of the cursor on the display apparatus according to the compensated pointing coordinate;

f) executing N−

1 and determining whether N is equal to zero; and

setting a fourth pointing coordinate to be the calibration coordinate and returning to step d) upon determined that N is not equal to zero;

wherein the forth pointing coordinate is computed according to the image position of the reference point formed in a third frame and the second tilt angle; and

correspondingly generating a cursor parameter for controlling a display position of the cursor on a display apparatus.

16. The pointer positioning method according to claim 15, further comprising:

computing the cursor position according to the image position of the reference point formed in the second frame and the second tilt angle, and generating the cursor parameter correspondingly controlling the display position of the cursor on the display apparatus when determines that the angle difference between the first and the second tilt angles is smaller than the preset angle, wherein the second frame is captured and generated at a later time than the first frame.

17. The pointer positioning method according to claim 15, wherein the step of computing the cursor position further comprises:

a) when determines that N is equal to zero, causes the handheld pointer device to compute the cursor position in the subsequent movement of the handheld pointer device according to the image position of the reference point formed in a succeeding frame captured and the second tilt angle.

18. The pointer positioning method according to claim 15, wherein the preset angle is set according to the type of a software application executed on the display apparatus.

19. The pointer positioning method according to claim 15, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the image position of the reference point formed in the consecutive frames have not substantially moved.

20. The pointer positioning method according to claim 15, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the pointing coordinates, being computed based on the image position of the reference point formed in multiple consecutive frames using the first tilt angle, has not substantially moved.

21. A pointer positioning method of a handheld pointer device, comprising:

causing the handheld pointer device to update a first tilt angle presently used to a second tilt angle at a first time interval;

causing the handheld pointer device to compute a first pointing coordinate and a second point coordinate according to the image position of the reference point formed in a first frame using the first tilt angle and the second tilt angle in the first time interval, respectively;

causing the handheld pointer device to compute a third pointing coordinate according to the image position of the reference point formed in a second frame and the second tilt angle at a second time interval, wherein the second time interval occurs after the first time interval; and

computing the cursor position of a cursor according to the first pointing coordinate, the second pointing coordinate, and the third pointing coordinate to correspondingly generate a cursor parameter for controlling a display position of the cursor on a display apparatus; and

computing the cursor position for controlling the display position of the cursor on the display apparatus according to the third pointing coordinate at the second time interval when a first displacement vector between the first and the second pointing coordinates is computed to be less than a first predetermined threshold;

wherein the step of computing the cursor position comprises;

a) setting a number of calibrations as N, a compensation vector as C and a calibration coordinate, wherein the calibration coordinate is set as the third pointing coordinate;

b) determining whether the first displacement vector is greater than a second predetermined threshold;

c) setting N equal to the first displacement vector divided by C when determines that the first displacement vector is greater than the second predetermined threshold, wherein C is a predetermined compensation value;

setting C equal to the first displacement vector divided by N when determines that the first displacement vector is less than the second predetermined threshold, wherein N is a predetermined number of calibrations;

d) computing the sum of the calibration coordinate and C to generate a compensated pointing coordinate;

e) generating the cursor parameter to correspondingly control the display position of the cursor on the display apparatus according to the compensated pointing coordinate;

f) executing N−

1 and determining whether N is equal to zero; and

g) setting a fourth pointing coordinate to be the calibration coordinate and returning to step d) upon determined that N is not equal to zero.

22. The pointer positioning method according to claim 21, further comprising:

computing the first displacement vector between the first and the second pointing coordinates at the first time interval;

generating the compensating vector per unit displacement according to the first displacement vector; and

computing the third pointing coordinate using the compensating vector per unit displacement and the second tilt angle at the second time interval.

23. The pointer positioning method according to claim 21, wherein the first predetermined threshold is set according to the type of a software application executed on the display apparatus.

24. The pointer positioning method according to claim 21, further comprising:

computing the cursor position at the first time interval according to the first pointing coordinate; and

generating the cursor parameter according to the cursor position computed for controlling the display position of the cursor at the first time interval.

25. The pointer positioning method according to claim 21, further comprising:

computing the fourth pointing coordinate at a third time interval according to the image position of the reference point formed in a third frame captured and the second tilt angle; and

generating the cursor parameter according to the fourth pointing coordinate for controlling the display position of the cursor on the display apparatus at the third time interval.

26. The pointer positioning method according to claim 21, wherein the step of computing the cursor position comprises:

determining whether an angle difference between the first and the second tilt angle computed is smaller than a preset angle; and

computing the cursor position according to the third pointing coordinate and generating the cursor parameter for correspondingly controlling the display position of the cursor on the display apparatus at the second time interval upon determined that the angle difference is smaller than the preset angle.

27. The pointer positioning method according to claim 26, wherein the preset angle is set according to the type of a software application executed on the display apparatus.

28. A handheld pointer device, comprising:

an image capturing unit, configured to operatively capture a plurality of images corresponding to the position of a reference point and sequentially generate a plurality of frames;

an accelerometer unit, configured to detect a plurality of accelerations of the handheld pointer device over multiple axes and generating an acceleration vector; and

a processing unit coupled to the image capturing unit and the accelerometer unit, the processing unit configured to operatively compute a cursor position of a cursor according to the image positions of the reference points in the frames and a first tilt angle;

wherein when the processing unit updates the first tilt angle presently used in cursor position computation to a second tilt angle according to the plurality of accelerations detected, the processing unit operatively drives the image capturing unit to capture a first frame containing the reference point to respectively compute a first pointing coordinate and a second pointing coordinate using the first and the second tilt angles in coordination with the first frame, drives the image capturing unit to capture a second frame containing the reference point thereafter, computes the cursor position according to the image position of the reference frame in the second frame, the first pointing coordinate, the second pointing coordinate, and generates a cursor parameter for correspondingly controlling a display position of the cursor on a display apparatus;

wherein the processing unit computes the cursor position according to the image position of the reference point formed in one of the frames and the second tilt angle when the processing unit determines that a first displacement vector between the first and the second pointing coordinates is computed to be less than a first predetermined threshold; and

the processing unit generates the first displacement vector according to the first and the second pointing coordinates and generates the cursor parameter for correspondingly controlling the display position of the cursor on the display apparatus according to the image position of the reference point formed in the second frame, the first displacement vector, and the second tilt angle;

wherein the processing unit computes the cursor position by executing the following steps;

a) setting a number of calibrations as N, a compensation vector as C and a calibration coordinate, wherein the calibration coordinate is a third pointing coordinate computed according the image position of the reference point in the second frame and the second tilt angle;

b) determining whether the first displacement vector is greater than a second predetermined threshold;

c) setting N equal to the first displacement vector divided by C when determines that the first displacement vector is greater than the second predetermined threshold, wherein C is a predetermined compensation value;

setting C equal to the first displacement vector divided by N when determines that the first displacement vector is less than the second predetermined threshold, wherein N is a predetermined number of calibrations;

d) computing the sum of the calibration coordinate and C to generate a compensated pointing coordinate;

e) generating the cursor parameter to correspondingly control the display position of the cursor on the display apparatus according to the compensated pointing coordinate;

f) executing N−

1 and determining whether N is equal to zero; and

g) setting a fourth pointing coordinate to be the calibration coordinate and returning to step d) upon determined that N is not equal to zero;

wherein the forth pointing coordinate is computed according to the image position of the reference point formed in a third frame and the second tilt angle.

29. The handheld pointer device according to claim 28, wherein the processing unit computes the cursor position according to the image position of the reference point formed in one of the frames and the second tilt angle when the processing unit determines that an angle difference between the first and the second tilt angles is smaller than a preset angle.

30. The handheld pointer device according to claim 28, wherein the step of computing the cursor position further comprises:

h) when determines that N is equal to zero, causes the handheld pointer device to compute the cursor position in the subsequent movement of the handheld pointer device according to the image positions of the reference point formed in a succeeding frame and the second tilt angle.

31. The handheld pointer device according to claim 30, wherein the processing unit executes the following steps before executing step d):

i) determining whether to cause the handheld pointer device to update the second tilt angle to a third tilt angle during the computation of the compensated pointing coordinate;

j) computing a second displacement vector generated as the handheld pointer device rotates when determines that the handheld pointer device has updated the second tilt angle presently used to the third tilt angle; and

k) computing the sum of the calibration coordinate, the second displacement vector and C to generate the compensated pointing coordinate.

32. The handheld pointer device according to claim 28, further comprising:

an input unit coupled to the processing unit, configured for providing a user of the handheld pointer device to set N or C based on a frame capturing rate associated with the reference point.

33. The handheld pointer device according to claim 28, further comprising:

an input unit coupled to the processing unit, configured for providing a user of the handheld pointer device to configure a frame capturing rate for the reference point according to a preset calibration time and set N based on the frame capturing rate.

34. The handheld pointer device according to claim 28, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the reference point has not substantially moved.

35. The handheld pointer device according to claim 34, wherein the processing unit operatively updates the first tilt angle presently used to the second tilt angle upon determined that the position displacement computed between the image position of the reference point formed in any two consecutive frames captured is less than a predefined displacement threshold.

36. The handheld pointer device according to claim 34, wherein the processing unit operatively updates the first tilt angle presently used to the second tilt angle upon determined that the velocity computed between the image position of the reference point formed in any two consecutive frames captured is less than a predefined a predefined velocity threshold.

37. The handheld pointer device according to claim 28, wherein the processing unit operatively updates the first tilt angle presently used to the second tilt angle upon determined that the magnitude of the acceleration vector of the handheld pointer device is equal to a gravitational acceleration of the handheld pointer device.

38. The handheld pointer device according to claim 28, wherein the handheld pointer device operatively updates the first tilt angle presently used to the second tilt angle upon determined that the pointing coordinates computed based on the image position of the reference point formed in multiple consecutive frames using the first tilt angle have not substantially moved.

39. The handheld pointer device according to claim 28, further comprising:

a communication unit, configured to operatively transmit the cursor parameter of the cursor to the display apparatus wirelessly.

40. The handheld pointer device according to claim 28, wherein the accelerometer unit is an accelerometer or a gravitational sensor.