Method for controlling a control region of a computerized device from a touchpad

• US 9,891,821 B2
• Filed: 09/19/2014
• Issued: 02/13/2018
• Est. Priority Date: 04/23/2010
• Status: Expired due to Fees

• Current Assignee: Handscape Inc., A Delaware Corporation
• Original Assignee: Handscape Inc., A Delaware Corporation
• Inventors: Luo, Tong
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): SHREWSBURY, NATHAN K
• Application Number:
  US14/491,671
• Publication Number:
  US 20150143276A1
• Time in Patent Office: 1,243 Days
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0216 Arrangements for ergonomically adjusting the disposition of keys of a keyboard for keyboards integrated in a laptop computer G06F1/1664
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A method for controlling a control region on a display screen of a computerized system is presented. The method includes obtaining data from a touchpad. The data is associated with a position of a portion of the hand of a user when the user operates the touchpad. The method includes transmitting the data from the touchpad to the computerized device and analyzing the data in accordance with a model of a human hand. In certain embodiments, the method includes identifying different sets of virtual keys to be associated with the different fingers of the user'"'"'s hand and generating a control region comprising the sets of virtual keys. In some embodiments, the method may include displaying the control region in a position on the display screen in accordance with a position of one or more fingers of the user'"'"'s hand on the touchpad.

Claims

1. A computer-implemented method for controlling a control region on a display screen of a computerized system, the method comprising:

obtaining, using the computerized system, first data from a touchpad, the first data being associated with a position of a portion of the hand of a user when the user operates the computerized system using the touchpad, the first data not being associated with an image of a finger of the user from an image sensor;

transmitting the first data from the touchpad to the computerized device, the touchpad being located in a location that is different from the location of the display screen;

analyzing the first data in accordance with a model of a human hand and assigning the first data to at least one of a plurality of fingers of the model;

identifying a first set of virtual keys to be associated with a first finger of the user;

generating a control region comprising the first set of virtual keys; and

displaying the control region in a first position on the display screen, wherein said first position varies in accordance with a position of the first finger on the touchpad.

2. The computer-implemented method of claim 1, further comprising:

computing a graphical representation of the first finger of the portion of the hand of the user on the touchpad in accordance with the model of the human hand; and

presenting the graphical representation of the first finger on the display screen of the computerized device.

3. The computer-implemented method of claim 1, wherein the control region comprises the first set of virtual keys associated with the first finger of the user.

4. The computer-implemented method of claim 1 further comprising:

computing a graphical representation of a second finger of the portion of the hand of the user in accordance with the model of the human hand;

identifying a second set of virtual keys to be associated with the second finger, the second set of virtual keys being different from the first set of virtual keys; and

displaying the control region comprising the graphical representation of the second set of virtual keys associated with the second finger.

5. The computer-implemented method of claim 1, wherein the identifying includes assigning the first set of virtual keys to the first finger in accordance with at least one of a QUERTY keyboard assignment or a standard keyboard assignment.

6. The computer-implemented method of claim 1 further comprising:

analyzing the first data in accordance with a model of the human hand;

determining an angular position of the first finger on the touchpad based on the analyzing; and

repositioning the control region in accordance with the angular position of the first finger.

7. The computer-implemented method of claim 1, further comprising determining that the first finger of the user on the touchpad is positioned above but not touching the touchpad, and in response to the determining, visually highlighting at least one virtual key of the first set of virtual keys in the control region.

8. The computer-implemented method of claim 7, further comprising fixing a position of the at least one virtual key in the control region until the at least one virtual key is selected, in response to the determining.

9. The computer-implemented method of claim 7, further comprising fixing a position of the at least one virtual key in the control region until a pre-determined time out period is reached.

10. The computer-implemented method of claim 7, further comprising altering the appearance of the at least one virtual key of the first set of virtual keys in the control region, in response to determining that the first finger of the user on the touchpad is positioned above but not touching the touchpad.

11. The computer-implemented method of claim 10, further comprising determining that the first finger is subsequently touching the touchpad, and in response to the determining, enabling a selection of the virtual key.

12. The computer-implemented method of claim 11, further comprising altering the appearance of the selected virtual key of the first set of virtual keys in the control region in response to determining that the first finger is subsequently touching the touchpad.

13. The computer-implemented method of claim 12, wherein altering the appearance of the selected virtual key comprises returning the appearance of the selected virtual key to its original size in response to determining that the first finger is subsequently touching the touchpad.

14. The computer-implemented method of claim 11, further comprising displaying the selected virtual key in a second position of the display screen, in response to determining that the first finger is subsequently touching the touchpad.

15. The computer-implemented method of claim 1, further comprising obtaining information related to the amount of pressure applied by the user when the user operates the touchpad from the first data and determining that the first finger of the user on the touchpad is touching the touchpad based on the obtained pressure information.

16. The computer-implemented method of claim 15, further comprising determining that the amount of pressure applied by the user on the touchpad is within a pre-determined threshold value, based on the first data.

17. The computer-implemented method of claim 16, further comprising visually highlighting at least one virtual key of the first set of virtual keys in the control region associated with the first finger based on determining that the amount of pressure applied by the user on the touchpad is within a pre-determined threshold value.

18. A non-transitory computer-readable storage medium comprising instructions which when executed by a computer cause the computer to:

obtain first data from a touchpad, the first data being associated with a position of a portion of the hand of a user when the user operates the computerized system using the touchpad, the first data not being associated with an image of a finger of the user from an image sensor;

transmit the first data from the touchpad to the computerized device, the touchpad being located in a location that is different from the location of the display screen;

analyze the first data in accordance with a model of a human hand and assigning the first data to at least one of a plurality of fingers of the model;

compute a graphical representation of a first finger of the portion of the hand of the user on the touchpad in accordance with the model of the human hand;

identify a first set of virtual keys to be associated with a first finger;

generate a control region comprising the first set of virtual keys; and

display the control region in a first position on the display screen, wherein said first position varies in accordance with a position of the first finger on the touchpad.

19. The computer-readable media of claim 18, wherein the control region comprises the first set of virtual keys associated with the first finger of the user.

20. The computer-readable media of claim 18, the instructions further comprising instructions to:

analyze the first data in accordance with a model of the human hand;

determine an angular position of the first finger on the touchpad based on the analyzing; and

reposition the control region in accordance with the angular position of the first finger.

21. The computer-readable media of claim 18, the instructions further comprising instructions to determine that the first finger of the user on the touchpad is positioned above but not touching the touchpad, and in response to the instructions to determine, visually highlighting at least one virtual key of the first set of virtual keys in the control region.

22. A system for controlling a control region on a display screen of a computerized system configured to:

obtain first data from a touchpad, the first data being associated with a position of a portion of the hand of a user when the user operates the computerized system using the touchpad, the first data not being associated with an image of a finger of the user from an image sensor;

transmit the first data from the touchpad to the computerized device, the touchpad being located in a location that is different from the location of the display screen;

analyze the first data in accordance with a model of a human hand and assigning the first data to at least one of a plurality of fingers of the model;

compute a graphical representation of a first finger of the portion of the hand of the user on the touchpad in accordance with the model of the human hand;

identify a first set of virtual keys to be associated with a first finger;

generate a control region comprising first set of virtual keys; and

display the control region in a first position on the display screen, wherein said first position varies in accordance with a position of the first finger on the touchpad.

23. The system of claim 22, wherein the control region comprises the first set of virtual keys associated with the first finger of the user.

24. The system of claim 22, wherein the instructions to identify comprise instructions to assign the first set of virtual keys to the first finger in accordance with at least one of a QUERTY keyboard assignment or a standard keyboard assignment.