Multi-level command sensing apparatus

• US 9,454,259 B2
• Filed: 04/29/2016
• Issued: 09/27/2016
• Est. Priority Date: 01/04/2016
• Status: Active Grant

• Current Assignee: SecuGen Corporation (Pivotec Corp.)
• Original Assignee: SecuGen Corporation (Pivotec Corp.)
• Inventors: Lee, Ye Seon, Lee, Dong Won, Kim, Jae Ho, Kim, Jae Hyeong
• Primary Examiner(s): Schwartz, Darren B
• Application Number:
  US15/143,303
• Publication Number:
  US 20160239150A1
• Time in Patent Office: 151 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2221/2139 Recurrent verification
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/041661 using detection at multiple resolutions, e.g. coarse and fine scanning; using detection within a limited area, e.g. object tracking window
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/1306 non-optical, e.g. ultrasonic or capacitive sensing
• CPC Class Codes: G06V 40/1312 direct reading, e.g. contactless acquisition
• CPC Class Codes: G06V 40/1318 using electro-optical elements or layers, e.g. electroluminescent sensing
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities

Abstract

Methods and systems are provided for a multi-level command sensing apparatus that includes a matrix of light sensors and light sources and that may also serve as the display. In one embodiment, a method for performing multi-level command sensing by a multi-level command sensing apparatus comprises detecting a leakage current corresponding to changes of light conditions on a display by one or more light sensors of the multi-level command sensing apparatus, determining an action performed by a user based on the changes of light conditions on the display by a controller of the multi-level command sensing apparatus, determining a command based on the action performed by the controller of the multi-level command sensing apparatus, and executing the command by the controller of the multi-level command sensing apparatus.

Claims

1. A method for performing multi-level command sensing by a multi-level command sensing apparatus, comprising:

detecting a leakage current corresponding to changes of light conditions on a display by one or more light sensors of the multi-level command sensing apparatus;

converting the leakage current to a leakage voltage;

determining an action performed by a user based on the changes of light conditions on the display according to changes of the leakage voltage by a controller of the multi-level command sensing apparatus;

determining a command based on the action performed by the controller of the multi-level command sensing apparatus, wherein determining the command comprises comparing the action performed by the user to a set of predefined actions stored in a database of the multi-level command sensing apparatus, and identifying the command corresponding to the action performed by the user in response to a match being found in the set of predefined actions; and

executing the command by the controller of the multi-level command sensing apparatus.

2. The method of claim 1:

wherein the changes of light conditions comprise a sequence of shadows detected on the display, and wherein the action performed by the user comprises a sequence of hovering motions without touching the display.

3. The method of claim 1:

wherein the changes of light conditions comprise a sequence of brightened shadows detected on the display, and wherein the action performed by the user comprises a sequence of touches on the display.

4. The method of claim 3:

wherein the sequence of brightened shadows is caused by reflected light and scattered light from an object touching the display.

5. The method of claim 3, wherein the sequence of touches includes a sequence of low pressure touches predefined by the user.

6. The method of claim 3, wherein the sequence of touches includes a sequence of high pressure touches predefined by the user.

7. The method of claim 3, further comprising:

authenticating the user based on the sequence of touches on the display.

8. The method of claim 7, wherein authenticating the user further comprises:

continuously authenticating the user during an access to security sensitive information using the multi-level command sensing apparatus; and

terminating the access to the security sensitive information in response to one or more mismatches found in the continuously authenticating process.

9. The method of claim 1, wherein determining the action performed by the user comprises:

comparing the changes of light conditions on the display to a set of predefined changes of light conditions stored in a database of the multi-level command sensing apparatus; and

identifying the action performed by the user corresponding to the changes of light conditions on the display in response to a match being found in the set of predefined changes of light conditions.

10. A multi-level command sensing apparatus, comprising:

a display;

one or more light sensors configured to detect a leakage current corresponding to changes of light conditions on the display;

a controller comprising one or more processors, the controller is configured to;

convert the leakage current to a leakage voltage;

determine an action performed by a user based on the changes of light conditions on the display according to changes of the leakage voltage;

determine a command based on the action performed, wherein the controller is further configured to compare the action performed by the user to a set of predefined actions stored in a database of the multi-level command sensing apparatus, and identify the command corresponding to the action performed by the user in response to a match being found in the set of predefined actions; and

execute the command determined.

11. The multi-level command sensing apparatus of claim 10:

wherein the changes of light conditions comprise a sequence of shadows detected on the display, and wherein the action performed by the user comprises a sequence of hovering motions without touching the display.

12. The multi-level command sensing apparatus of claim 10:

wherein the changes of light conditions comprise a sequence of brightened shadows detected on the display, and wherein the action performed by the user comprises a sequence of touches on the display.

13. The multi-level command sensing apparatus of claim 12:

wherein the sequence of brightened shadows is caused by reflected light and scattered light from an object touching the display.

14. The multi-level command sensing apparatus of claim 12, wherein the sequence of touches includes a sequence of low pressure touches predefined by the user.

15. The multi-level command sensing apparatus of claim 12, wherein the sequence of touches includes a sequence of high pressure touches predefined by the user.

16. The multi-level command sensing apparatus of claim 12, the controller is further configured to:

authenticate the user based on the sequence of touches on the display.

17. The multi-level command sensing apparatus of claim 16, wherein the controller is further configured to:

continuously authenticate the user during an access to security sensitive information using the multi-level command sensing apparatus; and

terminate the access to the security sensitive information in response to one or more mismatches found in the continuously authenticating process.

18. The multi-level command sensing apparatus of claim 10, the controller is further configured to:

compare the changes of light conditions on the display to a set of predefined changes of light conditions stored in a database of the multi-level command sensing apparatus; and

identify the action performed by the user corresponding to the changes of light conditions on the display in response to a match being found in the set of predefined changes of light conditions.