Multi-hand interface method

• US 10,515,282 B1
• Filed: 04/05/2018
• Issued: 12/24/2019
• Est. Priority Date: 04/05/2018
• Status: Active Grant

• Current Assignee: Government of the United States of America
• Original Assignee: the united states of america as represented by the secretary of the navy
• Inventors: Rowland, Raymond J, Puterio, Matthew C, Gilchrest, Matthew J, Kasischke, James M
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US15/945,800
• Time in Patent Office: 628 Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/117 Biometrics derived from hands
• CPC Class Codes: G06V 40/1306 non-optical, e.g. ultrasonic or capacitive sensing
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities

Abstract

A method for multi-user recognition for a multi-touch display is provided. The method identifies a user by using metrics from a hand touch on the display. A hand based menu system is provided on the display in response. Menu system can be oriented in accordance with the hand touch. Stored user preferences can be retrieved for the identified user. The display can recognize an additional hand from the same user or an additional user'"'"'s hand. These can be used to provide a collaborative display. Optionally additional metrics can be utilized for user identification.

Claims

1. A method for multi-user recognition for a multi-touch display joined to a processor comprising the steps of:

providing a multi-touch display joined to a processor;

providing a processor having a database with stored user data therein, the stored user data for each user comprising user hand metrics and other user data;

identifying a hand press on the multi-touch display;

generating hand metrics from the identified hand press wherein the generated hand metrics comprise multi-touch display location, hand orientation, hand configuration, and hand dimensions;

comparing generated hand dimensions with user hand metrics in the database to determine if the hand metrics match those in the database;

requesting further user identification if the hand metrics fail to match those in the database;

identifying the hand press as a hand press from a recognized user if the hand metrics match the hand metrics for the user in the database with a specified tolerance;

retrieving other user data from the database based on the recognized user;

identifying an additional hand press on the multi-touch display;

generating additional hand metrics from the identified additional hand press wherein additional hand metrics include additional multi-touch display location, additional hand orientation, additional hand configuration, and additional hand dimensions;

determining if the additional hand metrics indicate an additional user or an additional hand of the recognized user;

associating the additional hand press with the recognized user if the additional hand metrics indicate an additional hand of the recognized user;

comparing generated hand dimensions if the additional hand metrics indicate an additional user to determine if the additional hand metrics match those in the database;

requesting further user identification if the additional hand metrics fail to match those in the database;

identifying the additional hand press as a hand press from a recognized additional user if the additional hand metrics match the hand metrics in the database with a specified tolerance;

determining an additional user data record in the database based on the recognized additional user; and

retrieving other user data from the database based on the recognized additional user.

2. The method of claim 1 wherein the step of determining if the additional hand metrics indicate an additional user utilizes the additional hand configuration in concert with the recognized user hand configuration to determine if the additional hand press must be associated with an additional user.

3. The method of claim 1 wherein the step of determining if the additional hand metrics indicate an additional user utilizes the additional multi-touch display location in concert with the recognized user multi-touch display location to determine if the additional hand press must be associated with an additional user.

4. The method of claim 1 wherein the step of determining if the additional hand metrics indicate an additional user utilizes the additional hand orientation in concert with the recognized user hand orientation to determine if the additional hand press must be associated with an additional user.

5. The method of claim 1 wherein the step of determining if the additional hand metrics indicate an additional user comprises:

utilizing the additional hand configuration in concert with the recognized user hand configuration to determine if the additional hand press must be associated with an additional user;

utilizing the additional hand position in concert with the recognized user hand position to determine if the additional hand press is likely to be associated with an additional user;

utilizing the additional hand orientation in concert with the recognized user hand orientation to determine if the additional hand press is likely to be associated with an additional user; and

utilizing additional hand metrics in concert with stored user hand metrics to determine if the additional hand press is likely to be associated with an additional user after the steps of utilizing the additional hand configuration, utilizing the additional hand position and utilizing the additional hand orientation.

6. The method of claim 1 wherein the step of determining if the additional hand metrics indicate an additional user or an additional hand indicates an additional hand of the recognized user when the additional multi-touch display location is within a predetermined distance from the multi-touch display location of the recognized user hand press.

7. The method of claim 1 further comprising maintaining the additional hand press association with the recognized user as the additional multi-touch display location is dragged on the multi-touch display.

8. The method of claim 1 further comprising the steps of maintaining the association between the additional hand press and the recognized user hand if the additional hand press is dragged on the multi-touch display to a multi-touch display location within a predetermined distance from the multi-touch display location of the recognized user hand press.

9. The method of claim 1 further comprising the steps of:

providing a biometric identification device joined to the processor to provide biometrics to the processor;

receiving biometrics from the biometric identification device; and

comparing biometrics with biometric information stored in the database wherein said step of requesting further user identification is executed if the hand metrics fail to match the hand metrics in the database, the biometrics fail to match biometric information in the database, or if both the hand metrics and biometrics fail to match the metrics in the database.

10. The method of claim 9 wherein the biometric identification device is a camera joined to the processor and the biometrics are facial features.

11. The method of claim 9 wherein the biometric identification device is a fingerprint reader joined to the processor and the biometrics are fingerprint features.

12. The method of claim 11 wherein the fingerprint reader is a region of the multi-touch display.

13. The method of claim 9 wherein the biometric identification device is a microphone joined to the processor and the biometrics are voice features.

14. The method of claim 1 further comprising the steps of:

providing a non-biometric user identification device joined to the processor;

receiving non-biometric user identification data from the non-biometric user identification device;

comparing non-biometric user identification data with other user data; and

utilizing the non-biometric user identification data in the step of identifying the hand press as a hand press from a recognized user.

15. The method of claim 14 wherein the non-biometric user identification device is a card reader.

16. The method of claim 14 wherein the non-biometric user identification device is a pass code reader.