Supplementing a touch input mechanism with fingerprint detection

• US 10,198,109 B2
• Filed: 11/23/2015
• Issued: 02/05/2019
• Est. Priority Date: 12/17/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hinckley, Kenneth P., Pahud, Michel
• Primary Examiner(s): Nguyen, Jennifer T
• Application Number:
  US14/948,388
• Publication Number:
  US 20160283021A1
• Time in Patent Office: 1,170 Days
• Field of Search: 345173-178
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06V 40/1347 Preprocessing; Feature extraction

Abstract

A device and related methods, including a display and a display surface, are provided. The device includes logic configured to detect touch events received via the display surface. The display is coupled to a remote computing functionality that is configured to store shared work space information in a data store associated with the remote computing functionality to support collaborative tasks performed by participants in an interaction session. The device further includes logic configured to receive touch events and interpret the touch events as a request to drag an object, select a menu option, or display a web page. The device further includes logic configured to receive requests, not via the display surface of the display, but from user devices different from the display. Such requests can include requests to display an object on the display surface or execute an application.

Claims

1. A method comprising:

receiving a first touch event from a first participant and a second touch event from a second participant via a display surface of the display, wherein the display is coupled to a remote computing functionality via a network and wherein the remote computing functionality is configured to store shared work space information in a data store associated with the remote computing functionality to support collaborative tasks performed by participants in an interaction session, and wherein the display is configured to download applications provided by the remote computing functionality;

interpreting the first touch event from the first participant in the interaction session as a request to drag a first object displayed on the display surface and in response to the request, associating the first object with the first participant using logic associated with the display surface;

interpreting the second touch event from the second participant in the interaction session as a request to select a menu option displayed on the display surface and in response to the request generating at least one touch event using the logic associated with the display surface;

interpreting a third touch event from a third participant in the interaction session as a request to display a web page on the display surface and displaying the web page on the display surface using the logic associated with the display surface;

receiving a first request from a fourth participant in the interaction session, not via the display surface of the display, but from a user device, different from the display, associated with the fourth participant and in response to the request displaying a second object on the display surface using the logic associated with the display surface, wherein the second object is associated with user content located in the data store associated with the remote computing functionality;

receiving a second request from a fifth participant in the interaction session, not via the display surface of the display, but from a user device, different from the display, associated with the fifth participant and in response to the request executing an application on the display surface using the logic associated with the display surface; and

storing information related to the interaction session in the data store associated with the remote computing functionality to support any collaborative tasks performed by participants in the interaction session.

2. The method of claim 1, wherein the remote computing functionality is coupled to the display via at least one network.

3. The method of claim 1, wherein the remote computing functionality is implemented using at least one server computer.

4. The method of claim 1, wherein:

associating the first object with the first participant includes storing an indication of the association in conjunction with the first object.

5. The method of claim 4 further comprising:

retrieving the first object in response to receipt of a touch of a finger by the first participant, at a temporal time that is later than the storing of the indication of the association in conjunction with the first object.

6. The method of claim 5, wherein:

the retrieving the first object includes retrieving the first object in response to receipt of a touch of the finger by the first participant on a second display surface, that is different from the display surface, at a temporal time that is later than the storing of the indication of the association in conjunction with the first object.

7. A device comprising:

a display having a display surface;

logic configured to detect touch events received via the display surface;

logic configured to receive a first touch event from a first participant and a second touch event from a second participant via the display surface, wherein the display is coupled to a remote computing functionality via a network and wherein the remote computing functionality is configured to store shared work space information in a data store associated with the remote computing functionality to support collaborative tasks performed by participants in an interaction session, and wherein the logic is configured to download applications provided by the remote computing functionality;

logic configured to interpret the first touch event from the first participant in the interaction session as a request to drag a first object displayed on the display surface and in response to the request associate the first object with the first participant;

logic configured to interpret the second touch event from the second participant in the interaction session as a request to select a menu option displayed on the display surface and in response to the request generate at least one touch event;

logic configured to interpret a third touch event from a third participant in the interaction session as a request to display a web page on the display surface and display the web page on the display surface;

logic configured to receive a first request from a fourth participant in the interaction session, not via the display surface of the display, but from a user device, different from the display, associated with the fourth participant and in response to the request display a second object on the display surface, wherein the second object is associated with user content located in the data store associated with the remote computing functionality;

logic configured to receive a second request from a fifth participant in the interaction session, not via the display surface of the display, but from a user device, different from the display, associated with the fifth participant and in response to the request execute an application on the display surface; and

logic configured to store information related to the interaction session in the data store associated with the remote computing functionality to support any collaborative tasks performed by participants in the interaction session.

8. The device of claim 7, wherein the remote computing functionality is coupled to the display via at least one network.

9. The device of claim 7 further comprising logic configured to, by analyzing the first fingerprint information, determine a posture of the first recognized participant.

10. The device of claim 7, wherein:

the logic configured to associate the first object with the first participant includes logic configured to store an indication of the association in conjunction with the first object.

11. The device of claim 10 further comprising:

logic configured to retrieve the first object in response to receipt of a touch of a finger by the first participant, at a temporal time that is later than storing of the indication of the association in conjunction with the first object.

12. The device of claim 11, wherein:

the logic configured to retrieve the first object includes logic configured to retrieve the first object in response to receipt of a touch of the finger by the first participant on a second display surface, that is different from the display surface, at a temporal time that is later than the storing of the indication of the association in conjunction with the first object.

13. A device comprising:

a display having a display surface;

logic configured to detect touch events received via the display surface;

logic configured to receive a first touch event from a first participant and a second touch event from a second participant via the display surface, wherein the display is coupled to a remote computing functionality via a network and wherein the remote computing functionality is configured to store shared work space information in a data store associated with the remote computing functionality to support collaborative tasks performed by participants in an interaction session, and wherein the logic is configured to download applications provided by the remote computing functionality;

logic configured to interpret the first touch event using fingerprint information based on any first fingerprint information present in the first touch event, and using at least the first fingerprint information to recognize the first participant as a first recognized participant;

logic configured to interpret the second touch event using fingerprint information based on any second fingerprint information present in the second touch event, and using at least the second fingerprint information to recognize the second participant as a second recognized participant, wherein the second fingerprint information is different from the first fingerprint information;

logic configured to determine a first location of the first recognized participant based on a first region of the display surface corresponding to the first touch event and determine a second location of the second recognized participant based on a second region of the display surface corresponding to the second touch event, and present a first object in spatial proximity to the first recognized participant based on the first location and present a second object in spatial proximity to the second recognized participant based on the second location;

logic configured to interpret a third touch event from a third participant in the interaction session as a request to display a web page on the display surface and display the web page on the display surface;

logic configured to receive a first request from a fourth participant in the interaction session, not via the display surface of the display, but from a user device, different from the display, associated with the fourth participant and in response to the request display a third object on the display surface, wherein the third object is associated with user content located in the data store associated with the remote computing functionality;

logic configured to receive a second request from a fifth participant in the interaction session, not via the display surface of the display, but from a user device, different from the display, associated with the fifth participant and in response to the request execute an application on the display surface; and

logic configured to store information related to the interaction session in the data store associated with the remote computing functionality to support any collaborative tasks performed by participants in the interaction session.

14. The device of claim 13 further comprising:

logic configured to, by analyzing the first fingerprint information, determine a posture of the first recognized participant; and

logic configured to execute a command based on whether the first touch event corresponds to an index finger, a middle finger, or a ring finger of the first recognized participant.

15. The device of claim 13 further comprising:

logic configured to receive a first input indicating a user initiated drag of the first object on the display surface; and

logic configured to associate the first object with the first recognized participant, wherein the logic configured to associate the first object with the first recognized participant includes logic configured to store an indication of the association in conjunction with the first object.

16. The device of claim 15 further comprising:

logic configured to retrieve the first object in response to receipt of a touch of a finger by the first recognized participant, at a temporal time that is later than storing of the indication of the association in conjunction with the first object.