COMBINED GRIP AND MOBILITY SENSING

• US 20170115782A1
• Filed: 10/23/2015
• Published: 04/27/2017
• Est. Priority Date: 10/23/2015
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hinckley, Kenneth P., Benko, Hrvoje, Pahud, Michel, Yoon, Dongwook
• Application Number:
  US14/922,033
• Publication Number:
  US 20170115782A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof

Abstract

By correlating user grip information with micro-mobility events, electronic devices can provide support for a broad range of interactions and contextually-dependent techniques. Such correlation allows electronic devices to better identify device usage contexts, and in turn provide a more responsive and helpful user experience, especially in the context of reading and task performance. To allow for accurate and efficient device usage context identification, a model may be used to make device usage context determinations based on the correlated gesture and micro-mobility data. Once a context, device usage context, or gesture is identified, an action can be taken on one or more electronic devices.

Claims

1. A computing system, comprising:

at least one processing unit; and

memory configured to be in communication with the at least one processing unit, the memory storing instructions that based on execution by the at least one processing unit, cause the at least one processing unit to;

receive sensor data from at least one electronic device;

determine, based at least partly on the sensor data, a hand grip placement associated with the at least one electronic device;

determine, based at least partly on the sensor data, a motion associated with the at least one electronic device;

determine, based at least partly on the hand grip placement and the motion, a usage context of the at least one electronic device; and

cause an action to be performed based on the usage context of the at least one electronic device.

2. The computing system of claim 1, wherein the hand grip placement and the motion are each associated with a first electronic device of the at least one electronic device.

3. The computing system of claim 2, wherein the action is caused to be performed on a second electronic device of the at least one electronic device.

4. The computing system of claim 1, wherein the hand grip placement is a first hand grip placement associated with a first user, wherein the first hand grip placement is associated with a first electronic device, and wherein the instructions further cause the at least one processing unit to determine, based at least partly on the sensor data, a second hand grip placement associated with the first electronic device, wherein the second hand grip placement is associated with a second user.

5. The computing system of claim 4, wherein the instructions further cause the at least one processing unit to determine the usage context based at least further on the second hand grip placement.

6. The computing system of claim 1, wherein the instructions further cause the at least one processing unit to:

determine a type of hand grip placement; and

determine the usage context based at least further on the type of hand grip placement.

7. The computing system of claim 1 wherein the instructions further cause the at least one processing unit to determine an identity of a user associated with the hand grip placement, and wherein determining the usage context of the at least one electronic device is further based at least partly on the identity of the user.

8. The computing system of claim 1 wherein the usage context of the at least one electronic device comprises a selection of a portion of content displayed on a first electronic device, and wherein the action comprises causing the portion of content to be displayed on a second electronic device.

9. The computing system of claim 1 wherein the at least one electronic device is part of the computing system.

10. A method comprising:

receiving sensor data;

determining, based at least partly on the sensor data, a hand grip placement associated with at least one electronic device;

determining, based at least partly on the sensor data, a motion associated with the at least one electronic device;

determining, based at least partly on the hand grip placement and the motion, a usage context of the at least one electronic device; and

causing an action to be performed based on the usage context of the at least one electronic device.

11. The method of claim 10, wherein the hand grip placement and the motion are each associated with a first electronic device of the at least one electronic device.

12. The method of claim 11, wherein the action is caused to be performed on a second electronic device of the at least one electronic device.

13. The method of claim 10, wherein:

the hand grip placement is a first hand grip placement associated with a first user;

the first hand grip placement is associated with a first electronic device; and

the method further comprises determining, based at least partly on the sensor data, a second hand grip placement associated with the first electronic device, wherein the second hand grip placement is associated with a second user.

14. The method of claim 13, wherein the action comprises initiating one of a multi-user mode or guest mode on the first electronic device based at least partly on the second hand grip placement.

15. The method of claim 10, wherein determining the hand grip placement further comprises determining a type of hand grip placement, and wherein the usage context is determined based at least further on the type of hand grip placement.

16. The method of claim 10, wherein determining the hand grip placement further comprises determining an identity of a user associated with the hand grip placement, and wherein determining the usage context of the at least one electronic device is further based at least partly on user information associated with the identity of the user.

17. The method of claim 10, wherein the usage context of the at least one electronic device comprises a collaborative task performance by two or more users, and wherein the action comprises causing the at least one electronic device to operate in a one of a guest mode or a collaboration mode.

18. An electronic device comprising,

at least one processing unit;

sensing hardware; and

memory configured to be in communication with at least one processing unit, the memory storing instructions that in accordance with execution by the at least one processing unit, cause the at least one processing unit to;

receive sensor data indicating signals received from the sensing hardware;

determine, based at least partly on the sensor data, a hand grip placement associated with the electronic device;

determine, based at least partly on the sensor data, a motion associated with the electronic device;

determine, based at least partly on the hand grip placement and the motion, an interaction state of the electronic device; and

cause an action to be performed on the electronic device based on the interaction state of the electronic device.

19. The electronic device of claim 18, wherein the action includes causing another action to be performed on a second electronic device.

20. The electronic device of claim 18, wherein the interaction state of the electronic device indicates that a user of the electronic device is reading content, and wherein the action comprises changing a graphical user interface displayed on the electronic device to remove other content.