Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device

• US 10,282,155 B2
• Filed: 05/16/2016
• Issued: 05/07/2019
• Est. Priority Date: 01/26/2012
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Alberth, Jr., William P, Alameh, Rachid Mohsen, Dickinson, Timothy A., Zurek, Robert A.
• Primary Examiner(s): Tsang, Fan S
• Assistant Examiner(s): Siegel, David
• Application Number:
  US15/156,247
• Publication Number:
  US 20160259610A1
• Time in Patent Office: 1,086 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L

Abstract

A portable electronic device includes a processor and a detection mechanism operable to detect one or more characteristics relating to how a user handles the electronic device. The processor is operably coupled to the detection mechanism and operable in accordance with stored operating instructions to: determine, based on the detected characteristics, which limb of the user possesses the portable electronic device; and control at least one function of the portable electronic device taking into account which limb of the user possesses the electronic device (e.g., which limb of the user is holding or secured to the electronic device). According to one embodiment, the processor may further determine a reference position for the portable electronic device (e.g., a position of the device at rest) and compare one or more of the detected characteristics to the reference position to determine which limb of the user possesses the electronic device.

Claims

1. A portable electronic device comprising:

a detection mechanism operable to detect one or more characteristics relating to how a user handles the portable electronic device; and

a processor operably coupled to the detection mechanism and operable in accordance with stored operating instructions to;

determine a reference position from one or more positions of the portable electronic device, wherein the portable electronic device in the reference position is at rest and possessed by at least one limb of the user;

determine, based on a comparison of the reference position to at least one of the one or more characteristics detected by the detection mechanism based on an updated position of the portable electronic device that is different than the reference position, a particular limb of the user that possesses the portable electronic device;

responsive to determining the particular limb of the user that possesses the portable electronic device, determine, based on the at least one of the one or more characteristics, a positioning of the portable electronic device on the particular limb of the user that possesses the portable electronic device, wherein the positioning comprises at least one of a location or an orientation of the portable electronic device on the particular limb; and

control, based on the particular limb of the user that possesses the portable electronic device and further based on the positioning of the portable electronic device on the particular limb, at least one function of the portable electronic device.

2. The portable electronic device of claim 1, wherein the detection mechanism includes at least one of a camera, an optical sensor, an ultrasonic sensor, an accelerometer, or a gyroscope.

3. The portable electronic device of claim 1, further comprising:

a display operably coupled to the processor; and

a user interface operably coupled to the processor,

wherein the processor is further operable to;

output, for display, at least one of textual messages or images; and

after outputting the at least one of the textual messages or the images, determine the reference position for the portable electronic device further based on inputs received via the user interface.

4. The portable electronic device of claim 1, further comprising:

an audio output device coupled to the processor,

wherein the at least one function of the portable electronic device controlled by the processor includes a direction of audio outputted by the audio output device, and

wherein the processor is further operable to control the audio output device to output the audio toward an expected head location of the user based on the particular limb of the user that possesses the portable electronic device.

5. The portable electronic device of claim 1, further comprising:

an audio input device coupled to the processor,

wherein the at least one function of the portable electronic device controlled by the processor includes a direction from which audio is received by the audio input device, and

wherein the processor is further operable to control the audio input device to detect audio from an expected head location of the user based on the particular limb of the user that possesses the portable electronic device.

6. The portable electronic device of claim 1, further comprising:

a display coupled to the processor,

wherein the at least one function of the portable electronic device controlled by the processor includes arrangement of information displayed on the display, and

wherein the processor is further operable to control the display to arrange the displayed information based on the particular limb of the user that possesses the portable electronic device.

7. The portable electronic device of claim 1, further comprising:

a user interface coupled to the processor,

wherein the at least one function of the portable electronic device controlled by the processor includes a configuration of the user interface, and

wherein the processor is further operable to control the configuration of the user interface based on the particular limb of the user that possesses the portable electronic device.

8. The portable electronic device of claim 1, wherein the processor operable to determine the reference position for the portable electronic device is further operable to:

determine the reference position further based on at least one of;

an activation, at the portable electronic device, of a limb detection feature that determines the particular limb of the user that possesses the portable electronic device, or

general use of the portable electronic device by the user that is not part of an initial start-up of the portable electronic device.

9. The portable electronic device of claim 1, wherein the processor operable to determine the reference position for the portable electronic device is further operable to:

determine, in response to receiving at least one user input, and based on at least one output of the detection mechanism, at least one of;

an orientation of the portable electronic device when the at least one user input was received, or

a position of the portable electronic device relative to a user of the portable electronic device when the at least one user input was received; and

determine the reference position for the portable electronic device further based on at least one of the orientation of the portable electronic device or the position of the portable electronic device relative to the user of the portable electronic device.

10. The portable electronic device of claim 1, wherein the processor is further operable to:

determine whether detected movement along at least one of three axes in a three-dimensional space is in a positive direction or a negative direction relative to the reference position, the detected movement corresponding to the one or more characteristics, and

wherein the processor operable to determine which limb of the user possesses the portable electronic device is further operable to determine the particular limb of the user that possesses the portable electronic device based on whether the detected movement along the at least one of the three axes in the three-dimensional space is in the positive direction or the negative direction relative to the reference position.

11. The portable electronic device of claim 1, further comprising:

a memory operable to store detected characteristics of a previous use of the portable electronic device by the user over a period of time to produce historical characteristics that indicate which limb of a plurality of limbs of the user previously possessed the portable electronic device, and

wherein the processor, operable in accordance with stored operating instructions to determine the particular limb of the user that possesses the portable electronic device, is further operable to determine, based on the historical characteristics, the particular limb of the user that possesses the portable electronic device.

12. A method comprising:

detecting, by a portable electronic device, one or more characteristics relating to how a user handles the portable electronic device;

determining a reference position from one or more positions of the portable electronic device, wherein the portable electronic device in the reference position is at rest and possessed by at least one limb of the user;

determining, by the portable electronic device based on a comparison of the reference position to at least one of the one or more characteristics detected by the portable electronic device based on an updated position of the portable electronic device that is different than the reference position, a particular limb of the user that possesses the portable electronic device;

responsive to determining the particular limb of the user that possesses the portable electronic device, determining, based on the at least one of the one or more characteristics, a positioning of the portable electronic device on the particular limb of the user that possesses the portable electronic device, wherein the positioning comprises at least one of a location or an orientation of the portable electronic device on the particular limb; and

controlling, by the portable electronic device, based on the particular limb of the user that possesses the portable electronic device and further based on the positioning of the portable electronic device on the particular limb, at least one function of the portable electronic device.

13. The method of claim 12, further comprising:

storing the one or more characteristics over a period of time to produce historical characteristics,

wherein determining the particular limb of the user that possesses the portable electronic device is based on the historical characteristics.

14. The method of claim 12, wherein determining the reference position for the portable electronic device further comprises:

outputting, by the portable electronic device and for display, at least one of textual messages or images;

after outputting the at least one of the textual messages or the images, receiving, by the portable electronic device, inputs from the user; and

determining the reference position for the portable electronic device further based on the inputs received from the user.