Rolling gesture detection using an electronic device

• US 8,907,893 B2
• Filed: 10/29/2013
• Issued: 12/09/2014
• Est. Priority Date: 01/06/2010
• Status: Active Grant

• Current Assignee: Sensor Platforms, Incorporated (Knowles Corporation)
• Original Assignee: Sensor Platforms, Incorporated (Knowles Corporation)
• Inventors: Shaw, Kevin A., Chen, Ian, Joseph, Benjamin E.
• Primary Examiner(s): Bolotin, Dmitriy
• Application Number:
  US14/066,578
• Publication Number:
  US 20140055351A1
• Time in Patent Office: 406 Days
• Field of Search: 345156-167
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/4221 Dedicated function buttons, e.g. for the control of an EPG, subtitles, aspect ratio, picture-in-picture or teletext
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

An electronic device with one or more processors and memory detects a button press of a respective button of a plurality of buttons that include a first button that corresponds to a first type of operation and a second button that corresponds to a second type of operation. The device determines, in conjunction with detecting the button press, a rolling gesture metric corresponding to performance of a rolling gesture comprising rotation about a longitudinal axis of the electronic device. After determining the rolling gesture metric, when the respective button is the first button, the device initiates performance, in a respective user interface, of an operation of the first type in accordance with the rolling gesture metric and when the respective button is the second button, the device initiates performance, in the respective user interface, of an operation of the second type in accordance with the rolling gesture metric.

Claims

1. A method, comprising:

at an electronic device that includes one or more processors and memory storing one or more programs, the one or more processors executing the one or more programs to perform the operations of;

detecting a button press of a respective button of a plurality of buttons that are associated with different operations, wherein the plurality of buttons include a first button that corresponds to a first type of operation and a second button that corresponds to a second type of operation;

determining, in conjunction with detecting the button press of the respective button, a rolling gesture metric corresponding to performance of a rolling gesture comprising rotation of the electronic device about a longitudinal axis of the electronic device; and

after determining the rolling gesture metric;

in accordance with a determination that the respective button is the first button, initiating performance, in a respective user interface, of an operation of the first type in accordance with the rolling gesture metric; and

in accordance with a determination that the respective button is the second button, initiating performance, in the respective user interface, of an operation of the second type in accordance with the rolling gesture metric, wherein the operation of the second type comprises adjusting a presentation control parameter of the respective user interface without displaying a corresponding control object for the presentation control parameter in the respective user interface, and wherein the presentation control parameter of the respective user interface controls an audio or visual output characteristic for content to be presented via the respective user interface.

2. The method of claim 1, wherein the first button and the second button are physical buttons.

3. The method of claim 1, where initiating performance of an operation of a respective type that is associated with a respective setting includes:

determining a direction of rotation of the electronic device about the longitudinal axis;

in accordance with a determination that the rotation is in the clockwise direction, changing the setting in a first direction; and

in accordance with a determination that the rotation is in the counterclockwise direction, changing the setting in a second direction that is different from the first direction.

4. The method of claim 1, wherein the first button is selected from the group consisting of:

a volume button corresponding to a volume change operation;

a channel button corresponding to a channel change operation;

a video input button corresponding to a video input change operation;

an audio input button corresponding to an audio input change operation; and

a gesture button.

5. The method of claim 1, wherein:

the respective user interface does not include a user interface object associated with the first type of operation; and

the respective user interface does not include a user interface object associated with the second type of operation.

6. The method of claim 1, wherein the rolling gesture metric corresponds to a change in attitude of the electronic device after detecting the button press of the first button.

7. The method of claim 1, wherein the rolling gesture metric is selected from the group consisting of:

a roll angle;

a roll rate; and

a roll acceleration.

8. The method of claim 1, wherein determining the corresponding rolling gesture metric comprises:

calculating a change in attitude of the electronic device, corresponding to rotation about the longitudinal axis of the electronic device, based on one or more accelerometer measurements from one or more multi-dimensional accelerometers of the electronic device and one or more magnetic field measurements from one or more multi-dimensional magnetometers of the electronic device; and

calculating the rolling gesture metric based on the change in attitude of the electronic device.

9. The method of claim 1, wherein determining the corresponding rolling gesture metric comprises:

calculating a change in attitude of the electronic device based on one or more accelerometer measurements from one or more multi-dimensional accelerometers of the electronic device and one or more magnetic field measurements from one or more multi-dimensional magnetometers of the electronic device;

determining that the electronic device is undergoing a rotation about the longitudinal axis of the electronic device based on the change in attitude of the electronic device; and

calculating the rolling gesture metric based on the change in attitude of the electronic device.

10. The method of claim 1, wherein the first type of operation corresponding to the first button is a scrolling operation that is performed on an object in the respective user interface.

11. The method of claim 10, wherein the object is selected from the group consisting of:

a web page;

a document; and

a list.

12. The method of claim 1, wherein the first type of operation corresponding to the first button is a rotation operation that is performed on an object in the respective user interface.

13. The method of claim 12, wherein the object is selected from the group consisting of:

a dial;

a photograph; and

a page of a document.

14. A system for detecting performance of a rolling gesture using an electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions to;

detect a button press of a respective button of a plurality of buttons that are associated with different operations, wherein the plurality of buttons include a first button that corresponds to a first type of operation and a second button that corresponds to a second type of operation;

determine, in conjunction with detecting the button press of the respective button, a rolling gesture metric corresponding to performance of a rolling gesture comprising rotation of the electronic device about a longitudinal axis of the electronic device; and

after determining the rolling gesture metric;

in accordance with a determination that the respective button is the first button, initiate performance, in a respective user interface, of an operation of the first type in accordance with the rolling gesture metric; and

in accordance with a determination that the respective button is the second button, initiate performance, in the respective user interface, of an operation of the second type in accordance with the rolling gesture metric, wherein the operation of the second type comprises adjusting a presentation control parameter of the respective user interface without displaying a corresponding control object for the presentation control parameter in the respective user interface, and wherein the presentation control parameter of the respective user interface controls an audio or visual output characteristic for content to be presented via the respective user interface.

15. The system of claim 14, wherein the first button and the second button are physical buttons.

16. The system of claim 14, where initiating performance of an operation of a respective type that is associated with a respective setting includes:

determining a direction of rotation of the electronic device about the longitudinal axis;

in accordance with a determination that the rotation is in the clockwise direction, changing the setting in a first direction; and

in accordance with a determination that the rotation is in the counterclockwise direction, changing the setting in a second direction that is different from the first direction.

17. The system of claim 14, wherein the first button is selected from the group consisting of:

a volume button corresponding to a volume change operation;

a channel button corresponding to a channel change operation;

a video input button corresponding to a video input change operation;

an audio input button corresponding to an audio input change operation; and

a gesture button.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by an electronic device, cause the device to perform:

detecting a button press of a respective button of a plurality of buttons that are associated with different operations, wherein the plurality of buttons include a first button that corresponds to a first type of operation and a second button that corresponds to a second type of operation;

determining, in conjunction with detecting the button press of the respective button, a rolling gesture metric corresponding to performance of a rolling gesture comprising rotation of the electronic device about a longitudinal axis of the electronic device; and

after determining the rolling gesture metric;

in accordance with a determination that the respective button is the first button, initiating performance, in a respective user interface, of an operation of the first type in accordance with the rolling gesture metric; and

in accordance with a determination that the respective button is the second button, initiating performance, in the respective user interface, of an operation of the second type in accordance with the rolling gesture metric, wherein the operation of the second type comprises adjusting a presentation control parameter of the respective user interface without displaying a corresponding control object for the presentation control parameter in the respective user interface, and wherein the presentation control parameter of the respective user interface controls an audio or visual output characteristic for content to be presented via the respective user interface.

19. The non-transitory computer readable storage medium of claim 18, wherein the first button and the second button are physical buttons.

20. The non-transitory computer readable storage medium of claim 18, where initiating performance of an operation of a respective type that is associated with a respective setting includes:

determining a direction of rotation of the electronic device about the longitudinal axis;

in accordance with a determination that the rotation is in the clockwise direction, changing the setting in a first direction; and

in accordance with a determination that the rotation is in the counterclockwise direction, changing the setting in a second direction that is different from the first direction.

21. The non-transitory computer readable storage medium of claim 18, wherein the first button is selected from the group consisting of:

a volume button corresponding to a volume change operation;

a channel button corresponding to a channel change operation;

a video input button corresponding to a video input change operation;

an audio input button corresponding to an audio input change operation; and

a gesture button.