Personalized operation of a mobile device using acoustic and non-acoustic information

• US 9,772,815 B1
• Filed: 11/14/2014
• Issued: 09/26/2017
• Est. Priority Date: 11/14/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Knowles Electronics Llc (Knowles Corporation)
• Inventors: Medina, Eitan Asher
• Primary Examiner(s): Dragoescu, Claudia
• Application Number:
  US14/542,327
• Time in Patent Office: 1,047 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Systems and methods for performing personalized operations of a mobile device are provided. An example method includes determining a user-defined signature has been received. The user-defined signature can include a combination of an acoustic input and non-acoustic input. The method can further include performing, in response to the determination, operations of the mobile device, the operations being associated with the user-defined signature. Exemplary acoustic input includes a voice sound with at least one spoken keyword. The spoken keyword is used to identify the operations. Exemplary non-acoustic input includes motions of the mobile device detected by an accelerometer, a gyroscope, and a magnetometer. Exemplary motions include vibrations of the mobile device, tapping the mobile device, rotations of the mobile device, movements of the mobile device as to draw a figure in a space.

Claims

1. A method for performing operations of a mobile device, the method comprising:

determining that a signature has been received, the signature being a combination of an acoustic input and a non-acoustic input, the non-acoustic input including at least vibrations due to being held by a hand, wherein the determining that the signature has been received comprises;

comparing the acoustic input to a user-defined acoustic input sample; and

comparing the non-acoustic input to a user-defined non-acoustic input sample;

in response to the determination, performing operations of the mobile device, the operations being associated with the signature;

training the mobile device to perform the operations, the training comprising;

presenting lists of one or more applications associated with the operations and one or more sensor types via a user interface of the mobile device;

receiving a selection of one or more applications and one or more sensor types from a user via the user interface;

recording acoustic data and non-acoustic sensor data based at least on the one or more sensor types selected by the user via the user interface; and

generating the signature based at least on the acoustic data and non-acoustic sensor data, the signature being a user-defined signature, the user-defined signature being a combination of the user-defined acoustic input sample and the user-defined non-acoustic input sample; and

associating the generated signature with the selection of one or more applications.

2. The method of claim 1, wherein the acoustic input includes a voice sound.

3. The method of claim 2, wherein the voice sound includes at least a spoken keyword, the spoken keyword being used to identify the operations.

4. The method of claim 2, wherein the acoustic sound is captured by at least one microphone of the mobile device.

5. The method of claim 1, wherein the non-acoustic input is detected by one or more sensors associated with mobile device, the sensors including one or more of the following:

an accelerometer, a gyroscope, a magnetometer, and a proximity sensor.

6. The method of claim 1, wherein the signature further includes a predetermined window of time between the acoustic input and non-acoustic input.

13. The method of claim 1, wherein determining that the signature has been received includes detecting a frequency of the vibrations.

16. The method of claim 1, wherein determining that the signature has been received further includes detecting a number of taps in a tapping of the mobile device.

7. A system for performing operations of a mobile device, the system comprising:

a processor; and

a memory communicatively coupled with the processor, the memory storing instructions which when executed by the processor performs a method comprising;

determining that a signature has been received, the signature being a combination of an acoustic input and non-acoustic input, the non-acoustic input including at least vibrations due to being held by a hand, wherein the determining that the signature has been received comprises;

comparing the acoustic input to a user-defined acoustic input sample; and

comparing the non-acoustic input to a user-defined non-acoustic input sample;

in response to determination, performing operations of the mobile device, the operations being associated with the signature;

training the mobile device to perform the operations, the training comprising;

presenting lists of one or more applications associated with the operations and one or more sensor types via a user interface of the mobile device;

receiving a selection of one or more applications and one or more sensor types from a user via the user interface;

recording acoustic data and non-acoustic sensor data based at least on the one or more sensor types selected by the user via the user interface; and

generating the signature based at least on the acoustic data and non-acoustic sensor data, the signature being a user-defined signature, the user-defined signature being a combination of the user-defined acoustic input sample and the user-defined non-acoustic input sample; and

associating the generated signature with the selection of one or more applications.

8. The system of claim 7, wherein the acoustic input includes a voice sound captured by at least one microphone of the mobile device.

9. The system of claim 8, wherein the voice sound includes at least one spoken keyword, the at least one spoken keyword being used to identify the operations.

10. The system of claim 7, wherein the non-acoustic input is detected by one or more of sensor associated with the mobile device, the one or more sensors including one or more of the following:

an accelerometer, a gyroscope, a magnetometer, and a proximity sensor.

11. The system, of claim 7, wherein the signature further includes a predetermined window of time between the acoustic input and non-acoustic input.

14. The system of claim 7, wherein determining that the signature has been received includes detecting a frequency of the vibrations.

12. A non-transitory computer-readable storage medium having embodied thereon instructions, which when executed by one or more processors, perform steps of a method, the method comprising:

determining that a signature has been received, the signature being a combination of an acoustic input and a non-acoustic input, the non-acoustic input including at least vibrations due to being held by a hand, wherein the determining that the signature has been received comprises;

comparing the acoustic input to a user-defined acoustic input sample; and

comparing the non-acoustic input to a user-defined non-acoustic input sample;

in response to the determination, performing operations of the mobile device, the operations being associated with the signature;

training the mobile device to perform the operations, the training comprising;

presenting lists of one or more applications associated with the operations and one or more sensor types via a user interface of the mobile device;

receiving a selection of one or more applications and one or more sensor types from a user via the user interface;

recording acoustic data and non-acoustic sensor data based at least on the one or more sensor types selected by the user via the user interface; and

generating the signature based at least on the acoustic data and non-acoustic sensor data, the signature being a user-defined signature, the user-defined signature being a combination of the user-defined acoustic input sample and the user-defined non-acoustic input sample; and

associating the generated signature with the selection of one or more applications.

15. The non-transitory computer-readable storage medium of claim 12, wherein determining that the user-defined signature has been received includes detecting a frequency of the vibrations.