Controlling power consumption of a mobile device based on gesture recognition

• US 9,086,875 B2
• Filed: 06/02/2010
• Issued: 07/21/2015
• Est. Priority Date: 06/05/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Harrat, Newfel, Sheynblat, Leonid
• Primary Examiner(s): Huynh, Kim
• Assistant Examiner(s): Chang, Eric
• Application Number:
  US12/792,600
• Publication Number:
  US 20100313050A1
• Time in Patent Office: 1,875 Days
• Field of Search: 713/323
• US Class Current: 1/1
• CPC Class Codes: G06F 1/3203 Power management, i.e. event-based initiation of a power-saving mode
• CPC Class Codes: G06F 1/3293 by switching to a less power-consuming processor, e.g. sub-CPU
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04W 52/0254 detecting a user operation or a tactile contact or a motion of the device
• CPC Class Codes: H04W 52/0293 having a sub-controller with a low clock frequency switching on and off a main controller with a high clock frequency
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

In an embodiment, a mobile device includes a sensor processor system, an application processor system and a power management controller that controls power being applied to the application processor system. The sensor processor system monitors sensors connected to the mobile device. The sensor processor system detects a pre-defined gestures and an environmental condition or event based on the monitoring. The pre-defined gesture corresponds to one or more actions initiated by a user of the mobile device (e.g., the user jogs with the mobile device, places the mobile device in his/her pocket or backpack, etc.). The sensor processor system selects a power profile to be applied to the application processor system based on the detection, and instructs the power management controller to apply the selected power profile to the application processor system.

Claims

1. A method of controlling power consumption of a mobile device, comprising:

monitoring, at a sensor processor system of the mobile device, one or more sensors connected to the mobile device, the sensor processor system configured for low-power operation;

detecting one of a plurality of pre-defined gestures and one or more environmental conditions or events based on the monitoring, wherein each of the plurality of pre-defined gestures corresponds to one or more actions initiated by a user of the mobile device;

loading to an application processor system, operating independently from the sensor processor system, one or more applications associated with respective power requirements, the one or more applications selected from a plurality of available applications based on the detected one of the plurality of pre-defined gestures;

selecting one of a plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications based on the detected one of the plurality of pre-defined gestures to enable the mobile device to consume power at a level approximating the respective power requirements for the selected one or more applications, and loading the selected one of the plurality of predetermined power profiles to a power management controller to control power to the application processor system, wherein the selected one of the plurality of predetermined power profiles establishes at least one of (1) a clock frequency at which an application processor of the application processor system is to operate or (2) a current or voltage at which the application processor of the application processor system is to operate; and

instructing the power management controller to apply the one of the plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications, selected based on the one of the plurality of pre-defined gestures detected by the independently operating sensor processor system, to the application processor system to control the power to the application processor system so as to support the respective power requirements of the one or more loaded applications selected based on the detected one of the plurality of pre-defined gestures.

2. The method of claim 1, wherein the monitoring is performed periodically by the sensor processor system.

3. The method of claim 1, wherein the one or more sensors include (a) a light sensor, (b) a pressure sensor, (c) a gyroscopic sensor, (d) an accelerometer, (e) a touch-screen proximity sensor, (f) a fingerprint sensor and/or (g) a haptic sensor.

4. The method of claim 1, wherein the one or more user-initiated actions includes (a) the user pressing a key or button of the mobile device, (b) the user walking or jogging with the mobile device, (c) the user picking up the mobile device from a surface or storage location, (d) the user placing the mobile device onto a surface or into a storage location, (e) a proximity of the user'"'"'s fingers being close to a display of the mobile device and/or (f) the user moving into an airplane with the mobile device.

5. The method of claim 1, wherein the one or more environmental conditions or events includes (a) an amount of light in proximity to the mobile device, (b) a temperature in proximity to the mobile device, (c) an acceleration of the mobile device, (d) a velocity of the mobile device, (e) an altitude of the mobile device and/or (f) identifying one or more wireless transmitters in range of the mobile device.

6. The method of claim 1, wherein the selected one of the plurality of predetermined power profiles establishes whether a modem subsystem configured to manage wireless communications to or from the mobile device is turned on or off.

7. The method of claim 1, wherein the mobile device corresponds to a wireless mobile device that includes a modem subsystem to manage wireless communications to or from the wireless mobile device.

8. The method of claim 1, further comprising:

selecting the one or more applications for execution by the application processor system based on the detecting,

wherein the instructing step further instructs the application processor system to load the one or more applications.

9. The method of claim 8, wherein the one or more applications includes an audio application and the selected one of the plurality of predetermined power profiles provides power for at least audio circuitry of the mobile device.

10. The method of claim 8, wherein the one or more applications includes a texting or email application and the selected one of the plurality of predetermined power profiles provides power for at least display circuitry of the mobile device.

11. The method of claim 8, wherein the one or more applications includes a wireless communications application and the selected one of the plurality of predetermined power profiles provides power for a modem subsystem of the mobile device.

12. The method of claim 8, wherein the selected one of the plurality of predetermined power profiles is configured to provide a level of power that approximates a level of power required to support the one or more applications.

13. The method of claim 1, further comprising:

at the power management controller, determining that the application processor system has transitioned to a different mode of operation associated with a different power profile from among the plurality of power profiles;

applying the different power profile to the application processor system.

14. The method of claim 13, wherein the different mode of operation is a sleep-mode and the different power profile is power profile associated with low-power requirements of the sleep-mode.

15. The method of claim 13, wherein the selected one of the plurality of predetermined power profiles is associated with a first active mode and the different mode of operation corresponds to a second active mode, the first and second active modes having different power requirements for the application processor system that are each higher than a sleep-mode power requirement for the application processor system.

16. The method of claim 1, wherein the power management controller is configured to selectively scale power consumption of specific hardware of the application processor system.

17. The method of claim 1, further comprising:

generating a new power profile by merging at least one of the plurality of power profiles with at least another of the plurality of power profiles.

18. The method of claim 1, further comprising:

in response to a determination that an application, from the selected one or more applications, has low-power requirements, loading the application to the sensor processor system, configured for low-power operation, so that the sensor processor system runs the application determined to have the low-power requirements and the application processor system runs at least one other of the one or more applications selected based on the detected one of the plurality of pre-defined gestures.

19. A mobile device, comprising:

an application processor system configured to execute at least one application;

a power management controller configured to control power consumption of the application processor system; and

a sensor processor system, configured for low-power operation, and further configured to;

monitor one or more sensors coupled to the mobile device,

detect one of a plurality of pre-defined gestures and one or more environmental conditions or events based on the monitoring, wherein each of the plurality of pre-defined gestures corresponds to one or more actions initiated by a user of the mobile device,

cause loading to the application processor system, operating independently from the sensor processor system, one or more applications associated with respective power requirements, the one or more applications selected from a plurality of available applications based on the detected one of the plurality of pre-defined gestures,

select one of a plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications based on the detected one of the plurality of pre-defined gestures to enable the mobile device to consume power at a level approximating the respective power requirements for the selected one or more applications, and cause loading of the selected one of the plurality of predetermined power profiles to a power management controller to control power to the application processor system, wherein the selected one of the plurality of predetermined power profiles is configured to establish at least one of (1) a clock frequency at which an application processor of the application processor system is to operate or (2) a current or voltage at which the application processor of the application processor system is to operate, and

instruct the power management controller to apply the one of the plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications, selected based on the one of the plurality of pre-defined gestures detected by the independently operating sensor processor system, to the application processor system to control power to the application processor system so as to support the respective power requirements of the one or more loaded applications selected based on the detected one of the plurality of pre-defined gestures.

20. The mobile device of claim 19, wherein the sensor processor system is configured to monitor the one or more sensors on a periodic basis.

21. The mobile device of claim 19, wherein the sensor processor system is configured to continue to monitor the one or more sensors when the application processor system transitions to a sleep-state.

22. The mobile device of claim 19, wherein the one or more sensors include (a) a light sensor, (b) a pressure sensor, (c) a gyroscopic sensor, (d) an accelerometer, (e) a touch-screen proximity sensor, (f) a fingerprint sensor and/or (g) a haptic sensor.

23. The mobile device of claim 19, wherein the one or more user-initiated actions includes (a) the user pressing a key or button of the mobile device, (b) the user walking or jogging with the mobile device, (c) the user picking up the mobile device from a surface or storage location, (d) the user placing the mobile device onto a surface or into a storage location, (e) a proximity of the user'"'"'s fingers being close to a display of the mobile device and/or (f) the user moving into an airplane with the mobile device.

24. The mobile device of claim 19, wherein the one or more environmental conditions or events includes (a) an amount of light in proximity to the mobile device, (b) a temperature in proximity to the mobile device, (c) an acceleration of the mobile device, (d) a velocity of the mobile device, (e) an altitude of the mobile device and/or (f) identifying one or more wireless transmitters in range of the mobile device.

25. The mobile device of claim 19, wherein the selected one of the plurality of predetermined power profiles is configured to establish whether a modem subsystem configured to manage wireless communications to or from the mobile device is turned on or off.

26. The mobile device of claim 19, wherein the mobile device corresponds to a wireless mobile device that includes a modem subsystem to manage wireless communications to or from the wireless mobile device.

27. The mobile device of claim 19, wherein the sensor processor system is configured to select the one or more applications for execution by the application processor system based on the detection,

wherein the sensor processor system is further configured to instruct the application processor system to load the one or more applications.

28. The mobile device of claim 27, wherein the one or more applications includes an audio application and the selected one of the plurality of predetermined power profiles provides power for audio circuitry of the mobile device.

29. The mobile device of claim 27, wherein the one or more applications includes a texting or email application and the selected one of the plurality of predetermined power profiles provides power for display circuitry of the mobile device.

30. The mobile device of claim 27, wherein the one or more applications includes a wireless communications application and the selected one of the plurality of predetermined power profiles provides power for a modem subsystem of the mobile device.

31. The mobile device of claim 27, wherein the selected one of the plurality of predetermined power profiles is configured to provide a level of power that approximates a level of power required to support the one or more applications.

32. The mobile device of claim 19, wherein the power management controller is configured to determine that the application processor system has transitioned to a different mode of operation associated with a different power profile from among the plurality of power profiles, and to apply the different power profile to the application processor system.

33. The mobile device of claim 32, wherein the different mode of operation is a sleep-mode and the different power profile is power profile associated with low-power requirements of the sleep-mode.

34. The mobile device of claim 33, wherein the selected one of the plurality of predetermined power profiles is associated with a first active mode and the different mode of operation corresponds to a second active mode, the first and second active modes having different power requirements for the application processor system that are each higher than a sleep-mode power requirement for the application processor system.

35. A mobile device, comprising:

means for monitoring, at a sensor processor system of the mobile device, one or more sensors connected to the mobile device, the sensor processor system configured for low-power operation;

means for detecting one of a plurality of pre-defined gestures and one or more environmental conditions or events based on the monitoring, wherein each of the plurality of pre-defined gestures corresponds to one or more actions initiated by a user of the mobile device;

means for loading to an application processor system, operating independently from the sensor processor system, one or more applications associated with respective power requirements, the one or more applications selected from a plurality of available applications based on the detected one of the plurality of pre-defined gestures;

means for selecting one of a plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications based on the detected one of the plurality of pre-defined gestures to enable the mobile device to consume power at a level approximating the respective power requirements for the selected one or more applications, and means for loading the selected one of the plurality of predetermined power profiles to a power management controller to control power to the application processor system, wherein the selected one of the plurality of predetermined power profiles is further configured to establish at least one of (1) a clock frequency at which an application processor of the application processor system is to operate or (2) a current or voltage at which the application processor of the application processor system is to operate; and

means for instructing the power management controller to apply the one of the plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications, selected based on the one of the plurality of pre-defined gestures detected by the independently operating sensor processor system, to the application processor to control power to the application processor system so as to support the respective power requirements of the one or more loaded applications selected based on the detected one of the plurality of pre-defined gestures.

36. The mobile device of claim 35, wherein the one or more sensors include (a) a light sensor, (b) a pressure sensor, (c) a gyroscopic sensor, (d) an accelerometer, (e) a touch-screen proximity sensor, (f) a fingerprint sensor and/or (g) a haptic sensor.

37. The mobile device of claim 35, wherein the one or more user-initiated actions includes (a) the user pressing a key or button of the mobile device, (b) the user walking or jogging with the mobile device, (c) the user picking up the mobile device from a surface or storage location, (d) the user placing the mobile device onto a surface or into a storage location, (e) a proximity of the user'"'"'s fingers being close to a display of the mobile device and/or (f) the user moving into an airplane with the mobile device.

38. The mobile device of claim 35, wherein the one or more environmental conditions or events includes (a) an amount of light in proximity to the mobile device, (b) a temperature in proximity to the mobile device, (c) an acceleration of the mobile device, (d) a velocity of the mobile device, (e) an altitude of the mobile device and/or (f) identifying one or more wireless transmitters in range of the mobile device.

39. The mobile device of claim 35, wherein the selected one of the plurality of predetermined power profiles is configured to establish whether a modem subsystem configured to manage wireless communications to or from the mobile device is turned on or off.

40. The mobile device of claim 35, further comprising:

means for selecting the one or more applications for execution by the application processor system based on the detection,

wherein the means for instructing further instructs the application processor system to load the one or more applications.

41. The mobile device of claim 35, further comprising:

means for determining that the application processor system has transitioned to a different mode of operation associated with a different power profile from among the plurality of power profiles; and

means for applying the different power profile to the application processor system.

42. A mobile device, comprising:

logic configured to monitor, at a sensor processor system of the mobile device, one or more sensors connected to the mobile device, the sensor processor system configured for low-power operation;

logic configured to detect one of a plurality of pre-defined gestures and one or more environmental conditions or events based on the monitoring, wherein each of the plurality of pre-defined gestures corresponds to one or more actions initiated by a user of the mobile device;

logic configured to load to an application processor system, operating independently from the sensor processor system, one or more applications associated with respective power requirements, the one or more applications selected from a plurality of available applications based on the detected one of the plurality of pre-defined gestures;

logic configured to select one of a plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications based on the detected one of the plurality of pre-defined gestures to enable the mobile device to consume power at a level approximating the respective power requirements for the selected one or more applications, and load the selected one of the plurality of predetermined power profiles to a power management controller to control power to the application processor system, wherein the selected one of the plurality of predetermined power profiles is configured to establish at least one of (1) a clock frequency at which an application processor of the application processor system is to operate or (2) a current or voltage at which the application processor of the application processor system is to operate; and

logic configured to instruct the power management controller to apply the one of the plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications, selected based on the one of the plurality of pre-defined gestures detected by the independently operating sensor processor system, to the application processor to control power to the application processor system so as to support the respective power requirements of the one or more loaded applications selected based on the detected one of the plurality of pre-defined gestures.

43. The mobile device of claim 42, wherein the one or more sensors include (a) a light sensor, (b) a pressure sensor, (c) a gyroscopic sensor, (d) an accelerometer, (e) a touch-screen proximity sensor, (f) a fingerprint sensor and/or (g) a haptic sensor.

44. The mobile device of claim 42, wherein the one or more user-initiated actions includes (a) the user pressing a key or button of the mobile device, (b) the user walking or jogging with the mobile device, (c) the user picking up the mobile device from a surface or storage location, (d) the user placing the mobile device onto a surface or into a storage location, (e) a proximity of the user'"'"'s fingers being close to a display of the mobile device and/or (f) the user moving into an airplane with the mobile device.

45. The mobile device of claim 42, wherein the one or more environmental conditions or events includes (a) an amount of light in proximity to the mobile device, (b) a temperature in proximity to the mobile device, (c) an acceleration of the mobile device, (d) a velocity of the mobile device, (e) an altitude of the mobile device and/or (f) identifying one or more wireless transmitters in range of the mobile device.

46. The mobile device of claim 42, wherein the selected one of the plurality of predetermined power profiles is configured to establish whether a modem subsystem configured to manage wireless communications to or from the mobile device is turned on or off.

47. The mobile device of claim 42, further comprising:

logic configured to select the one or more applications for execution by the application processor system based on the detection,

wherein the logic configured to instruct further instructs the application processor system to load the one or more applications.

48. The mobile device of claim 42, further comprising:

logic configured to determine that the application processor system has transitioned to a different mode of operation associated with a different power profile from among the plurality of power profiles; and

logic configured to apply the different power profile to the application processor system.

49. A non-transitory computer-readable storage medium containing instructions stored thereon, which, when executed by a mobile device, cause the mobile device to perform operations, the instructions comprising:

program code to monitor, at a sensor processor system of the mobile device, one or more sensors connected to the mobile device, the sensor processor system configured for low-power operation;

program code to detect one of a plurality of pre-defined gestures and one or more environmental conditions or events based on the monitoring, wherein each of the plurality of pre-defined gestures corresponds to one or more actions initiated by a user of the mobile device;

program code to load to an application processor system, operating independently from the sensor processor system, one or more applications associated with respective power requirements, the one or more applications selected from a plurality of available applications based on the detected one of the plurality of pre-defined gestures;

program code to select one of a plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications based on the detected one of the plurality of pre-defined gestures to enable the mobile device to consume power at a level approximating the respective power requirements for the selected one or more applications, and load the selected one of the plurality of predetermined power profiles to a power management controller to control power to the application processor system, wherein the selected one of the plurality of predetermined power profiles is configured to establish at least one of (1) a clock frequency at which an application processor of the application processor system is to operate or (2) a current or voltage at which the application processor of the application processor system is to operate; and

program code to instruct the power management controller to apply the one of the plurality of predetermined power profiles corresponding to the respective power requirements for the selected one or more applications, selected based on the detected one of the plurality of pre-defined gestures, to the application processor system to control power to the application processor system so as to support the respective power requirements of the one or more loaded applications selected based on the detected one of the plurality of pre-defined gestures.

50. The non-transitory computer-readable storage medium of claim 49, wherein the one or more sensors include (a) a light sensor, (b) a pressure sensor, (c) a gyroscopic sensor, (d) an accelerometer, (e) a touch-screen proximity sensor, (f) a fingerprint sensor and/or (g) a haptic sensor.

51. The non-transitory computer-readable storage medium of claim 49, wherein the one or more user-initiated actions includes (a) the user pressing a key or button of the mobile device, (b) the user walking or jogging with the mobile device, (c) the user picking up the mobile device from a surface or storage location, (d) the user placing the mobile device onto a surface or into a storage location, (e) a proximity of the user'"'"'s fingers being close to a display of the mobile device and/or (f) the user moving into an airplane with the mobile device.

52. The non-transitory computer-readable storage medium of claim 49, wherein the one or more environmental conditions or events includes (a) an amount of light in proximity to the mobile device, (b) a temperature in proximity to the mobile device, (c) an acceleration of the mobile device, (d) a velocity of the mobile device, (e) an altitude of the mobile device and/or (f) identifying one or more wireless transmitters in range of the mobile device.

53. The non-transitory computer-readable storage medium of claim 49, wherein the selected one of the plurality of predetermined power profiles is configured to establish whether a modem subsystem configured to manage wireless communications to or from the mobile device is turned on or off.

54. The non-transitory computer-readable storage medium of claim 49, further comprising:

program code to select the one or more applications for execution by the application processor system based on the detection,

wherein the program code to instruct is configured to instruct the application processor system to load the one or more applications.

55. The non-transitory computer-readable storage medium of claim 49, further comprising:

program code to determine that the application processor system has transitioned to a different mode of operation associated with a different power profile from among the plurality of power profiles; and

program code to apply the different power profile to the application processor system.