Sleep mode selection employing a semi-markov decision process

• US 8,565,134 B2
• Filed: 12/01/2010
• Issued: 10/22/2013
• Est. Priority Date: 09/08/2010
• Status: Expired due to Fees

• Current Assignee: Hong Kong University of Science and Technology
• Original Assignee: Dynamic Invention LLC
• Inventors: Kong, Lei, Wong, Ka Wai, Tsang, Danny Hin Kwok
• Primary Examiner(s): Jaroenchonwanit, Bunjob
• Application Number:
  US12/958,185
• Publication Number:
  US 20120057513A1
• Time in Patent Office: 1,056 Days
• Field of Search: 370/311
• US Class Current: 370/311
• CPC Class Codes: H04W 52/0216 using a pre-established activity schedule, e.g. traffic indication frame
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

The disclosed subject matter relates to energy efficiency in mobile devices associated with a wireless communications environment. Power Saving Classes (PSCs) aim to reduce the power consumption of mobile devices based on the different types of traffic. Optimizing sleep mode selection schemes so as to maximize the energy efficiency while providing a QoS guarantee can be accomplished with optimization of a theoretical framework based on the semi-Markov Decision Process along with a performance evaluation on the sleep mode operation. A novel Policy Optimization algorithm is capable of finding optimized policies for a selection of different PSCs.

Claims

1. A system comprising:

a memory to store instructions; and

a processor, coupled to the memory, that facilitates execution of the instructions to perform operations comprising;

accessing a set of sleep mode instructions comprising a first sleep mode instruction for a first sleep mode defined in a corresponding wireless communication standard and a second sleep mode instruction for a second sleep mode defined in the corresponding wireless communication standard, wherein a sleep mode instruction of the set of sleep mode instructions is selectable based on a sleep mode selection policy; and

modifying the sleep mode selection policy based on a semi-Markov decision process model to form a modified sleep mode selection policy without modification of the sleep mode instruction of the set of sleep mode instructions.

2. The system of claim 1, wherein the operations further comprise determining a cost metric value based on a related action of the semi-Markov decision process model.

3. The system of claim 2, wherein the determining the cost metric value comprises determining the cost metric value further based on a sleep ratio value, an energy cost value, or a packet delay value.

4. The system of claim 1, wherein the modifying the sleep mode selection policy comprises employing a linear programming policy optimization.

5. The system of claim 4, wherein the linear programming policy optimization reduces a projected power consumption of the system subject to a delay constraint threshold value.

6. The system of claim 1, wherein the sleep mode instruction of the set of sleep mode instructions corresponds to a determined timeout delay value or a sleep mode transition value.

7. The system of claim 1, wherein the corresponding wireless communication standard is the Institute of Electrical and Electronics Engineers 802.16e-2005 standard.

8. The system of claim 1, the operations further comprising:

receiving a wireless system parameter; and

selecting the sleep mode instruction of the set of sleep mode instructions based on the modified sleep mode selection policy and the wireless system parameter.

9. The system of claim 8, wherein the wireless system parameter includes a traffic demand parameter.

10. The system of claim 8, wherein the wireless system parameter includes of a mobile subscriber station parameter, a cost metric parameter, a quality of service parameter, or an optimization target.

11. The system of claim 8, wherein the selecting the sleep mode instruction of the set of sleep mode instructions comprises selecting the sleep mode instruction based on a ranked plurality of modified sleep mode selection policies of a set of sleep mode selection policies comprising the modified sleep mode selection policy.

12. The system of claim 11, wherein a quality of service requirement is satisfied by the sleep mode instruction of the set of sleep mode instructions.

13. A method, comprising:

accessing, by a system comprising a processor, a wireless communication parameter of a wireless communication link between a base station device and a mobile device;

receiving a first sleep mode instruction for a first sleep mode of a wireless communication standard employed by the wireless communication link;

receiving a second sleep mode instruction for a second sleep mode of the wireless communication standard; and

modifying, by the system, a sleep mode selection policy, based on a semi-Markov decision process and the wireless communication parameter, to form a modified sleep mode selection policy, wherein a sleep mode instruction, of a set of sleep mode instructions comprising the first sleep mode instruction and second sleep mode instruction, is configured to be selected based on the modified sleep mode selection policy.

14. The method of claim 13, wherein the wireless communication standard is the Institute of Electrical and Electronics Engineers 802.16e-2005 standard.

15. The method of claim 13, wherein the accessing the wireless communication parameter comprises accessing a sleep ratio value, a power consumption level value, or a packet delay value.

16. The method of claim 13, further comprising:

selecting, by the system, a sleep mode instruction of the set of sleep mode instructions based on the modified sleep mode selection policy; and

generating, by the system, a timeout value or transition decision value associated with the mobile device employing the sleep mode instruction.

17. The method of claim 13, wherein the wireless device employing the sleep mode instruction is predictively determined to not conflict with a quality of service requirement of the wireless communication link.

18. A mobile subscriber station comprising:

a memory to store instructions; and

a processor, coupled to the memory, that facilitates execution of the instructions to perform operations comprising;

modeling a sleep mode selection policy of the mobile subscriber station as a semi-Markov decision process to facilitate computing performance evaluations of wireless power saving classes associated with the mobile subscriber station and a wireless link to a base station device or access point device of a wireless communications system, wherein a set of sleep mode operations comprises a first sleep mode operation for a first defined sleep mode of a wireless communication standard employed by the wireless communication link and a second sleep mode operation for a second defined sleep mode of the wireless communication standard;

modifying a sleep mode selection policy without modification of the set of sleep mode operations, to form a modified sleep mode selection policy, based on the modeling of the sleep mode selection policy;

modeling a cost function for a behavior of the sleep mode operation of the mobile subscriber station; and

selecting a sleep mode operation of the set of sleep mode operations based on the modified sleep mode selection policy and the modeling the cost function.

19. The mobile subscriber station of claim 18, the operations further comprising:

modeling a cost function for a behavior of the sleep mode operation of the mobile subscriber station.

20. The mobile subscriber station of claim 19, the operations further comprising:

selecting a sleep mode operation of the set of sleep mode operations based on the modified sleep mode selection policy and the cost function.

21. A computer-readable storage medium having instructions stored thereon that, in response to execution, cause a system comprising a processor to perform operations, comprising:

modeling a sleep mode selection policy of a mobile subscriber station as a semi-Markov decision process to facilitate an evaluation of wireless power saving classes associated with the mobile subscriber station and a wireless link with a base station device or access point device of a wireless communications system, wherein a set of sleep mode operations comprises a first sleep mode operation for a first sleep mode of a wireless communication standard employed by the wireless communication link and a second sleep mode operation for a second sleep mode of the wireless communication standard; and

modifying a sleep mode selection policy without modification of the set of sleep mode operations, to form a modified sleep mode selection policy, based on the modeling the sleep mode selection policy.

22. The computer readable storage medium of claim 21, wherein the wireless communication standard is the Institute of Electrical and Electronics Engineers 802.16e-2005 standard.