Enhanced automated environmental control system scheduling using a preference function

• US 9,933,177 B2
• Filed: 11/04/2014
• Issued: 04/03/2018
• Est. Priority Date: 11/04/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Hester, Todd, Minich, Allen Joseph, Heitz, III, George Alban
• Primary Examiner(s): Nguyen, Van
• Application Number:
  US14/532,231
• Publication Number:
  US 20160123618A1
• Time in Patent Office: 1,246 Days
• Field of Search: None
• CPC Class Codes: F24F 11/30 for purposes related to the operation of the system, e.g. for safety or monitoring
• CPC Class Codes: F24F 11/46 Improving electric energy efficiency or saving
• CPC Class Codes: F24F 11/52 Indication arrangements, e.g. displays
• CPC Class Codes: F24F 11/58 using Internet communication
• CPC Class Codes: F24F 11/62 characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
• CPC Class Codes: F24F 11/64 using pre-stored data
• CPC Class Codes: F24F 2110/10 Temperature
• CPC Class Codes: F24F 2120/00 Control inputs relating to users or occupants
• CPC Class Codes: F24F 2120/10 Occupancy
• CPC Class Codes: G05B 13/0265 the criterion being a learning criterion
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house

Abstract

In an embodiment, an electronic device may include storage containing processor-executable instructions and a current setpoint schedule, and a processor configured to execute the instructions. The instructions may cause the processor to control an environmental control system based at least in part on the current setpoint schedule, and to determine the current setpoint schedule by detecting user behavior that indicates satisfaction with setpoints, based at least in part on the detected user behavior, determining a preference function that maps weights indicating user preferences for setpoints, determining candidate setpoint schedules, scoring the candidate setpoint schedules against the weights of the preference function to obtain first scores, where candidate setpoint schedules that best fit the weights of the preference function have the highest first scores, modifying the first scores to obtain second scores, and selecting the candidate setpoint schedule with the highest second score as a new current setpoint schedule.

Claims

1. An electronic device comprising:

storage containing;

processor-executable instructions; and

a current setpoint schedule of temperature setpoints over time; and

a processor configured to execute the instructions, wherein the instructions are configured to cause the processor to control an environmental control system based at least in part on the current setpoint schedule, wherein the instructions are configured to cause the processor to determine the current setpoint schedule by;

detecting user behavior that indicates satisfaction or dissatisfaction with setpoint temperatures of the environmental control system in relation to time of day;

based at least in part on the detected user behavior, determining a preference function that maps weights indicating likely relative user preferences for a range of possible setpoint temperatures for a range of times of day;

determining a plurality of candidate setpoint schedules;

scoring the plurality of candidate setpoint schedules against the weights of the preference function to obtain a first score for each of the plurality of candidate setpoint schedules, wherein candidate setpoint schedules that best fit the weights of the preference function have the highest first scores;

modifying or not modifying the first scores for each of the plurality of candidate setpoint schedules to obtain a second score for each of the plurality of candidate setpoint schedules; and

selecting one of the plurality of candidate setpoint schedules with the highest second score to be a new current setpoint schedule.

2. The electronic device of claim 1, wherein the user behavior that is detected that indicates satisfaction or dissatisfaction with the setpoint temperatures of the environmental control system comprises:

not changing the current setpoint schedule at a first time of day, thereby indicating satisfaction with a current setpoint at the first time of day;

changing a current setpoint temperature to a second setpoint temperature at the first time of day, thereby indicating dissatisfaction with the current setpoint temperature at the first time of day and satisfaction with the second setpoint temperature at the first time of day;

manually adding a new temperature setpoint to the current setpoint schedule at the first time of day, thereby indicating satisfaction with the setpoint temperature of the new temperature setpoint at the first time of day;

manually deleting a previous temperature setpoint from the current setpoint schedule at the first time of day, thereby indicating dissatisfaction with the setpoint temperature of the previous temperature setpoint at the first time of day;

or

displaying detectable discomfort with the current setpoint temperature at the first time of day, thereby indicating dissatisfaction with the current setpoint temperature at the first time of day;

or

any combination thereof.

3. The electronic device of claim 2, wherein determining the preference function comprises:

adding a first amount of weight to the current setpoint temperature at the first time of day when the current setpoint schedule is not changed at the first time of day;

subtracting a second amount of weight from the current setpoint temperature at the first time of day when the current setpoint is changed to the second setpoint temperature at the first time of day;

adding a third amount of weight to the second setpoint temperature at the first time of day when the current setpoint is changed to the second setpoint temperature at the first time of day;

adding a fourth amount of weight to the setpoint temperature of the new temperature setpoint at the first time of day when the new temperature setpoint is added at the first time of day;

subtracting a fifth amount of weight from the setpoint temperature of the previous temperature setpoint at the first time of day when the previous temperature setpoint is deleted at the first time of day;

or

any combination thereof.

4. The electronic device of claim 3, wherein the first amount of weight is greater than the second amount of weight.

5. The electronic device of claim 3, wherein the third amount of weight is greater than the first amount of weight.

6. The electronic device of claim 3, wherein the fourth amount of weight is greater than the first amount of weight and the fourth amount of weight is greater than the third amount of weight.

7. The electronic device of claim 1, wherein determining the preference function comprises updating a stored preference function by adding weights to temperature, time-of-day coordinates when the detected user behavior indicated satisfaction and by subtracting weights to temperature, time-of-day coordinates when the detected user behavior indicated dissatisfaction.

8. The electronic device of claim 7, comprising smoothing the weights of the preference function by decaying at least some added weights forward to time-of-day coordinates that occur later in the day.

9. The electronic device of claim 8, wherein the decayed weights are decayed forward to the time-of-day coordinates that occur later in the day down to a persistence weight that is no longer decayed further but continues forward to later time-of-day coordinates until other tracked user behavior suggests another temperature would be preferred.

10. The electronic device of claim 7, comprising smoothing the weights of the preference function by decaying at least some added weights to nearby higher and lower temperatures.

11. The electronic device of claim 10, wherein decaying the added weights comprises exponentially decaying the added weights.

12. The electronic device of claim 1, wherein determining the preference function comprises adding weight to efficient temperatures for which the user behavior indicated satisfaction.

13. One or more tangible, non-transitory machine-readable media comprising instructions to cause a processor to:

control an environmental control system based at least in part on a setpoint schedule of temperature setpoints over time; and

determine the setpoint schedule by;

detecting user behavior that indicates satisfaction or dissatisfaction with setpoint temperatures of the environmental control system in relation to time of day;

based at least in part on the detected user behavior, determining a preference function that maps weights indicating likely relative user preferences for a range of possible setpoint temperatures for a range of times of day;

determining a plurality of candidate setpoint schedules;

scoring the plurality of candidate setpoint schedules against the weights of the preference function to obtain a first score for each of the plurality of candidate setpoint schedules, wherein candidate setpoint schedules that best fit the weights of the preference function have the highest first scores;

modifying or not modifying the first scores for each of the plurality of candidate setpoint schedules to obtain a second score for each of the plurality of candidate setpoint schedules; and

selecting one of the plurality of candidate setpoint schedules with the highest second score to be the setpoint schedule.

14. The media of claim 13, wherein the detected user behavior comprises a manual deletion of a previous temperature setpoint from the setpoint schedule at a first time of day, thereby indicating dissatisfaction with the setpoint temperature of the previous temperature setpoint at the first time of day.

15. The media of claim 14, wherein determining the preference function comprises creating a banned area around the setpoint temperature of the previous temperature setpoint at the first time of day, and wherein determining the plurality of candidate setpoint schedules comprises not determining any candidate setpoint schedules that have a temperature setpoint within the banned area.

16. The media of claim 15, wherein the banned area has a cross shape having a vertical component and a horizontal component.

17. The media of claim 16, wherein the vertical component is relatively larger when the manually deleted previous temperature setpoint was replaced by a manually added temperature setpoint of a different temperature at the same time of day and

wherein the horizontal component is relatively larger when the manually deleted temperature setpoint was replaced by a manually added temperature setpoint at the same temperature at a different time of day.

18. The media of claim 15, wherein the instructions comprise instructions to maintain the banned area for a minimum number of days, during which the current setpoint schedule cannot include a temperature setpoint within the banned area.

19. An electronic device comprising:

storage containing;

processor-executable instructions; and

a current setpoint schedule of temperature setpoints over time; and

a processor configured to execute the instructions, wherein the instructions are configured to cause the processor to control an environmental control system based at least in part on the current setpoint schedule, wherein the instructions are configured to cause the processor to determine the current setpoint schedule by;

detecting user behavior that indicates satisfaction or dissatisfaction with setpoint temperatures of the environmental control system in relation to time of day;

based at least in part on the detected user behavior, determining a preference function that maps weights indicating likely relative user preferences for a range of possible setpoint temperatures for a range of times of day;

selecting the current setpoint schedule as a first candidate setpoint schedule of a first plurality of candidate setpoint schedules and modifying the current setpoint schedule according to a first set of constraints to determine the first plurality of candidate setpoint schedules;

scoring the first plurality of candidate setpoint schedules against the weights of the preference function to obtain a first score for each of the first plurality of candidate setpoint schedules, wherein the candidate setpoint schedules that best fit the weights of the preference function have the highest first scores;

modifying or not modifying the first scores for each of the first plurality of candidate setpoint schedules to obtain a second score for each of the first plurality of candidate setpoint schedules; and

selecting one of the first plurality of candidate setpoint schedules with the highest second score to be the current setpoint schedule;

or

selecting the one of the first plurality of candidate setpoint schedules with the highest second score to be a first candidate setpoint schedule of another plurality of setpoint schedules and repeating the modifying, scoring, modifying or not modifying, and selecting with the other plurality of setpoint schedules.

20. The electronic device of claim 19, wherein the first set of constraints comprises:

a latest time in a day to have a temperature setpoint;

an earliest time in the day to have a temperature setpoint;

a highest setpoint temperature to have a temperature setpoint;

a lowest setpoint temperature to have a temperature setpoint;

a minimum difference in proximity in time to have two nearest-in-time temperature setpoints;

or

a maximum temperature increment from one temperature setpoint to another temperature setpoint;

or

any combination thereof.

21. The electronic device of claim 20, wherein:

the latest time in the day comprises the latest time of day that temperature adjustments were made by a user within a first historical period;

the earliest time in the day comprises the earliest time of day that temperature adjustments were made by the user within the first historical period;

the highest setpoint temperature comprises the highest temperature selected by a user within the first historical period;

or

the lowest setpoint temperature comprises the highest temperature selected by a user within the first historical period;

or

any combination thereof.

22. The electronic device of claim 21, wherein the first score of each of the first plurality of candidate setpoint schedules is modified based on:

a total number of setpoints;

a regularity of setpoints;

or

a change from the current setpoint schedule;

or

any combination thereof.