Anticipatory lighting from device screens based on user profile

• US 9,585,229 B2
• Filed: 05/13/2014
• Issued: 02/28/2017
• Est. Priority Date: 05/13/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Liu, Eric H C, Effrat, Jonathan James, Goran, Charles
• Primary Examiner(s): Nguyen, Van
• Application Number:
  US14/276,964
• Publication Number:
  US 20160029458A1
• Time in Patent Office: 1,022 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G05B 19/042 using digital processors G05B19/05 takes precedence
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: H05B 47/105 in response to determined parameters
• CPC Class Codes: H05B 47/11 by determining the brightness or colour temperature of ambient light
• CPC Class Codes: H05B 47/155 Coordinated control of two or more light sources
• CPC Class Codes: H05B 47/16 by timing means
• CPC Class Codes: H05B 47/165 following a pre-assigned programmed sequence; Logic control [LC]
• CPC Class Codes: H05B 47/175 by remote control
• CPC Class Codes: H05B 47/19 via wireless transmission
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

Systems, methods, and computer readable storage mediums are provided for determining the mood of the user, deriving an appropriate lighting scheme, and then implementing that lighting scheme on all devices within a predetermined proximity to that user. Furthermore, when a user begins a task, the devices can track the user and use lighting from nearby screens to offer functional lighting.

Claims

1. A method for adaptive lighting, comprising:

at a computer system having one or more processors and memory storing programs for execution by the one or more processors;

accessing a lighting map of lighting devices, wherein the lighting devices include one or more non-conventional lighting devices, each of the lighting devices has one or more lighting characteristics and are controllable via one or more networks, and the map indicates for each of the lighting devices at least lighting device position and lighting device on/off state;

obtaining contextual information for a user, wherein the contextual information includes current user location, time of day, and one or more indications of;

user movement, sound in proximity to the user'"'"'s location, ambient light level in proximity to the user'"'"'s location, user'"'"'s calendar events, device interactions by the user, and web interactions by the user;

based on the contextual information, inferring a user task and a lighting need associated with the user task;

based on the user location, determining from the lighting map a first subset of the lighting devices that are located in proximity to the user'"'"'s location, wherein the subset of the lighting devices includes at least a first non-conventional lighting device; and

controlling the lighting characteristics of the first subset of the lighting devices via one or more of the networks to satisfy the lighting need.

2. The method of claim 1, wherein each of the non-conventional lighting devices is a networked, electronic device with a controllable, illuminated display screen.

3. The method of claim 2, wherein each of the non-conventional lighting devices is selected from:

a television, video projector, smart phone, tablet computer, computer display, laptop computer, audio component, or appliance.

4. The method of claim 1, wherein each of the non-conventional lighting devices is a networked, electronic device with a controllable lighting element.

5. The method of claim 4, wherein each of the electronic devices is selected from:

a power transformer, charging device, power outlet with a controllable status light, power switch adapter, and light socket adapter.

6. The method of claim 4, further comprising:

determining whether the lighting need was met and, in response to determining that the lighting need was not met, determining from the lighting map a second subset of the lighting devices that are located in proximity to the user'"'"'s location, and controlling the lighting characteristics of the second set of lighting devices via one or more of the networks to satisfy the lighting need.

7. The method of claim 1, wherein at least one of the first subset of the lighting devices is responsive to commands sent in accordance with an API configured to specify lighting characteristics, including one or more of lighting on/off state, and lighting hue, saturation and brightness.

8. The method of claim 1, wherein the first non-conventional lighting device is configured to execute an operating system that can control display content and lighting characteristics, including one or more of display on/off state, and lighting hue, saturation and brightness for a plurality of addressable pixels of the display.

9. The method of claim 1, wherein controlling the lighting characteristics of the lighting devices includes controlling display content of at least one of the non-conventional lighting devices to provide a meaningful indictor to the user related to the inferred task.

10. The method of claim 9, wherein the meaningful indicator includes a text message, a graphic display, or a directional indicator.

11. The method of claim 1, wherein the positions of lighting devices in the lighting map are described with reference to rooms of a structure occupied by the user.

12. The method of claim 1, further comprising:

preparing the lighting map by;

sending network commands to one or more of the lighting devices to cause respective ones of the one or more lighting devices to emit respective identifiable sequences of lighting events; and

using a video camera to locate in context of the lighting map positions of the respective lighting devices by identifying the identifiable sequences of lighting events.

13. The method of claim 12, further comprising:

using the video camera and a database of images of lighting devices, including images of non-conventional lighting devices, to identify using visual matching techniques types of the respective lighting devices.

14. The method of claim 12, further comprising:

determining the lighting characteristics of an identified and located lighting device by recording lighting responses of the lighting device to a sequence of lighting commands.

15. The method of claim 1, further comprising:

using the video camera, audio recording, or radio frequency triangulation to identify a location of a respective lighting device.

16. The method of claim 1, wherein the inferred task involves the user waking up in the morning.

17. The method of claim 1, wherein the inferred task involves the user moving from a current location to a destination.

18. The method of claim 17, wherein controlling the lighting characteristics of the subset of the lighting devices further comprises:

identifying the current location of the user and a physical path of the user to the destination in context of the lighting map;

consulting the lighting map to identify a first collection of lighting devices, including at least one non-conventional lighting device, that are proximate to the current location of the user, the physical path of the user, and the destination;

sensing and updating using environmental sensors the current location of the user;

based on the current location of the user, sending commands to respective ones of the first collection of lighting devices to direct the first collection of lighting devices to provide illumination from the current location along the path to the destination with lighting characteristics consistent with the inferred task and contextual information.

19. A centralized lighting control system, comprising:

one or more processors; and

memory storing one or more programs to be executed by the one or more processors;

the one or more programs comprising instructions for;

accessing a lighting map of lighting devices, wherein the lighting devices include one or more non-conventional lighting devices, each of the lighting devices has one or more lighting characteristics that are controllable via one or more networks, and the map indicates for each of the lighting devices at least lighting device position and lighting device on/off state;

obtaining contextual information for a user, wherein the contextual information includes current user location, time of day, and one or more indications of;

user movement, sound in proximity to the user'"'"'s location, ambient light level in proximity to the user'"'"'s location, user'"'"'s calendar events, device interactions by the user and web interactions by the user;

based on the contextual information, inferring a user task and a lighting need associated with the user task;

based on the user location, determining from the lighting map a first subset of the lighting devices that are located in proximity to the user'"'"'s location, wherein the subset of the lighting devices includes at least a first non-conventional lighting device; and

controlling the lighting characteristics of the first subset of the lighting devices via one or more of the networks to satisfy the lighting need.

20. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:

accessing a lighting map of lighting devices, wherein the lighting devices include one or more non-conventional lighting devices, each of the lighting devices has one or more lighting characteristics that are controllable via one or more networks, and the map indicates for each of the lighting devices at least lighting device position and lighting device on/off state;

obtaining contextual information for a user, wherein the contextual information includes current user location, time of day, and one or more indications of;

user movement, sound in proximity to the user'"'"'s location, ambient light level in proximity to the user'"'"'s location, user'"'"'s calendar events, device interactions by the user and web interactions by the user;

based on the contextual information, inferring a user task and a lighting need associated with the user task;

based on the user location, determining from the lighting map a first subset of the lighting devices that are located in proximity to the user'"'"'s location, wherein the subset of the lighting devices includes at least a first non-conventional lighting device; and

controlling the lighting characteristics of the first subset of the lighting devices via one or more of the networks to satisfy the lighting need.