Methods, devices, and systems for controlling smart lighting objects to establish a lighting condition

• US 9,313,863 B2
• Filed: 04/10/2015
• Issued: 04/12/2016
• Est. Priority Date: 06/02/2014
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Hershberg, Joshua, Berelejis, Gabriel, Vogelsang, Brian, Geffen, Fruma Adina
• Primary Examiner(s): Owens, Douglas W
• Assistant Examiner(s): Fernandez, Pedro C
• Application Number:
  US14/683,821
• Publication Number:
  US 20150351204A1
• Time in Patent Office: 368 Days
• US Class Current: 1/1
• CPC Class Codes: G08C 23/02 using infrasonic, sonic or ultrasonic waves
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information
• CPC Class Codes: H04W 4/30 Services specially adapted for particular environments, situations or purposes
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H05B 47/19 via wireless transmission
• CPC Class Codes: H05B 47/1965 using handheld communication devices
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

A device controls a lighting condition of smart objects. A networking framework is executed on the device and the smart objects. An RF signal is broadcast from the device to the smart objects. The signal requests the objects to transmit an ultrasound signal. Ultrasound signals from the objects are received in the device via microphones. A range and direction to each object may be determined based on reception times of the ultrasound signals. A map of the location of the objects is generated. The objects are controlled, via the networking framework, based on the map. A user interface overlay that shows the current lighting condition and location of objects using icons is presented on the device display. The icons are interactive controls for the objects, which may be interacted with for control of the corresponding object. The objects may be manually or automatically controlled to achieve a lighting condition.

Claims

1. A method for controlling a lighting condition by a control device, comprising:

executing a networking framework on the control device;

broadcasting a radio frequency (RF) signal on an RF communication channel associated with the networking framework from the control device for reception by a plurality of smart lighting objects registered with the networking framework, wherein each of the plurality of smart lighting objects is assigned an identifier within the networking framework, wherein the RF signal is configured to cause each of the plurality of smart lighting objects to transmit an ultrasound signal including the assigned identifier;

receiving ultrasound signals from a subset of the plurality of smart lighting objects in the control device via two or more ultrasound microphones;

determining a range and a direction to each of the subset of the plurality of smart lighting objects from which ultrasound signals were received based on reception times of the ultrasound signals by each of the two or more ultrasound microphones;

generating a three dimensional map of locations of the subset of the plurality of smart lighting objects from which ultrasound signals were received based on the determined range and the determined direction; and

controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition.

2. The method of claim 1, further comprising presenting a user interface including a camera image showing a current lighting condition on a display of the control device, wherein the user interface includes control objects associated with the subset of the plurality of smart lighting objects from which ultrasound signals were received and wherein the control objects are presented on the camera image based on their location identified in the three dimensional map.

3. The method of claim 2, wherein controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises receiving a user input based on the presented camera image showing the current lighting condition and an interaction with one of the control objects and translating the received user input into a control command that is transmitted via the networking framework to one of the selected ones of the subset of the plurality of smart lighting objects corresponding to the one control object.

4. The method of claim 3, further comprising presenting a new camera image showing a new lighting condition based on the transmitted control command, wherein controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises receiving a new user input based on the presented new camera image showing the new lighting condition and a new interaction with one of the control objects and translating the received new user input into a new control command that is transmitted via the networking framework to one of the selected ones of the subset of the plurality of smart lighting objects corresponding to the one control object.

5. The method of claim 2, wherein presenting the user interface including the camera image showing the current lighting condition on the display of the device comprises presenting one or more selections for predetermined lighting conditions that provide pre-programmed control settings of one or more of the subset of the plurality of smart lighting objects.

6. The method of claim 2, wherein controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises disabling a light output of a first one or more of the subset of the plurality of smart lighting objects within the camera image and adjusting a light output of a second one or more of the subset of the plurality of smart lighting objects outside the camera image to control the lighting condition.

7. The method of claim 1, wherein controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises:

processing an image captured by a camera to determine a required level of light for the lighting condition;

identifying, based the three dimensional map and the processed image, one or more of the subset of the plurality of smart lighting objects that can be adjusted to achieve the required level of light; and

transmitting commands via the networking framework to adjust a light output of the identified one or more of the subset of the plurality of smart lighting objects to achieve the required level of light for the lighting condition.

8. The method of claim 7, further comprising:

processing the image to determine further changes to lighting required to achieve the desired lighting condition; and

transmitting commands via the networking framework to readjust one or more of the subset of the plurality of smart lighting objects to achieve the required level of light for the lighting condition based on the determined further changes to lighting required to achieve the desired lighting condition.

9. The method of claim 7, wherein transmitting commands via the networking framework to adjust a light output of the identified one or more of the subset of the plurality of smart lighting objects comprises transmitting commands to reduce a light output of a first one or more of the subset of the plurality of smart lighting objects within the image and to increase a light output of a second one or more of the subset of the plurality of smart lighting objects outside the image to achieve the required level of light for the lighting condition.

10. The method of claim 1, further comprising determining whether a current lighting condition includes sufficient light to take a picture, wherein controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises:

processing an image captured by a camera to determine a required level of light for the lighting condition;

identifying, based on the three dimensional map and the processed image, one or more of the subset of the plurality of the smart lighting objects that to be adjusted to achieve the required level of light; and

transmitting commands via the networking framework to adjust a light output of the identified one or more of the subset of the plurality of smart lighting objects to achieve the required level of light for the lighting condition.

11. A control device, comprising:

a transceiver;

two or more ultrasound microphones; and

a processor coupled to the transceiver and the two or more ultrasound microphones, the processor configured with processor executable instructions to perform operations comprising;

executing a networking framework;

broadcasting a radio frequency (RF) signal on an RF communication channel associated with the networking framework from the control device for reception by a plurality of smart lighting objects registered with the networking framework, wherein each of the plurality of smart lighting objects is assigned an identifier within the networking framework, wherein the RF signal is configured to cause each of the plurality of smart lighting objects to transmit an ultrasound signal including the assigned identifier;

receiving ultrasound signals from a plurality of smart lighting objects via the two or more ultrasound microphones;

determining a range and a direction to each of the plurality of smart lighting objects from which ultrasound signals were received based on reception times of the ultrasound signals by each of the two or more ultrasound microphones;

generating a three dimensional map of locations of a subset of the plurality of smart lighting objects from which ultrasound signals were received based on the determined range and the determined direction; and

controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition.

12. The control device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations further comprising presenting a user interface including a camera image showing a current lighting condition on a display of the control device, wherein the user interface includes control objects associated with the subset of the plurality of smart lighting objects from which ultrasound signals were received and wherein the control objects are presented on the camera image based on their location identified in the three dimensional map.

13. The control device of claim 12, wherein the processor is configured with processor-executable instructions to perform operations such that controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises receiving a user input based on the presented camera image showing the current lighting condition and an interaction with one of the control objects and translating the received user input into a control command that is transmitted via the networking framework to the smart lighting object corresponding to the one control object.

14. The control device of claim 13, wherein the processor is configured with processor-executable instructions to perform operations:

further comprising presenting a new camera image showing a new lighting condition based on the transmitted control command; and

such that controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifier to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises receiving a new user input based on the presented new camera image showing the new lighting condition and a new interaction with one of the control objects and translating the received new user input into a new control command that is transmitted via the networking framework to the smart lighting object corresponding to the one control object.

15. The control device of claim 12, wherein the processor is configured with processor-executable instructions to perform operations such that presenting the user interface including the camera image showing the current lighting condition on the display of the device comprises presenting one or more selections for predetermined lighting conditions that provide pre-programmed control settings of one or more of the subset of the plurality of smart lighting objects.

16. The control device of claim 12, wherein the processor is configured with processor-executable instructions to perform operations such that controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises disabling a light output of a first one or more of the subset of the plurality of smart lighting objects within the camera image and adjusting a light output of a second one or more of the subset of the plurality of smart lighting objects outside the camera image to control the lighting condition.

17. The control device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations such that controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises:

processing an image captured by a camera to determine a required level of light for the lighting condition;

identifying, based the three dimensional map and the processed image, one or more of the subset of the plurality of the smart lighting objects that can be adjusted to achieve the required level of light; and

transmitting commands via the networking framework to adjust a light output of the identified one or more of the smart lighting objects to achieve the required level of light for the lighting condition.

18. The control device of claim 17, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

processing the captured image to determine further changes to lighting required to achieve the desired lighting condition; and

transmitting commands via the networking framework to readjust one or more of the smart lighting objects to achieve the required level of light for the lighting condition based on the determined further changes to lighting required to achieve the desired lighting condition.

19. The control device of claim 11, wherein the processor is configured with processor executable instructions to perform operations further comprising determining whether a current lighting condition includes sufficient light to take a picture, and wherein the processor is configured with processor executable instructions to perform operations such that controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition comprises:

processing an image captured by a camera to determine a required level of light for the current lighting condition;

identifying, based the three dimensional map and the processed image, one or more of the subset of the plurality of the smart lighting objects that can be adjusted to achieve the required level of light; and

transmitting commands via the networking framework to adjust a light output of the identified one or more of the subset of the plurality of smart lighting objects to achieve the required level of light for the lighting condition.

20. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a control device to perform operations comprising:

executing a networking framework on the control device;

broadcasting a radio frequency (RF) signal on an RF communication channel associated with the networking framework from the control device for reception by a plurality of smart lighting objects registered with the networking framework, wherein each of the plurality of smart lighting objects is assigned an identifier within the networking framework, wherein the RF signal is configured to cause each of the plurality of smart lighting objects to transmit an ultrasound signal including the assigned identifier;

receiving ultrasound signals from a plurality of smart lighting objects in the control device via two or more ultrasound microphones;

determining a range and a direction to each of the plurality of smart lighting objects from which ultrasound signals were received based on reception times of the ultrasound signals by each of the two or more ultrasound microphones;

generating a three dimensional map of locations of a subset of the plurality of smart lighting objects from which ultrasound signals were received based on the determined range and the determined direction; and

controlling a lighting condition by sending control signals, via the networking framework, to selected ones of the subset of the plurality of smart lighting objects based on the three dimensional map and the assigned identifiers of the selected ones of the subset of the plurality of smart lighting objects to cause the selected ones of the subset of the plurality of smart lighting objects to brighten or dim in order to achieve a desired lighting condition.