Virtual room-based light fixture and device control

• US 8,296,669 B2
• Filed: 06/02/2010
• Issued: 10/23/2012
• Est. Priority Date: 06/03/2009
• Status: Active Grant

• Current Assignee: Savant Systems, LLC
• Original Assignee: Savant Systems, LLC
• Inventors: Madonna, Robert P., Cipollo, Nicholas J.
• Primary Examiner(s): Patel, Ramesh
• Application Number:
  US12/792,236
• Publication Number:
  US 20100312366A1
• Time in Patent Office: 874 Days
• Field of Search: 700 17- 20, 700 65- 66, 700/83, 700 86- 87, 340/3.71, 715763-765, 715/771, 718/108, 718/116, 718120-121
• US Class Current: 715/765
• CPC Class Codes: G05B 19/042 using digital processors G05B19/05 takes precedence
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: H04L 12/2816 Controlling appliance services of a home automation network by calling their functionalities arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00
• CPC Class Codes: H05B 47/155 Coordinated control of two or more light sources
• CPC Class Codes: H05B 47/175 by remote control

Abstract

In one embodiment, a technique for controlling one or more devices within a physical room of a structure is provided. One or more devices in the structure are coupled, either directly or indirectly, to a programmable multimedia controller configured to issue control commands which, when implemented, change the state of the devices. A virtual room-based user interface is displayed on a display screen. The virtual room-based user interface may include one or more virtual rooms, each virtual room including a substantially photo-realistic depiction of a portion of the structure, including substantially photo-realistic depictions of one or more devices located within the portion of the structure. In response to the selection of a particular substantially photo-realistic visual depiction, the programmable multimedia controller may issue control commands which, when implemented, change the state of a particular device. The appearance of the particular virtual room may be updated to reflect the changed state.

Claims

1. A method for controlling one or more devices within a physical room of a structure, comprising:

coupling the one or more devices in the structure, either directly or indirectly, to a programmable multimedia controller configured to issue control commands which, when implemented, change the state of the one or more devices;

displaying, on a display screen, a virtual room-based user interface, the virtual room-based user interface including one or more of virtual rooms, each virtual room including a substantially photo-realistic depiction of a portion of the structure, the substantially photo-realistic depiction of a portion of the structure including substantially photo-realistic visual depictions of one or more boundaries of the portion of the structure, one or more furnishings located within the portion of the structure, and one or more devices located within the portion of the structure;

receiving a selection of a particular substantially photo-realistic visual depiction of a particular device within a particular virtual room;

in response to the selection of the particular substantially photo-realistic visual depiction of the particular device, issuing, by the programmable multimedia controller, control commands which, when implemented, change the state of the particular device; and

updating the appearance of the particular virtual room, such that the substantially photo-realistic visual depiction of the particular device, as well as the substantially photo-realistic visual depictions of the one or more boundaries of the portion of the structure and of the one or more furnishings located within the portion of the structure, reflect the changed state of the particular device.

2. The method of claim 1 wherein the one or more devices include one or more light fixtures, the selection of the particular substantially photo-realistic visual depiction corresponds to a substantially photo-realistic visual depiction of a particular light fixture, and the control commands, when implemented, change the state of the particular light fixture by changing the particular light fixture'"'"'s illumination.

3. The method of claim 2 wherein the changing the particular light fixture'"'"'s illumination further comprises:

turning the particular light fixture on or off.

4. The method of claim 3 wherein the updating the appearance of the particular virtual room further comprises:

showing a substantially photo-realistic depiction of the physical room with the particular light fixture illuminated.

5. The method of claim 1 wherein the one or more devices include one or more A/V devices, the selection of the particular substantially photo-realistic visual depiction corresponds to a substantially photo-realistic visual depiction of a particular A/V device, and the control commands, when implemented, change the state of the particular A/V device.

6. The method of claim 1 wherein the one or more devices include one or more automatic window shades, the selection of the particular substantially photo-realistic visual depiction corresponds to a substantially photo-realistic visual depiction of a particular automatic window shade, and the control commands, when implemented, raise or lower the particular automatic window shade.

7. The method of claim 1 wherein the one or more of virtual rooms each correspond to a portion of a physical room of the structure and the one or more boundaries of the portion of the structure are boundaries of the physical room and the one or more furnishings located within the portion of the structure are furnishings present in the physical room.

8. The method of claim 1 wherein the virtual room-based user interface includes one or more additional virtual rooms, at least one additional virtual room including a substantially photo-realistic depiction of an outdoor space and including substantially photo-realistic visual depictions of one or more devices located within the outdoor space.

9. The method of claim 1 further comprising:

coupling a control unit, either directly or indirectly, to the programmable multimedia controller; and

wherein the displaying a virtual room-based user interface displays the virtual room-based user interface on a display screen of the control unit and the receiving a selection of a particular substantially photo-realistic visual depiction of a particular device receives the selection on the control unit.

10. The method of claim 9 wherein the display screen of the control unit is a touch-screen display and the receiving a selection of a particular substantially photo-realistic visual depiction comprises:

receiving a touch on the touch-screen display about the particular substantially photo-realistic visual depiction.

11. The method of claim 1 further comprising:

providing a mobile device that is configured to communicate with the programmable multimedia controller; and

wherein the displaying a virtual room-based user interface displays the virtual room-based user interface on a display screen of the mobile device and the receiving a selection of a particular substantially photo-realistic visual depiction of a particular device receives the selection on the mobile device.

12. The method of claim 11 wherein the mobile device is a one of a multimedia smartphone, a multi-purposes tablet computing device, and a portable media player.

13. The method of claim 1 further comprising:

coupling a television, either directly or indirectly, to the programmable multimedia controller; and

coupling a remote control unit, either directly or indirectly, to the programmable multimedia controller;

wherein the displaying a virtual room-based user interface displays the virtual room-based user interface on a display screen of the television and the receiving a selection of a particular substantially photo-realistic visual depiction of a particular device receives the selection on the remote control unit.

14. The method of claim 1 further comprising:

capturing a first number of photographs of the portion of the structure; and

deriving the photo-realistic depiction of the portion of the structure in each of a second number of states, wherein the second number is greater than the first number.

15. An apparatus for controlling one or more devices within a physical room of a structure, comprising:

a display screen;

a programmable multimedia controller coupled to the one or more devices in the structure and configured to issue control commands which, when implemented, change a state of the one or more devices, the programmable multimedia controller further configured to cause display of a virtual room-based user interface on the display screen, the virtual room-based user interface including one or more of virtual rooms, each virtual room including a substantially photo-realistic depiction of a portion of the structure, the substantially photo-realistic depiction of a portion of the structure including substantially photo-realistic visual depictions of one or more boundaries of the portion of the structure, one or more furnishings located within the portion of the structure, and one or more devices located within the portion of the structure, the appearance of the one or more boundaries of the portion of the structure and the one or more furnishings located within the portion of the structure dependent upon the state of the one or more devices;

an interface device configured to receive a selection of a particular substantially photo-realistic visual depiction of a particular device within a particular virtual room;

wherein the programmable multimedia controller is further configured to, in response to the selection of the particular substantially photo-realistic visual depiction of a device, issue control commands which, when implemented, change the state of the particular device.

16. The apparatus of claim 15 wherein the programmable multimedia controller is further configured to update the appearance of the particular virtual room on the display screen, such that the substantially photo-realistic visual depiction of the particular device, as well as the substantially photo-realistic visual depictions of the one or more boundaries of the portion of the structure and of the one or more furnishings located within the portion of the structure, reflect the changed state of the particular device.

17. The apparatus of claim 16 wherein the one or more devices include one or more light fixtures, the selection of the particular substantially photo-realistic visual depiction corresponds to a substantially photo-realistic visual depiction of a particular light fixture, and the control commands, when implemented, change the state of the particular light fixture by changing the particular light fixture'"'"'s illumination.

18. The apparatus of claim 17 wherein the programmable multimedia controller is further configured to update the appearance of the particular virtual room to show a substantially photo-realistic depiction of the physical room with the particular light fixture illuminated.

19. The apparatus of claim 17 wherein the display screen and the interface are part of a touch-screen control unit coupled, either directly or indirectly, to the programmable multimedia controller.

20. An apparatus for controlling one or more devices within a physical room of a structure, comprising:

means for issuing control commands which, when implemented, change the state of the one or more devices;

means displaying a virtual room-based user interface, the virtual room-based user interface including one or more of virtual rooms, each virtual room including a substantially photo-realistic depiction of a portion of the structure, the substantially photo-realistic depiction of a portion of the structure including substantially photo-realistic visual depictions of one or more boundaries of the portion of the structure, one or more furnishings located within the portion of the structure, and one or more devices located within the portion of the structure;

means for receiving a selection of a particular substantially photo-realistic visual depiction of a particular device within a particular virtual room;

means for, in response to the selection of the particular substantially photo-realistic visual depiction of a device, issuing control commands which, when implemented, change the state of the particular device; and

means for updating the appearance of the particular virtual room, such that the substantially photo-realistic visual depiction of the particular device, as well as the substantially photo-realistic visual depictions of the one or more boundaries of the portion of the structure and of the one or more furnishings located within the portion of the structure, reflect the changed state of the particular device.