User interface for multi-device control

• US 10,230,538 B2
• Filed: 10/04/2011
• Issued: 03/12/2019
• Est. Priority Date: 11/03/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Killian, David, Harter, Glenn, Flores, Justin, Krzyzanowski, Paul
• Primary Examiner(s): Tan, Alvin H
• Application Number:
  US13/252,826
• Publication Number:
  US 20120266095A1
• Time in Patent Office: 2,716 Days
• Field of Search: 715740
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: Y10S 715/97 Instrumentation and component modelling, e.g. interactive control panel

Abstract

A control server, or similar central processor, manages the distribution of data (including audio and video), voice, and control signals among a plurality of system components connected via a wired and/or wireless communications network. The system components include audio/visual components (such as, televisions, monitors, PDAs, notepads, notebooks, MP3, portable stereo, etc.) as well as household appliances (such as, lighting, ovens, alarm clocks, etc.). A portable controller allows a user to access and control the system components from any location within a controlled residential and/or non-residential environment, including its surrounding areas. The portable controller includes a user and management interface that contains customized control screens for the system components. The control screens are stored in a hierarchical architecture that is searchable by region or component type.

Claims

1. A system including a graphical user interface for managing a plurality of system devices within a controlled environment, comprising:

one or more processors configured to generate the graphical user interface, the graphical user interface configured to;

display a set of first control objects associated with a plurality of respective system devices within the controlled environment;

enable a user to select a system device of the plurality of respective system devices for active user control of the selected system device by at least providing an activation input for a corresponding control object of the set of first control objects; and

display a device control interface configured to simultaneously present, automatically in response to at least the activation input being provided;

an indication of the selected system device;

a set of second control objects associated with a plurality of respective affiliate system devices within the controlled environment, the respective affiliate system devices being selected by the at least one or more processors based on a determination by the at least one of the one or more processors that the respective affiliate system devices are child devices in a chain of system devices of the selected system device, the affiliate system devices being configured to provide an input to the selected system device; and

control options for the selected system device, each control option being associated with a sequence of commands that, when executed, sends instructions to control at least one of operations or functions of the chain of system devices of the selected system device;

wherein activation of a control object from the set of second control objects populates the device control interface with control options for an affiliate system device associated with the activated control object from the set of second control objects; and

wherein each control option for the affiliate system device is associated with a sequence of commands that, when executed, sends instructions to control at least one of the operations or the functions of the affiliate system device.

2. The system of claim 1, wherein the set of first control objects represents a plurality of regions within the controlled environment, wherein each region includes one or more system devices.

3. The system of claim 2, wherein the graphical user interface is further configured to display a set of third control objects representing available system devices within a selected region in response to the activation input being provided for the control object from the set of first control objects;

and

wherein the selected system device is selected in response to an activation input being provided for a control object from the set of third control objects.

4. The system of claim 1, wherein the set of first control objects represents a plurality of device types within the controlled environment.

5. The system of claim 4, wherein the graphical user interface is further configured to display a set of third control objects representing available regions within the controlled environment in response to the activation input being provided for the control object from the set of first control objects;

and

wherein the selected system device is selected in response to an activation input being provided for a control object from the set of third control objects.

6. The system of claim 1, the graphical user interface being further configured to display a switch object associated with a global command that, responsive to an activation input being provided from the user, sends instructions to alter an on-off state of designated system devices;

wherein selection of one or more control objects from the set of first control objects denotes the designated system devices.

7. The system of claim 6, wherein the switch object is associated with at least one of:

a global command that, when executed, sends instructions to alter the on-off state of one or more system devices matching a designated device type, wherein selection of a control object from the set of first control objects denotes the designated device type, or

a global command that, when executed, sends an instruction to alter the on-off state of at least one system device positioned within a designated region within the controlled environment, wherein selection of a control object from the set of first control objects denotes the designated region.

8. The system of claim 6, further comprising:

an exclusion device configured to exempt from the global command at least one of one or more specified system devices, one or more system devices matching a specified device type, or one or more system devices positioned within a specified region within the controlled environment;

wherein execution of the global command does not send instructions to alter the on-off state of the exempted one or more system devices.

9. The system of claim 1, further comprising:

a definition device configured to specify at least one of one or more input links, one or more output links, or one or more dependencies among the plurality of respective affiliate system devices and the plurality of respective system devices to establish the chain of system devices of the selected system device.

10. The system of claim 1, wherein the chain of system devices includes a hidden affiliate system device, and

wherein at least one command of the sequence of commands, when executed, is automatically redirected from a system device of the chain of system devices of the selected system device to the hidden affiliate system device.

11. The system of claim 1, wherein the graphical user interface is configured to display the device control interface configured to simultaneously display, automatically in response to at least the activation input being provided:

the indication of the selected system device;

the set of second control objects; and

the control options for the selected system device.

12. The system of claim 1, wherein the graphical user interface is configured to display the device control interface configured to, automatically in response to at least the activation input being provided, simultaneously:

display the indication of the selected system device;

initiate display of the set of second control objects; and

display the control options for the selected system device.

13. A method of managing a plurality of system devices within a controlled environment, comprising:

presenting, on a user interface, a set of first control objects, each control object being associated with one or more system devices within the controlled environment;

selecting a system device for active user control in response to at least receipt of an activation signal associated with a control object from the set of first control objects;

populating the user interface with control options for the selected system device;

presenting, on the user interface simultaneously with the control options, a set of second control objects representing one or more affiliate system devices that are configured to provide an input to the selected system device, wherein presenting the set of second control objects is based on an automatic determination by a processing device that the one or more affiliate system devices are in a chain of system devices with the selected system device;

associating each control option with a sequence of executable commands that sends instructions to control at least one of operations or functions of the chain of system devices;

populating the user interface with control options for at least one of the one or more affiliate system devices in response to activation of a control object from the set of second control objects; and

associating each control option for the at least one of the one or more affiliate system devices with a sequence of executable commands that sends instructions to control at least one of the operations or the functions of the at least one of the one or more affiliate system devices.

14. The method of claim 13, further comprising:

populating the user interface with control options to link one of the one or more affiliate system devices to the selected system device and to hide the one of the one or more affiliate system devices from further view on the user interface.

15. The method of claim 13, wherein the set of first control objects represents a plurality of regions, each region including one or more system devices within the controlled environment;

and

wherein selecting the system device comprises;

selecting a region in response to receipt of an activation signal associated with a control object from the set of first control objects;

populating the user interface with a set of third control objects to represent available system devices within the selected region; and

selecting the system device in response to receipt of an activation signal associated with a control object from the set of third control objects.

16. The method of claim 13, wherein the set of first control objects represents a plurality of device types within the controlled environment;

and

wherein selecting the system device comprises;

selecting a device type in response to receipt of an activation signal associated with a control object from the set;

populating the user interface with a set of third control objects to represent available regions, each region including one or more system devices of a selected device type within the controlled environment; and

selecting the system device in response to receipt of an activation signal associated with a control object from the set of third control objects.

17. The method of claim 13, further comprising:

selecting one or more control objects from the set of first control objects to designate system devices;

presenting, on the user interface, a switch object that, when activated, executes a global command for the designated system devices; and

executing the global command to send instructions to alter an on-off state of the designated system devices.

18. The method of claim 13, further comprising:

selecting one or more control objects from the set of first control objects to designate a device type;

presenting, on the user interface, a switch object that, when activated, executes a global command for one or more system devices matching the device type; and

executing the global command to send instructions to alter an on-off state of the one or more system devices matching the device type.

19. The method of claim 13, further comprising at least one of:

performing;

selecting one or more control objects from the set of first control objects to designate a region within the controlled environment;

presenting, on the user interface, a switch object that, when activated, executes a global command for one or more system devices positioned within the region; and

executing the global command to send instructions to alter an on-off state of the one or more system devices positioned within the region;

or

performing;

selecting one or more control objects from the set of first control objects to designate system devices;

presenting, on the user interface, a switch object that, when activated, executes a global command for the designated system devices;

exempting from the global command at least one of one or more specified system devices, one or more system devices matching a specified device type, or one or more system devices positioned within a specified region within the controlled environment; and

executing the global command to send instructions to alter an on-off state of the designated system devices except for the exempted one or more system devices.

20. A computer program product comprising a computer useable memory, which is not a signal, having computer readable program code embedded in the memory for causing a processor-based system to manage a plurality of system devices within a controlled environment, the computer program product configured to perform operations comprising:

present, on a user interface, a set of first control objects, each control object being associated with one or more system devices within the controlled environment;

select a system device for active user control in response to at least receipt of an activation signal associated with a control object from the set of first control objects;

populate the user interface with control options for the selected system device in response to selecting the system device;

present, on the user interface simultaneously with the control options, a set of second control objects representing one or more affiliate system devices based on an automatic determination that the one or more affiliate system devices are child devices of the selected system device in a chain of system devices;

associate each control option with a sequence of executable commands that sends instructions to control at least one of operations or functions of the chain of system devices;

populate the user interface with control options for at least one of the one or more affiliate system devices in response to activation of a control object from the set of second control objects; and

associate each control option for the at least one of the one or more affiliate system devices with a sequence of executable commands that sends instructions to control at least one of the operations or the functions of the at least one of the one or more affiliate system devices.

21. The computer program product of claim 20, wherein the one or more affiliate system devices include at least one hidden affiliate system device, and

further comprising logic to not include at least one control object associated with the at least one hidden affiliate system device in the set of second control objects, which is presented on the user interface simultaneously with the control options, based on the at least one affiliate system device being at least one respective hidden affiliate system device.