User interface to a device environment

• US 20030231212A1
• Filed: 06/18/2002
• Published: 12/18/2003
• Est. Priority Date: 06/18/2002
• Status: Abandoned Application

• Current Assignee: Bellsouth Intellectual Property Corporation (AT&T, Inc.)
• Original Assignee: Bellsouth Intellectual Property Corporation (AT&T, Inc.)
• Inventors: Kreiner, Barrett, Olsson, Stefan, Slemmer, John B., Jarboe, Andre, Kleinfelter, Kevin
• Application Number:
  US10/175,483
• Publication Number:
  US 20030231212A1
• Time in Patent Office: Days
• US Class Current: 715/771
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/2807 Exchanging configuration information on appliance services in a home automation network arrangements for maintenance or administration involving network analysis for automatically determining the actual topology of a network H04L41/12; hardware or software tools for network management using graphical user interfaces H04L41/22; address allocation H04L61/50
• CPC Class Codes: H04L 12/2809 indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/2814 Exchanging control software or macros for controlling appliance services in a home automation network arrangements for maintenance or administration involving configuration of the network and network elements H04L41/08
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 2012/2845 Telephone line
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 2012/285 Generic home appliances, e.g. refrigerators
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

Devices and methods are disclosed for a user interface permitting interaction directly between a user and devices of a device environment. A user interface device includes a display screen and memory storing representations of devices, their functions, and interaction rules. A processor displays the representations of devices and functions with connections shown between the representations on the screen to visually present the interaction rules. Choices may be provided through a user interface for user initiated learning in the environment so the user may initiate state changes on the devices themselves to produce the interaction rule. Additionally, the user may create a rule by selecting representations of devices and their functions on the screen to associate a function of one device with a function of another device. Also, a choice of device to query for information may be displayed on the screen, and the queried information is displayed once received.

Claims

1. A method of establishing device interaction rules for an environment having a plurality of devices where each device performs one or more unique functions within the environment, the method comprising:

providing a choice to initiate learning of a first portion of an interaction rule;

receiving a user selection of the choice to learn a first portion of the interaction rule;

after receiving the user selection of the choice to learn the first portion of the interaction rule, receiving a user selection of a first function choice at a first device;

providing a choice to initiate learning a second portion of the interaction rule;

after receiving the user selection of the choice at the first device, receiving a user selection of the choice to learn the second portion of the interaction rule;

after receiving the user selection of the choice to learn the second portion of the interaction rule, receiving a user selection of a second function choice at a second device; and

associating the first function choice with the second function choice to create the interaction rule.

2. The method of claim 1, wherein providing a choice to initiate learning of the first portion comprises providing a display screen showing a first icon representing the choice to initiate learning of the first portion and wherein providing a choice to initiate learning of the second portion comprises showing on the display screen a second icon representing the choice to initiate learning of the second portion.

3. The method of claim 1, further comprising:

receiving a message from the first device indicating that the first function choice has been selected; and

receiving a message from the second device indicating that the second function choice has been selected.

4. The method of claim 1, wherein associating the first function choice with the second function choice comprises storing in memory an instruction for sending a message to the first device indicating the first function choice should occur and the instruction indicating that the message is sent to the first device when a message from the second device is received that indicates that the second function choice has been selected.

5. The method of claim 1, wherein associating the first function choice with the second function choice comprises storing in memory an instruction for sending a message to the second device indicating the second function choice should occur and the instruction indicating that the message is sent to the second device when a message from the first device is received that indicates that the first function choice has been selected.

6. The method of claim 1, further comprising displaying the created interaction rule on a display screen, the created interaction rule comprising a representation of the first device and a representation of the second device and a connection therebetween.

7. A method of establishing device interaction for an environment having a plurality of devices where each device performs one or more unique functions within the environment, the method comprising:

displaying on a screen a choice of devices of the environment;

receiving a user selection of a first device from the choice of devices;

sending a message to the first device to query the first device for information in response to the user selection;

receiving the message at the first device and sending a response containing the requested information;

receiving the response from the first device; and

displaying information from the response on the screen.

8. The method of claim 7, wherein the information comprises a current status of the first device.

9. The method of claim 7, wherein the information comprises device interaction rules stored by the first device and wherein displaying information comprising device interaction rules comprises displaying a representation of the first device and a representation of a second device with a connector displayed between the representation of the first device and the representation of the second device.

10. A method of establishing device interaction rules for an environment having a plurality of devices where each device performs one or more unique functions within the environment, the method comprising:

displaying on a screen representations of the devices of the environment;

receiving a user selection of a first device representation;

displaying on the screen representations of functions of the first device;

receiving a user selection of a function representation of the first device;

receiving a user selection of a second device representation;

displaying on the screen representations of functions of the second device;

receiving a user selection of a function representation of the second device; and

associating the selected function of the first device with the selected function of the second device to create an interaction rule.

11. The method of claim 10, wherein the representations of functions that are common to two or more of the devices are the same.

12. The method of claim 11, wherein a representation of a power on/off function is common to the first device and the second device and wherein the representations of power on/off for the first device and for the second device appear as a circle.

13. The method of claim 10, further comprising displaying on the screen a representation of the interaction rule that is created.

14. The method of claim 13, wherein the representation of the rule comprises the representation of the first device displayed proximal to the function representation of the first device and the representation of the second device displayed proximal to the function representation of the second device with a connector displayed between the representation of the first device and the representation of the second device.

15. The method of claim 10, wherein the display screen is divided into a device portion and a workspace portion, and wherein receiving a user selection of a representation of a device comprises the user dragging the representation of the device from the device portion to the workspace portion of the display screen.

16. A display device for establishing device interaction in an environment having a plurality of devices where each device performs one or more unique functions within the environment with the one or more functions of each device being associated with various states, the display device comprising:

a display screen;

a memory that stores information about devices of the environment, the information including representations of each device, function representations of each device, and the interactions rules for the environment; and

a processor in communication with the display screen and memory, the processor being configured to display on the display screen one or more of the representations of devices, one or more of the function representations, and one or more of the interaction rules that are comprised of connections displayed between the representations of devices and functions involved in the interaction rule.

17. The display device of claim 16, wherein the processor is further configured to recognize the introduction of a new device to the environment, query the new device for information including the representation of the device and the function representations of the device, and add the information for the new device in memory.

18. The display device of claim 16, wherein the processor is further configured to receive user selections of representations of devices and function representations of each device to create interactions rules.

19. The display device of claim 18, wherein the processor is further configured to display the representations of the devices in a device portion of the display screen and display a workspace portion and wherein users drag the representations of devices to the workspace portion from the device portion to create interaction rules.

20. The display device of claim 16, wherein the processor is further configured to display identical function representations for functions that are common to two or more devices.