Automation system user interface with three-dimensional display

• US 10,522,026 B2
• Filed: 07/07/2016
• Issued: 12/31/2019
• Est. Priority Date: 08/11/2008
• Status: Active Grant

• Current Assignee: iControl Networks, Inc. (Comcast Corporation)
• Original Assignee: iControl Networks, Inc. (Comcast Corporation)
• Inventors: Sundermeyer, Ken, Dawes, Paul, Fulker, Jim
• Primary Examiner(s): Higa, Brendan Y
• Application Number:
  US15/204,662
• Publication Number:
  US 20170068419A1
• Time in Patent Office: 1,272 Days
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 25/003 Address allocation methods and details
• CPC Class Codes: G08B 25/007 Details of data content structure of message packets; data protocols
• CPC Class Codes: G08B 25/008 Alarm setting and unsetting, i.e. arming or disarming of the security system
• CPC Class Codes: G08B 25/009 Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: G08B 25/14 Central alarm receiver or annunciator arrangements
• CPC Class Codes: G08B 29/02 Monitoring continuously signalling or alarm systems
• CPC Class Codes: H04L 12/2809 indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/2818 from a device located outside both the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007
• CPC Class Codes: H04L 12/2823 Reporting information sensed by appliance or service execution status of appliance services in a home automation network device-related reporting H04L43/065; arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00
• CPC Class Codes: H04L 12/283 Processing of data at an internetworking point of a home automation network
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 2012/2843 Mains power line
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 63/029 Firewall traversal, e.g. tunnelling or, creating pinholes
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/166 at the transport layer
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04M 1/72403 : with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72415 : for remote control of appliances
• CPC Class Codes: H04W 4/33 : for indoor environments, e.g. buildings

Abstract

Systems and methods comprising a device including a processor coupled to a plurality of premises devices located at a premises. The device is configured to generate layout data comprising a layout of the premises including representations of premises devices on a floor plan configured to represent the premises. The layout data includes configuration data for each of the premises devices. The premises devices include at least one of a security device and a network device. The system includes a sensor user interface (SUI) application coupled to the device. The SUI application is remote to the device and configured to use the layout data to generate display elements comprising a three-dimensional (3D) representation of the floor plan and the premises devices. The floor plan layout visually and separately indicates a location and a state of the premises devices. The state includes current state and historical state.

Claims

1. A system comprising:

a device in communication with a plurality of premises devices located at a premises, wherein the device is configured to receive state data from a premises device of the plurality of premises devices, wherein the state data indicates a state of the premises device; and

a sensor user interface (SUI) configured for output, wherein the SUI comprises;

a layout portion that three-dimensionally (3D) indicates at least a portion of the premises, and

a device icon that indicates, based on the state data, the state of the premises device,

wherein a position of the device icon, relative to the layout portion, visually indicates a location of the premises device at the premises, and

wherein at least a first portion of the layout portion, proximate the device icon, visually indicates a historical state of the premises device.

2. The system of claim 1, wherein the SUI is caused to be output on a second device that is remote to the device.

3. The system of claim 1, wherein the SUI comprises a control interface configured to enable a user to provide control input to control the plurality of premises devices.

4. The system of claim 2, wherein the second device comprises at least one of a touchscreen device, a mobile telephone, a cellular telephone, a client device configured to cause output of the SUI via a mobile portal, and a client device configured to cause output of the SUI via a web portal.

5. The system of claim 1, wherein the layout portion indicates a plurality of floors presented simultaneously in a single 3D representation.

6. The system of claim 1, wherein the layout portion indicates a number of floors corresponding to the premises, and wherein the number of floors is presented simultaneously in a single 3D representation.

7. The system of claim 1, wherein the layout portion indicates at least one monitoring area associated with a premises device of the plurality of premises devices.

8. The system of claim 1, wherein the plurality of premises devices comprises at least one sensor.

9. The system of claim 8, wherein the at least one sensor comprises at least one of a security system sensor, door sensor, window sensor, glass break sensor, motion sensor, smoke detector, carbon monoxide detector, heat detector, fire detector, or flood sensor.

10. The system of claim 8, wherein a state of the at least one sensor comprises at least one of open, close, on, off, active, inactive, alarm, trouble, tamper, bypass, or low battery.

11. The system of claim 1, wherein the plurality of premises devices comprises at least one of a door lock or a door controller.

12. The system of claim 11, wherein a state of the at least one of a door lock or a door controller comprises at least one of open, close, lock, unlock, alarm, trouble, tamper, bypass, or low battery.

13. The system of claim 1, wherein the plurality of premises devices comprises one or more lights and a state of the one or more lights comprises at least one of on, off, dimmer level changes, or trouble.

14. The system of claim 1, wherein the plurality of premises devices comprises one or more thermostats and a state of the one or more thermostats comprises updates of at least one of heating, cooling, setpoint change, mode change, or low battery.

15. The system of claim 1, wherein the plurality of premises devices comprises one or more cameras.

16. The system of claim 15, wherein a state of the one or more cameras comprises updates of a camera motion sensor.

17. The system of claim 1, wherein the plurality of premises devices comprises at least one of a device actuator, light, thermostat, energy device, lock, door actuator, irrigation controller, window blind controller, electrical outlet, electrical switch, or ventilation controller.

18. The system of claim 1, wherein the device is configured with a plurality of premises rules configured to indicate, based on a layout of the premises, a type and a location in the premises of at least one of the plurality of premises devices.

19. The system of claim 1, wherein the position of the device icon relative to the layout portion is based on a manual user selection.

20. The system of claim 1, wherein the layout portion is based at least on one of a predefined floor plan template or manual user interaction with a drawing tool.

21. The system of claim 1, wherein the state of the premises device comprises at least one of an alarmed state, a tripped state, a tampered state, a low-battery state, an offline state, an unknown state, an installing state, an open state, a closed state, a motion state, a quiet state, an inactive state, a closed state, an untriggered state, or an untripped state.

22. The system of claim 1, wherein the device is configured to receive configuration data associated with the plurality of premises devices, and wherein the device icon is based at least in part on the configuration data.

23. The system of claim 22, wherein the device is configured to allow modification of data received from a database and indicating the layout portion, and wherein a modified version of the data indicating the layout portion is stored at the database.

24. The system of claim 1, wherein the device is configured to activate an edit mode, and wherein the edit mode is configured to at least one of generate and revise data indicating the layout portion.

25. The system of claim 24, wherein the edit mode is configured to edit the layout portion.

26. The system of claim 24, wherein the edit mode is configured to indicate the position of the device icon relative to the layout portion.

27. The system of claim 1, wherein the historical state of the premises device occurred within at least a portion of a prior, pre-specified period of time.

28. The system of claim 27, wherein the pre-specified period of time is selectable by a user.

29. The system of claim 1, wherein the device icon indicates a current state of the premises device.

30. The system of claim 1, wherein the device icon indicates the historical state of the premises device.

31. The system of claim 1, wherein a differential appearance of the first portion of the layout portion, relative to a second portion of the layout portion proximate the first portion of the layout portion, visually indicates the historical state.

32. The system of claim 1, wherein the first portion of the layout portion visually indicates the historical state based on an elapsed time since the historical state.

33. The system of claim 1, wherein the historical state is visually indicated by one or more degrees of transparency of the first portion of the layout portion.

34. The system of claim 33, wherein the one or more degrees of transparency increase according to an increase in an elapsed time since the historical state.

35. A method comprising:

receiving, from a premises device of a plurality of premises devices located at a premises and by a device, state data indicating a state of the premises device; and

causing output of a sensor user interface (SUI), wherein the SUI comprises;

a layout portion that three-dimensionally (3D) indicates at least a portion of the premises, and

a device icon that indicates, based on the state data, the state of the premises device,

wherein a position of the device icon, relative to the layout portion, visually indicates a location of the premises device at the premises, and

wherein at least a first portion of the layout portion, proximate the device icon, visually indicates a historical state of the premises device.

36. The method of claim 35, further comprising causing output of the SUI on a second device that is remote to the device.

37. The method of claim 35, wherein the SUI comprises a control interface configured to enable a user to provide control input to control the plurality of premises devices.

38. The method of claim 35, wherein the layout portion indicates a plurality of floors presented simultaneously in a single 3D representation.

39. The method of claim 35, wherein the layout portion indicates a number of floors corresponding to the premises, and wherein the number of floors is presented simultaneously in a single 3D representation.

40. The method of claim 35, wherein the layout portion indicates at least one monitoring area associated with the premises device of the plurality of premises devices.

41. The method of claim 35, wherein the plurality of premises devices comprises at least one sensor, and wherein a state of the at least one sensor comprises at least one of open, close, on, off, active, inactive, alarm, trouble, tamper, bypass, or low battery.

42. The method of claim 41, wherein the at least one sensor comprises at least one of a security system, sensor, door sensor, window sensor, glass break sensor, motion sensor, smoke detector, carbon monoxide detector, heat detector, fire detector, or flood sensor.

43. The method of claim 35, wherein the plurality of premises devices comprises at least one of door locks or door controllers, and wherein a state of the at least one of door locks and door controllers comprises at least one of open, close, lock, unlock, alarm, trouble, tamper, bypass, or low battery.

44. The method of claim 35, wherein the plurality of premises devices comprises one or more lights, and wherein a state of the one or more lights comprises at least one of on, off, dimmer level changes, or trouble.

45. The method of claim 35, wherein the plurality of premises devices comprises one or more cameras, and wherein a state of the one or more cameras comprises updates of a camera motion sensor.

46. The method of claim 35, wherein the device is configured with a plurality of premises rules configured to indicate, based on a layout of the premises, a type and a location in the premises of at least one of the plurality of premises devices.

47. The method of claim 35, wherein the position of the device icon relative to the layout portion is based on a manual user selection.

48. The method of claim 35, wherein the layout portion is based at least on one of a predefined floor plan template or manual user interaction with a drawing tool.

49. The method of claim 35, wherein the device icon is configured to include text outputted with the layout portion and indicating the state of the premises device.

50. The method of claim 35, wherein the state of the premises device comprises at least one of an alarmed state, a tripped state, a tampered state, a low-battery state, an offline state, an unknown state, an installing state, an open state, a closed state, a motion state, a quiet state, an inactive state, a closed state, an untriggered state, or an untripped state.

51. The method of claim 35, wherein the layout portion comprises a popup display configured to be displayed based on a touch of a corresponding device icon, and wherein the popup display is configured to display at least one of a name of the premises device, detailed information of the premises device, device state, or a link to information of the premises device corresponding to the device icon selected.

52. The method of claim 51, wherein the information of the premises device comprises at least one of live video from the premises device or a control screen comprising controls for the premises device.

53. The method of claim 35, further comprising:

receiving, by the device, configuration data associated with the plurality of premises devices; and

configuring, based on the configuration data, the device icon.

54. The method of claim 53, further comprising:

receiving, from a database and by the device, data indicating the layout portion;

modifying the data indicating the layout portion; and

sending, to the database and by the device, the modified data indicating the layout portion.

55. The method of claim 35, further comprising activating an edit mode, wherein the edit mode is configured to at least one of generate and revise data indicating the layout portion.

56. The method of claim 55, further comprising receiving input, via the edit mode, to indicate the position of the device icon relative to the layout portion.

57. The method of claim 35, wherein the historical state of the premises device occurred within at least a portion of a prior, pre-specified period of time.

58. The method of claim 57, wherein the pre-specified period of time is selectable by a user.

59. The method of claim 35, wherein the device icon indicates a current state of the premises device.

60. The method of claim 35, wherein the device icon indicates the historical state of the premises device.

61. The method of claim 35, wherein a differential appearance of the first portion of the layout portion, relative to a second portion of the layout portion proximate the first portion of the layout portion, visually indicates the historical state.

62. The method of claim 35, wherein the first portion of the layout portion visually indicates the historical state based on an elapsed time since the historical state.

63. The method of claim 35, wherein the historical state is visually indicated by one or more degrees of transparency of the first portion of the layout portion.

64. The method of claim 63, wherein the one or more degrees of transparency increase according to an increase in an elapsed time since the historical state.

65. A device comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the device to;

receive, from a premises device of a plurality of premises devices located at a premises, state data indicating a state of the premises device; and

cause output of a sensor user interface (SUI), wherein the SUI comprises;

a layout portion that three-dimensionally (3D) indicates at least a portion of the premises, and

a device icon that indicates, based on the state data, the state of the premises device,

wherein a position of the device icon, relative to the layout portion, visually indicates a location of the premises device at the premises, and

wherein at least a first portion of the layout portion, proximate the device icon, visually indicates a historical state of the premises device.

66. The device of claim 65, wherein the historical state of the premises device occurred within at least a portion of a prior, pre-specified period of time.

67. The device of claim 66, wherein the pre-specified period of time is selectable by a user.

68. The device of claim 65, wherein the device icon indicates a current state of the premises device.

69. The device of claim 65, wherein the device icon indicates the historical state of the premises device.

70. The device of claim 65, wherein a differential appearance of the first portion of the layout portion, relative to a second portion of the layout portion proximate the first portion of the layout portion, visually indicates the historical state.

71. The device of claim 65, wherein the first portion of the layout portion visually indicates the historical state based on an elapsed time since the historical state.

72. The device of claim 65, wherein the historical state is visually indicated by one or more degrees of transparency of the first portion of the layout portion.

73. The device of claim 72, wherein the one or more degrees of transparency increase according to an increase in an elapsed time since the historical state.

74. A non-transitory computer-readable medium storing instructions that, when executed, cause:

receiving, from a premises device of a plurality of premises devices located at a premises and by a device, state data indicating a state of the premises device; and

causing output of a sensor user interface (SUI), wherein the SUI comprises;

a layout portion that three-dimensionally (3D) indicates at least a portion of the premises, and

a device icon that indicates, based on the state data, the state of the premises device,

wherein a position of the device icon, relative to the layout portion, visually indicates a location of the premises device at the premises, and

wherein at least a first portion of the layout portion, proximate the device icon, visually indicates a historical state of the premises device.

75. The non-transitory computer-readable medium of claim 74, wherein the first portion of the layout portion visually indicates the historical state based on an elapsed time since the historical state.

76. The non-transitory computer-readable medium of claim 74, wherein the historical state is visually indicated by one or more degrees of transparency of the first portion of the layout portion.

77. The non-transitory computer-readable medium of claim 76, wherein the one or more degrees of transparency increase according to an increase in an elapsed time since the historical state.

78. The non-transitory computer-readable medium of claim 74, wherein the historical state of the premises device occurred within at least a portion of a prior, pre-specified period of time.

79. The non-transitory computer-readable medium of claim 78, wherein the pre-specified period of time is selectable by a user.