MOBILE APPLICATION FOR MONITORING AND CONTROLLING DEVICES

• US 20140245160A1
• Filed: 02/21/2014
• Published: 08/28/2014
• Est. Priority Date: 02/22/2013
• Status: Abandoned Application

• Current Assignee: Ubiquiti Networks, Inc. (Ubiquiti Inc.)
• Original Assignee: Ubiquiti Networks, Inc. (Ubiquiti Inc.)
• Inventors: Frei, Randall W., Bauer, Jonathan G., McConachie, Christopher
• Application Number:
  US14/187,105
• Publication Number:
  US 20140245160A1
• Time in Patent Office: Days
• US Class Current: 715/736
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/41 Remote control of gateways
• CPC Class Codes: G08C 2201/42 Transmitting or receiving remote control signals via a network
• CPC Class Codes: G08C 2201/91 Remote control based on location and proximity
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]

Abstract

A sensor-monitoring application can execute on a mobile device, tablet computer, or other portable device, and facilitates controlling sensors and navigating through sensor data either directly or via a sensor-managing service. A user can monitor feedback from a variety of sensors, such as a motion sensor, a temperature sensor, a door sensor, an electrical sensor. The user may interact with the application'"'"'s user interface to control and synchronize various sensors, controllers, power switches wirelessly. The user can also control devices, such as by sending a command to a device via an electronic port, or by enabling, disabling, or adjusting a power output from a power outlet that provides power to a device (e.g., to a light fixture).

Claims

1. A method for monitoring sensor data, the method comprising:

presenting a user interface (UI) comprising a first UI element that includes a listing of one or more electronic devices;

receiving a selection for a first device listed in the first UI element; and

responsive to receiving the selection for the first device, presenting a second UI element that indicates at least a sensor measurement for the first device and a location of the first device.

2. The method of claim 1, further comprising:

updating the first UI element, in real-time, to include recent information for sensors listed in the first UI element.

3. The method of claim 1, wherein presenting the second UI element involves presenting an animation that slides the second UI element from a right edge of the user interface.

4. The method of claim 1, wherein the second UI element also includes one or more of:

a name for a corresponding device;

a status icon that illustrates a state of the device;

a power button for enabling or disabling the device;

a sensor snapshot that indicates information received from the device;

a visual representation of a space at which the device is deployed; and

a graph visualization that illustrates device states for a determinable time range.

5. The method of claim 1, further comprising:

receiving a selection for a second device listed in the first UI element, while presenting the second UI element; and

updating the second UI element to include information associated with the second device, without removing the second UI element.

6. The method of claim 1, further comprising presenting a space-visualizing UI element that illustrates a visual representation for a physical space, and illustrates device icons for one or more devices deployed in the physical space.

7. The method of claim 6, wherein the visual representation for the physical space includes a live image freed from a pan-tilt camera, and wherein the method further comprises:

determining that the image from the pan-tilt camera has shifted; and

adjusting a position for a device icon on the space-visualizing UI element to account for the image shift.

8. The method of claim 6, wherein the space-visualizing UI element includes an augmented-reality user interface, wherein the visual representation for the physical space includes a live image feed from a portable computing device, and wherein the method further comprises:

determining a position and orientation for the portable computing device;

determining one or more devices located in front of an image sensor of the portable computing device; and

overlaying device icons for the one or more devices over the visual representation.

9. The method of claim 6, wherein a respective device icon includes illustrations for one or more of:

a name for the corresponding device;

a sensor measurement;

a gauge to illustrate a magnitude of the sensor measurement; and

a sensor indicator to illustrate a sensor type.

10. The method of claim 6, wherein the space-visualizing UI element includes a screen-maximize button, and wherein the method further comprises:

determining that a user has selected the screen-maximize button; and

expanding the space-visualizing UI element to occupy the user interface.

11. The method of claim 10, wherein expanding involves sliding the space-visualizing UI element from a right side of the user interface.

12. The method of claim 10, wherein the expanded space-visualizing UI element also includes a camera icon for capturing an image to use as the visual representation of the physical space, and wherein the method further comprises:

responsive to the user selecting the camera icon, providing the user with a camera user interface for capturing a picture using an image sensor; and

responsive to the user capturing an image, using the captured image as the visual representation of the physical space.

13. The method of claim 10, wherein the expanded space-visualizing UI element also includes a side-panel user interface comprising a set of device icons provisioned devices, and wherein the method further comprises:

allowing a user to drag a device icon for a provisioned device to a desired position of the visual representation; and

communicating the placement position of the provisioned device to a central controller that manages the provisioned devices.

14. The method of claim 10, wherein the expanded space-visualizing UI element includes a screen-minimize button, and wherein the method further comprises:

determining that a user has selected the screen-minimize button; and

minimizing the space-visualizing UI element to reveal the first UI element.

15. The method of claim 14, wherein minimizing involves sliding the space-visualizing UI element toward a right side of the user interface.

16. The method of claim 6, wherein presenting the second UI element involves overlaying the second UI element over the third UI element.

17. The method of claim 16, wherein updating the second UI element involves scrolling a space-view image, which presents a visual representation of a space, to reveal a location associated with the second device.

18. The method of claim 1, wherein the first UI element further includes a space-indicating UI element that includes a label for a physical space.

19. The method of claim 18, further comprising:

determining that a user has selected the space-indicating UI element; and

displaying a space-listing menu that includes a list of physical spaces associated with one or more deployed devices.

20. The method of claim 19, further comprising:

determining that a user has selected a physical space from the space-listing menu;

updating the first UI element to include a listing of devices associated with the selected physical space; and

updating a space-visualizing UI element to illustrate a visual representation for the selected physical space, and to illustrate device icons for the devices associated with the physical space.

21. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for monitoring sensor data, the method comprising:

presenting a user interface (UI) comprising a first UI element that includes a listing of one or more electronic devices;

receiving a selection for a first device listed in the first UI element; and

responsive to receiving the selection for the first device, presenting a second UI element that indicates at least a sensor measurement for the first device and a location of the first device.

22. The storage medium of claim 21, wherein the method further comprises:

updating the first UI element, in real-time, to include recent information for sensors listed in the first UI element.

23. The storage medium of claim 21, wherein presenting the second UI element involves presenting an animation that slides the second UI element from a right edge of the user interface.

24. The storage medium of claim 21, wherein the second UI element also includes one or more of:

a name for a corresponding device;

a status icon that illustrates a state of the device;

a power button for enabling or disabling the device;

a sensor snapshot that indicates information received from the device;

a visual representation of a space at which the device is deployed; and

a graph visualization that illustrates device states for a determinable time range.

25. The storage medium of claim 21, wherein the method further comprises:

receiving a selection for a second device listed in the first UI element, while presenting the second UI element; and

updating the second UI element to include information associated with the second device, without removing the second UI element.

26. The storage medium of claim 21, wherein the method further comprises presenting a space-visualizing UI element that illustrates a visual representation for a physical space, and illustrates device icons for one or more devices deployed in the physical space.

27. The storage medium of claim 26, wherein the visual representation for the physical space includes a live image freed from a pan-tilt camera, and wherein the method further comprises:

determining that the image from the pan-tilt camera has shifted; and

adjusting a position for a device icon on the space-visualizing UI element to account for the image shift.

28. The storage medium of claim 26, wherein the space-visualizing UI element includes an augmented-reality user interface, wherein the visual representation for the physical space includes a live image feed from a portable computing device, and wherein the method further comprises:

determining a position and orientation for the portable computing device;

determining one or more devices located in front of an image sensor of the portable computing device; and

overlaying device icons for the one or more devices over the visual representation.

29. The storage medium of claim 26, wherein a respective device icon includes illustrations for one or more of:

a name for the corresponding device;

a sensor measurement;

a gauge to illustrate a magnitude of the sensor measurement; and

a sensor indicator to illustrate a sensor type.

30. The storage medium of claim 26, wherein the space-visualizing UI element includes a screen-maximize button, and wherein the method further comprises:

determining that a user has selected the screen-maximize button; and

expanding the space-visualizing UI element to occupy the user interface.

31. The storage medium of claim 30, wherein expanding involves sliding the space-visualizing UI element from a right side of the user interface.

32. The storage medium of claim 30, wherein the expanded space-visualizing UI element also includes a camera icon for capturing an image to use as the visual representation of the physical space, and wherein the method further comprises:

responsive to the user selecting the camera icon, providing the user with a camera user interface for capturing a picture using an image sensor; and

responsive to the user capturing an image, using the captured image as the visual representation of the physical space.

33. The storage medium of claim 30, wherein the expanded space-visualizing UI element also includes a side-panel user interface comprising a set of device icons provisioned devices, and wherein the method further comprises:

allowing a user to drag a device icon for a provisioned device to a desired position of the visual representation; and

communicating the placement position of the provisioned device to a central controller that manages the provisioned devices.

34. The storage medium of claim 30, wherein the expanded space-visualizing UI element includes a screen-minimize button, and wherein the method further comprises:

determining that a user has selected the screen-minimize button; and

minimizing the space-visualizing UI element to reveal the first UI element.

35. The storage medium of claim 34, wherein minimizing involves sliding the space-visualizing UI element toward a right side of the user interface.

36. The storage medium of claim 26, wherein presenting the second UI element involves overlaying the second UI element over the third UI element.

37. The storage medium of claim 36, wherein updating the second UI element involves scrolling a space-view image, which presents a visual representation of a space, to reveal a location associated with the second device.

38. The storage medium of claim 21, wherein the first UI element further includes a space-indicating UI element that includes a label for a physical space.

39. The storage medium of claim 38, wherein the method further comprises:

determining that a user has selected the space-indicating UI element; and

displaying a space-listing menu that includes a list of physical spaces associated with one or more deployed devices.

40. The storage medium of claim 39, wherein the method further comprises:

determining that a user has selected a physical space from the space-listing menu;

updating the first UI element to include a listing of devices associated with the selected physical space; and

updating a space-visualizing UI element to illustrate a visual representation for the selected physical space, and to illustrate device icons for the devices associated with the physical space.

41. An apparatus for monitoring sensor data, the method comprising:

a display device;

a processor;

a memory;

a presenting module to present, on the display device, a user interface (UI) comprising a first UI element that includes a listing of one or more electronic devices;

an input module to receive a user input that includes a selection for a first device listed in the first UI element; and

wherein responsive to receiving the selection for the first device, the presenting module is further configured to present a second UI element that indicates at least a sensor measurement for the first device and a location of the first device.

42. The apparatus of claim 41, wherein the presenting module is further configured to:

update the first UI element, in real-time, to include recent information for sensors listed in the first UI element.

43. The apparatus of claim 41, wherein presenting the second UI element involves presenting an animation that slides the second UI element from a right edge of the user interface.

44. The apparatus of claim 41, wherein the second UI element also includes one or more of:

a name for a corresponding device;

a status icon that illustrates a state of the device;

a power button for enabling or disabling the device;

a sensor snapshot that indicates information received from the device;

a visual representation of a space at which the device is deployed; and

a graph visualization that illustrates device states for a determinable time range.

45. The apparatus of claim 41, wherein the input module is further configured to receive a selection for a second device listed in the first UI element, while presenting the second UI element;

and

wherein the presenting module is further configured to update the second UI element to include information associated with the second device, without removing the second UI element.

46. The apparatus of claim 41, wherein the presenting module is further configured to present a space-visualizing UI element that illustrates a visual representation for a physical space, and illustrates device icons for one or more devices deployed in the physical space.

47. The apparatus of claim 46, wherein the visual representation for the physical space includes a live image freed from a pan-tilt camera, and wherein the apparatus further comprises a space-updating module to:

determine that the image from the pan-tilt camera has shifted; and

adjust a position for a device icon on the space-visualizing UI element to account for the image shift.

48. The apparatus of claim 46, wherein the space-visualizing UI element includes an augmented-reality user interface, wherein the visual representation for the physical space includes a live image feed from a portable computing device, and wherein the apparatus further comprises a space-updating module to:

determine a position and orientation for the portable computing device;

determine one or more devices located in front of an image sensor of the portable computing device; and

overlay device icons for the one or more devices over the visual representation.

49. The apparatus of claim 46, wherein a respective device icon includes illustrations for one or more of:

a name for the corresponding device;

a sensor measurement;

a gauge to illustrate a magnitude of the sensor measurement; and

a sensor indicator to illustrate a sensor type.

50. The apparatus of claim 46, wherein the space-visualizing UI element includes a screen-maximize button;

wherein the input module is further configured to determine when a user has selected the screen-maximize button; and

wherein the presenting module is further configured to expand the space-visualizing UI element to occupy the user interface.

51. The apparatus of claim 50, wherein expanding involves sliding the space-visualizing UI element from a right side of the user interface.

52. The apparatus of claim 50, wherein the expanded space-visualizing UI element also includes a camera icon for capturing an image to use as the visual representation of the physical space, and wherein the presenting module is further configured to:

provide the user with a camera user interface for capturing a picture using an image sensor responsive to the user selecting the camera icon; and

use the captured image as the visual representation of the physical space responsive to the user capturing an image.

53. The apparatus of claim 50, wherein the expanded space-visualizing UI element also includes a side-panel user interface comprising a set of device icons provisioned devices;

wherein the input module is further configured to receive a user input that drags a device icon for a provisioned device to a desired position of the visual representation; and

wherein the apparatus further comprises a communication module to communicate the placement position of the provisioned device to a central controller that manages the provisioned devices.

54. The apparatus of claim 50, wherein the expanded space-visualizing UI element includes a screen-minimize button;

wherein the input module is further configured to receive a user input that selects the screen-minimize button; and

wherein the presenting module is further configured to minimize the space-visualizing UI element to reveal the first UI element.

55. The apparatus of claim 54, wherein minimizing involves sliding the space-visualizing UI element toward a right side of the user interface.

56. The apparatus of claim 46, wherein presenting the second UI element involves overlaying the second UI element over the third UI element.

57. The apparatus of claim 56, wherein updating the second UI element involves scrolling a space-view image, which presents a visual representation of a space, to reveal a location associated with the second device.

58. The apparatus of claim 41, wherein the first UI element further includes a space-indicating UI element that includes a label for a physical space.

59. The apparatus of claim 58, wherein the input module is further configured to receive a user input that selects the space-indicating UI element;

and

wherein the presenting module is further configured to display a space-listing menu that includes a list of physical spaces associated with one or more deployed devices.

60. The apparatus of claim 59, wherein the input module is further configured to receive a user input that selects a physical space from the space-listing menu;

and

wherein the presenting module is further configured to;

update the first UI element to include a listing of devices associated with the selected physical space; and

update a space-visualizing UI element to illustrate a visual representation for the selected physical space, and to illustrate device icons for the devices associated with the physical space.