Graphical user interface and video frames for a sensor based detection system

• US 10,084,871 B2
• Filed: 03/03/2015
• Issued: 09/25/2018
• Est. Priority Date: 05/23/2013
• Status: Active Grant

• Current Assignee: Allied Telesis Holdings KK
• Original Assignee: Allied Telesis Holdings KK
• Inventors: Gallo, Joseph L., de Antoni, Ferdinand E. K., Gill, Scott, Stellick, Daniel
• Primary Examiner(s): Hossain, Moazzam
• Application Number:
  US14/637,168
• Publication Number:
  US 20150241993A1
• Time in Patent Office: 1,302 Days
• Field of Search: 702189
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

A system may include a sensor a visual capturing device, and a controller. The sensor may be configured to measure a value associated with an input. The visual capturing device may be configured to capture visual data. The controller may be configured to cause the measured value and the captured visual data to be rendered on a display device simultaneously.

Claims

1. A system comprising:

a sensor configured to measure a value associated with an input, wherein the sensor is further configured to time stamp the measured value;

a visual capturing device configured to capture visual data, wherein the visual capturing device is further configured to time stamp the captured visual data; and

a controller configured to cause the measured value and the captured visual data to be rendered on a display device simultaneously;

wherein the controller is further configured to store the measured value with the time stamp and the captured visual data with the time stamp;

wherein the controller is further configured to display a representation of the sensor on a geographical map, wherein the representation of the sensor on the map is positioned in its geo-positional location on the map based on global positioning system (GPS) coordinates of the sensor stored by the controller;

wherein the controller is further configured to display a representation of the visual capturing device on the map, wherein the representation of the visual capturing device on the map is positioned in its geo-positional location on the map based on GPS coordinates of the visual capturing device stored by the controller; and

wherein the controller is further configured to scroll through the stored measured value and captured visual data based on the time stamp on the display of the representation of the sensor and the visual capturing device on the map.

2. The system as described in claim 1, wherein the sensor is selected from a group consisting of thermal sensor, electromagnetic sensor, mechanical sensor, motion sensor, and biological/chemical sensor, and wherein the visual capturing device is associated with the sensor.

3. The system as described in claim 1, wherein the visual capturing device is selected from a group consisting of a camera and a video camera, and wherein the controller is further configured to display the measured value of the sensor and the captured visual data of the visual capturing device simultaneously upon selection by a user of the displayed representation of the sensor on the map.

4. The system as described in claim 1, wherein the controller is further configured to cause the measured value to be time stamped and stored in a storage medium for later retrieval, and wherein the controller is further configured to display a configuration state of the sensor, a last reset of the sensor, a duration of the state of the sensor, a name of the sensor, a sensor type, a closest sensor within proximity of the sensor, and a closest visual capturing device upon selection by a user of the displayed representation of the sensor on the map.

5. The system as described in claim 1, wherein the controller is further configured to determine whether the measured value satisfies a certain condition, wherein the sensor is configured to measure a plurality of values associated with the input, and wherein the visual capturing device is configured to capture a sequence of visual data associated with the plurality of values.

6. The system as described in claim 5, wherein the controller in response to determining that the measured value satisfies the certain condition causes the captured visual data to be time stamped and stored in a storage medium for later retrieval, wherein the sensor and the visual capturing device are within a same physical proximity, and wherein the captured visual data is associated with the measured value, and wherein the certain condition is at least one of:

the sensor reading exceeding a threshold and a group of sensor readings exceeding a threshold within a certain period.

7. The system as described in claim 1, wherein the controller is further configured to display the captured visual data associated with the measured value of the sensor based on a user selection of the sensor and an associated timestamp on the map.

8. The system as descried in claim 1, wherein the captured visual data is time stamped and stored in a storage medium for later retrieval responsive to a user selection to timestamp.

9. The system as described in claim 1, wherein the sensor and the visual capturing device are within a same physical proximity, and wherein the captured visual data is associated with the measured value, wherein the same physical proximity is at least one of:

within a line of sight, within a same room, and within a same building.

10. The system as described in claim 1, wherein the sensor is configured to measure a plurality of values associated with the input, and wherein the visual capturing device is configured to capture a sequence of visual data associated with the plurality of values, and wherein the controller is configured to cause the plurality of values and the sequence of visual data to be rendered on the display device simultaneously and scroll through in time responsive to user manipulation, and wherein the sequence of visual data is a video feed.

11. The system as described in claim 1, wherein the controller is further configured to display a color coding of the sensor on the map based on the value measured by the sensor, wherein the color coding provides a different color for each of:

a calibrating sensor, a normal reading from the sensor, an elevated sensor reading, a potential hazard sensor reading, and a hazard alert sensor reading.

12. A system comprising:

a plurality of sensors configured to measure values associated with inputs associated therewith, wherein the plurality of sensors are further configured to time stamp the measured values;

a plurality of visual capturing devices configured to capture visual data associated therewith, wherein a subset of the plurality of sensors is associated with a subset of the plurality of visual capturing devices, wherein the plurality of visual capturing devices are further configured to time stamp the captured visual data; and

a controller configured to cause measured values associated with the subset of the plurality of sensors that is further associated with captured visual data associated with the subset of the plurality of visual capturing devices to be simultaneously rendered on a display device;

wherein the controller is further configured to store the measured values with the time stamp and the captured visual data with the time stamp;

wherein the controller is further configured to display a representation of the plurality of sensors on a geographical map, wherein the locations of the plurality of sensors on the map are based on global positioning system (GPS) coordinates of the plurality of sensors stored by the controller;

wherein the controller is further configured to display a representation of the plurality of visual capturing devices on the map, wherein the locations of the plurality of visual capturing devices are based on GPS coordinates of the plurality of visual capturing devices stored by the controller; and

wherein the controller is further configured to scroll through the stored measured values and captured visual data based on the time stamp on the display of the representation of the plurality of sensors and the plurality of visual capturing devices on the map.

13. The system as described in claim 12, wherein the controller is further configured to display a path traveled by a material on the map based on the measured values of the plurality of sensors and the stored GPS coordinates of the plurality of sensors, and wherein the controller is further configured to display the measured value of the sensor and the captured visual data of the visual capturing device simultaneously upon selection by a user of the displayed representation of the sensor on the map.

14. The system as described in claim 12, wherein the subset of the plurality of sensors is associated with the subset of the plurality of visual capturing devices in response to heuristics.

15. The system as described in claim 14, wherein the heuristics is based on latitude and longitude of the subset of the plurality of sensors and further based on latitude and longitude of the subset of plurality of visual capturing devices, and wherein the heuristics is further based on whether the subset of the plurality of sensors and the subset of the plurality of visual capturing devices are within a same physical boundaries such that the subset of plurality of visual capturing devices is configured to provide visual queues associated with physical proximity of the subset of the plurality of sensors, and wherein the same physical boundaries are at least one of:

within a line of sight and within a same room.

16. The system as described in claim 12, wherein the subset of the plurality of sensors associated with the subset of the plurality of visual capturing devices share a similar geo-locational characteristic and are within a certain physical proximity of one another, and wherein the controller is further configured to display a configuration state of the sensor, a last reset of the sensor, a duration of the state of the sensor, a name of the sensor, a sensor type, a closest sensor within proximity of the sensor, and a closest visual capturing device upon selection by a user of the displayed representation of the sensor on the map.

17. The system as described in claim 12, wherein the controller is configured to cause the measured values associated with the subset of the plurality of sensors to be time stamped and stored, and wherein the controller is further configured to cause a subset of the captured visual data associated with the subset of the plurality of visual capturing devices to be time stamped and stored responsive to the measured values associated with the subset of the plurality of sensors satisfying a certain condition, and wherein the certain condition is at least one of:

the sensor reading exceeding a threshold and a group of sensor readings exceeding a threshold within a certain period.

18. A method comprising:

receiving a plurality of measured values from a plurality of sensors, wherein the plurality of sensors are configured to time stamp the plurality of measured values;

receiving a plurality of captured visual data from a plurality of visual capturing devices, wherein at least one of the plurality of visual capturing devices is associated with at least one of the sensors of the plurality of sensors, wherein the plurality of captured visual data is associated with the plurality of measured values, and wherein the plurality of visual capturing devices are further configured to time stamp the plurality of captured visual data; and

rendering the plurality of measured values and the plurality of captured visual data simultaneously on a graphical user interface;

storing the plurality of measured values with the time stamp and the plurality of captured visual data with the time stamp;

rendering a representation of the plurality of sensors on a geographical map of the GUI, wherein the locations of the plurality of sensors on the map are based on global positioning system (GPS) coordinates of the plurality of sensors;

rendering a representation of the plurality of visual capturing devices on the map of the GUI, wherein the locations of the plurality of visual capturing devices are based on GPS coordinates of the plurality of visual capturing devices; and

rendering a scroll through the stored measured values and captured visual data based on the time stamp on the display of the rendered representation of the plurality of sensors and the plurality of visual capturing devices on the map of the GUI.

19. The method as described in claim 18 further comprising:

scrolling in time through the plurality of measured values and the plurality of captured visual data simultaneously on the graphical user interface in response to a user interaction with the graphical user interface; and

rendering for each sensor of the plurality of sensors;

a configuration state, a last reset, a duration of the state, a name, a sensor type, a closest sensor within proximity, and a closest visual capturing device upon selection by a user of the displayed representation of the sensor on the map.

20. The method as described in claim 18, wherein the sensor and the visual capturing device are within a same physical boundaries such that the visual capturing device is configured to provide visual queues associated with physical proximity of the sensor, and wherein the same physical boundaries are at least one of:

within a line of sight, within a same room, and within a same building.

21. The method as described in claim 18 further comprising:

rendering a path traveled by a material on the map based on the measured values from the plurality of sensors and the GPS coordinates of the plurality of sensors; and

rendering the measured values of the plurality of sensors and the captured visual data of the visual capturing devices simultaneously upon selection by a user of the displayed representation of the sensor on the map.

22. The method as described in claim 18, wherein the representation of the plurality of sensors is color coded based on the measured values of each sensor of the plurality of sensors, wherein the color coding provides a different color for each of:

a calibrating sensor, a normal reading from the sensor, an elevated sensor reading, a potential hazard sensor reading, and a hazard alert sensor reading.