Platform for gathering real-time analysis

• US 10,382,300 B2
• Filed: 10/06/2016
• Issued: 08/13/2019
• Est. Priority Date: 10/06/2015
• Status: Active Grant

• Current Assignee: Evolv Technologies Incorporated (Evolv Technologies Holdings, Inc.)
• Original Assignee: Evolv Technologies Incorporated (Evolv Technologies Holdings, Inc.)
• Inventors: Ellenbogen, Michael, McCord, M. Brendan, Knoth, Brian, Wolfe, Brandon
• Primary Examiner(s): Rahman, S M A
• Application Number:
  US15/287,604
• Publication Number:
  US 20170099200A1
• Time in Patent Office: 1,041 Days
• Field of Search: 709224
• CPC Class Codes: G06F 18/2414 Smoothing the distance, e.g. radial basis function networks [RBFN]
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06N 3/10 Interfaces, programming languages or software development kits, e.g. for simulating neural networks
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G06N 5/025 Extracting rules from data
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G06N 7/06 Simulation on general purpose computers
• CPC Class Codes: G06V 10/454 Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/82 using neural networks
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Data is received characterizing a request for agent computation of sensor data. The request includes a required confidence and required latency for completion of the agent computation. Agents to query are determined based on the required confidence. Data is transmitted to query the determined agents to provide analysis of the sensor data. Related apparatus, systems, techniques, and articles are also described.

Claims

1. A method comprising:

receiving data characterizing a request for agent computation of sensor data, the request including a required confidence that a result of the agent computation is correct and a required latency for the agent computation to return the result;

determining agents to query based on the required confidence and the required latency, the determining further based on a predetermined probability that a given agent responds correctly, a number of agents responding to the query, and a predetermined probability that agents disagree in the result, wherein the agents include human agents; and

transmitting data to clients associated with the determined agents to query the determined agents to provide analysis of the sensor data.

2. The method of claim 1, wherein the determining agents is further based on at least one of a measure of quality, a measure of expected agent latency, and proximity to average completion time for a current task.

3. The method of claim 1, further comprising:

receiving data characterizing query results from a plurality of the determined agents; and

transmitting data to query additional agents to achieve the required confidence when two or more of the received query results are inconsistent.

4. The method of claim 3, further comprising:

determining a number of the additional agents to query to achieve the required confidence.

5. The method of claim 3, further comprising:

determining quality of available agents in a pool of agents; and

determining a minimum quality required of a to-be-queried agent to achieve the required confidence.

6. The method of claim 1, further comprising:

determining a measure of quality for agents in a pool of agents.

7. The method of claim 6, wherein the measure of quality is determined as a ratio of a number of query responses deemed correct to a number of total queries.

8. The method of claim 1, further comprising:

determining a measure of expected latency for agents in a pool of agents;

the measure of expected latency determined as a Poisson process.

9. The method of claim 1, wherein the expected latency is less than 30 seconds.

10. The method of claim 1, wherein the agent computation is defined by a question with at least two predefined answers.

11. The method of claim 1, wherein at least one of the receiving, determining, and transmitting is performed by at least one data processor forming part of at least one computing system.

12. The method of claim 1, wherein the sensor data of a security system asset that is an imaging device, a video camera, a still camera, a radar imaging device, a microphone, a chemical sensor, an acoustic sensor, a radiation sensor, a thermal sensor, a pressure sensor, a force sensor, or a proximity sensor.

13. The method of claim 1, wherein the sensor data includes an image including a single image, a series of images, or a video;

and the computational task includes;

detecting a pattern in the image;

detecting a presence of an object within the image;

detecting a presence of a person within the image;

detecting intrusion of the object or person within a region of the image;

detecting suspicious behavior of the person within the image;

detecting an activity of the person within the image;

detecting an object carried by the person, detecting a trajectory of the object or the person in the image;

a status of the object or person in the image;

identifying whether a person who is detected is on a watch list;

determining whether a person or object has loitered for a certain amount of time;

detecting interaction among person or objects;

tracking a person or object;

determining status of a scene or environment;

determining the sentiment of one or more people;

counting the number of objects or people;

determining whether a person appears to be lost;

determining whether an event is normal or abnormal; and

/or

determining whether text matches that in a database.

14. A non-transitory computer program product which, when executed by at least one data processor forming part of at least one computer, result in operations comprising:

receiving data characterizing a request for agent computation of sensor data, the request including a required confidence that a result of the agent computation is correct and a required latency for the agent computation to return the result;

determining agents to query based on the required confidence and the required latency, the determining further based on a predetermined probability that a given agent responds correctly, a number of agents responding to the query, and a predetermined probability that agents disagree in the result, wherein the agents include human agents; and

transmitting data to clients associated with the determined agents to query the determined agents to provide analysis of the sensor data.

15. The computer program product of claim 14, wherein determining agents is further based on at least one of a measure of agent quality, a measure of expected agent latency, and proximity to average completion time for a current task.

16. The computer program product of claim 14, further comprising:

receiving data characterizing query results from a plurality of the determined agents; and

transmitting data to query additional agents to achieve the required confidence when two or more of the received query results are inconsistent.

17. The computer program product of claim 14, further comprising:

determining the measure of quality for agents in a pool of agents.

18. The computer program product of claim 14, wherein the expected latency is less than 30 seconds.

19. A system comprising:

means for receiving data characterizing a request for agent computation of sensor data, the request including a required confidence that a result of the agent computation is correct and a required latency for the agent computation to return the result;

means for determining agents to query based on the required confidence and the required latency, the determining further based on a predetermined probability that a given agent responds correctly, a number of agents responding to the query, and a predetermined probability that agents disagree in the result, wherein the agents include human agents; and

means for transmitting data to clients associated with the determined agents to query the determined agents to provide analysis of the sensor data.

20. The system of claim 19, wherein determining agents is further based on at least one of a measure of agent quality, a measure of expected agent latency, and proximity to average completion time for a current task.

21. The system of claim 19, further comprising:

means for receiving data characterizing query results from a plurality of the determined agents; and

means for transmitting data to query additional agents to achieve the required confidence when two or more of the received query results are inconsistent.

22. The system of claim 21, further comprising:

means for determining quality of available agents in a pool of agents; and

means for determining a minimum quality required of a to-be-queried agent to achieve the required confidence.

23. The system of claim 19, further comprising:

means for determining the measure of quality for agents in a pool of agents.