System and Method for Managing Mixed Fleet Worksites Using Video and Audio Analytics
First Claim
1. A method comprising:
- receiving, by one or more processors, one or more models relating to a worksite or a fleet of machines at the worksite, wherein the fleet of machines comprises an in-network machine and an out-of-network machine;
receiving, by the one or more processors, first sensor data associated with the out-of-network machine at the worksite, the first sensor data comprising one or more of image data and audio data;
receiving, by the one or more processors, second sensor data associated with the in-network machine at the worksite;
determining, by the one or more processors, a machine state of each of the in-network machine and the out-of-network machine based at least on the first sensor data and the second sensor data;
comparing the determined machine states to a modeled machine state represented by the received one or more models to detect an irregularity in site operations or an inefficiency in site operations; and
generating a response based at least on the detected irregularity or inefficiency.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for managing and optimizing mixed fleet worksite operations based on video and or audio data are disclosed. One method includes receiving one or more models relating to a fleet of machines at the worksite, wherein the fleet of machines comprises an in-network machine and an out-of-network machine, receiving first sensor data associated with the out-of-network machine at the worksite, receiving second sensor data associated with the in-network machine at the worksite, determining a machine state of each of the in-network machine and the out-of-network machine based at least on the first sensor data and the second sensor data, comparing the determined machine states to a modeled machine state represented by the received one or more models to classify site operations and/or detect an irregularity in site operations or an inefficiency in site operations, and generating a response based at least on the detected irregularity or inefficiency.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving, by one or more processors, one or more models relating to a worksite or a fleet of machines at the worksite, wherein the fleet of machines comprises an in-network machine and an out-of-network machine; receiving, by the one or more processors, first sensor data associated with the out-of-network machine at the worksite, the first sensor data comprising one or more of image data and audio data; receiving, by the one or more processors, second sensor data associated with the in-network machine at the worksite; determining, by the one or more processors, a machine state of each of the in-network machine and the out-of-network machine based at least on the first sensor data and the second sensor data; comparing the determined machine states to a modeled machine state represented by the received one or more models to detect an irregularity in site operations or an inefficiency in site operations; and generating a response based at least on the detected irregularity or inefficiency. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising:
-
a processor; and a memory bearing instructions that, upon execution by the processor, cause the system at least to; receive one or more models relating to a worksite or a fleet of machines at the worksite, wherein the fleet of machines comprises an in-network machine and an out-of-network machine; receiving, by the one or more processors, first sensor data associated with the out-of-network machine at the worksite, the first sensor data comprising one or more of image data and audio data; receive second sensor data associated with the in-network machine at the worksite; determine a machine state of each of the in-network machine and the out-of-network machine based at least on the first sensor data and the second sensor data; and compare the determined machine states to a modeled machine state represented by the received one or more models to classify one or more site operations. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A computer readable storage medium bearing instructions that, upon execution by one or more processors, effectuate operations comprising:
-
receiving, by the one or more processors, one or more models relating to a worksite or a fleet of machines at the worksite, wherein the fleet of machines comprises an in-network machine and an out-of-network machine; receiving, by the one or more processors, first sensor data associated with the out-of-network machine at the worksite, the first sensor data comprising one or more of image data and audio data; receiving, by the one or more processors, second sensor data associated with the in-network machine at the worksite; determining, by the one or more processors, a machine state of each of the in-network machine and the out-of-network machine based at least on the first sensor data and the second sensor data; comparing the determined machine states to a modeled machine state represented by the received one or more models to detect an irregularity in site operations or an inefficiency in site operations; and generating a response based at least on the detected irregularity or inefficiency. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification