Video content analysis system and method for transportation system
First Claim
1. A method for processing data from a mobile asset comprising:
- receiving, using a video analytics system onboard the mobile asset, data based on at least one data signal from at least one of;
at least one data source onboard the mobile asset, comprising at least one of a mobile asset data component, at least one microphone, at least one fixed camera, and at least one 360 degree camera; and
at least one data source remote from the mobile asset, comprising at least one of a weather component, a route, a manifest, and geographic information system information received from a geographic information system (GIS), and a remote data repository;
processing, using an artificial intelligence component of the video analytics system, the data into processed data;
sending, using the video analytics system, at least one of the data and the processed data to a data recorder onboard the mobile asset;
encoding, using a data encoder of the data recorder, a first record based on the processed data; and
storing, using an onboard data manager of the data recorder, at least one of the data, the processed data, and the first record at a configurable first predetermined rate in at least one local memory of the data recorder, wherein the first predetermined rate is greater than zero seconds and up to five minutes.
2 Assignments
0 Petitions
Accused Products
Abstract
A video content analysis system for mobile assets that includes track detection and infrastructure monitoring component. The track detection and infrastructure monitoring includes a reinforcement learning component, an object detection and location component, and an obstruction detection component to analyze video data, audio data, vehicle data, weather data, and route/manifest data to determine internal and/or external conditions relating to an the asset. A data acquisition and recording system uploads the data, internal and/or external condition information, object detection information, object location information, and obstruction detection information to a remote memory module and provides streaming video data in real-time to a remotely located user. Remotely located users can view the data in various view modes through a web browser or virtual reality device, which provides for quicker emergency response, validates the effectiveness of repairs and rerouting, and monitors crew performance and safety.
-
Citations
18 Claims
-
1. A method for processing data from a mobile asset comprising:
-
receiving, using a video analytics system onboard the mobile asset, data based on at least one data signal from at least one of; at least one data source onboard the mobile asset, comprising at least one of a mobile asset data component, at least one microphone, at least one fixed camera, and at least one 360 degree camera; and at least one data source remote from the mobile asset, comprising at least one of a weather component, a route, a manifest, and geographic information system information received from a geographic information system (GIS), and a remote data repository; processing, using an artificial intelligence component of the video analytics system, the data into processed data; sending, using the video analytics system, at least one of the data and the processed data to a data recorder onboard the mobile asset; encoding, using a data encoder of the data recorder, a first record based on the processed data; and storing, using an onboard data manager of the data recorder, at least one of the data, the processed data, and the first record at a configurable first predetermined rate in at least one local memory of the data recorder, wherein the first predetermined rate is greater than zero seconds and up to five minutes. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for processing data from a mobile asset comprising:
-
receiving, using a video analytics system onboard the mobile asset, data based on at least one data signal from at least one of; at least one data source onboard the mobile asset, comprising at least one of mobile asset data component, at least one microphone, at least one fixed camera, and at least one 360 degree camera; and at least one data source remote from the mobile asset, comprising at least one of a weather component, a route, a manifest, and geographic information system information received from a geographic information system (GIS), and a remote data repository; processing, using an artificial intelligence component of the video analytics system, the data into processed data; sending, using the video analytics system, at least one of the data and the processed data to a data recorder onboard the mobile asset; encoding, using a data encoder of the data recorder, a first record based on the processed data; storing, using an onboard data manager of the data recorder, at least one of the data, the processed data, and the first record at a configurable first predetermined rate in at least one local memory of the data recorder; and the first predetermined rate is configurable between zero seconds and five minutes, wherein at least one of the data, the processed data, and the first record is stored continuously in the at least one local memory of the data recorder on a first condition that the first predetermined rate is zero seconds and at least one of the data, the processed data, and the first record is stored in specified time intervals based on the first predetermined rate in the at least one local memory of the data recorder on a second condition that the first predetermined rate is greater than zero seconds and up to five minutes.
-
-
12. A method for processing data from a mobile asset comprising:
-
receiving, using a video analytics system onboard the mobile asset, data based on at least one data signal from at least one of; at least one data source onboard the mobile asset, comprising at least one of mobile asset data component, at least one microphone, at least one fixed camera, and at least one 360 degree camera; and at least one data source remote from the mobile asset, comprising at least one of a weather component, a route, a manifest, and geographic information system Information received from a geographic information system (GIS), and a remote data repository; processing, using an artificial intelligence component of the video analytics system, the data Into processed data; sending, using the video analytics system, at least one of the data and the processed data to a data recorder onboard the mobile asset; encoding, using a data encoder of the data recorder, a first record based on the processed data; storing, using an onboard data manager of the data recorder, at least one of the data, the processed data, and the first record at a configurable first predetermined rate in at least one local memory of the data recorder; sending, using the onboard data manager, the first record to a remote data manager via a wireless data link at a configurable second predetermined rate, the second predetermined rate is configurable between zero seconds and five minutes, wherein the first record is sent continuously to the remote data manager on a first condition that the second predetermined rate is zero seconds and the first record is sent to the remote data manager in specified time intervals based on the second predetermined rate on a second condition that the second predetermined rate is greater than zero seconds and up to five minutes; and storing, using the remote data manager, the first record in a remote data repository.
-
-
13. A system for analyzing video content comprising:
-
at least one of at least one 360 degree camera, at least one fixed camera, and at least one microphone; a video analytics system onboard a mobile asset, the video analytics system comprising an artificial intelligence component, an object detection and location component, and an obstruction detection component, the video analytics system adapted to receive data based on at least one data signal from the at least one of the at least one 360 degree camera, the at least one fixed camera, and the at least one microphone, the artificial intelligence component adapted to process the data into processed data, the object detection and location component adapted to determine object detection data and object location data of a first object based on the processed data, and the obstruction detection component adapted to determine obstruction detection information based on at least one of the processed data, the object detection information, and the object location information; a digital video recorder, onboard the mobile asset, adapted to receive data based on at least one data signal from the at least one of the at least one 360 degree camera, the at least one fixed camera, and the at least one microphone; and a data recorder, onboard the mobile asset, comprising a data encoder, an onboard data manager, and at least one local memory, the data recorder adapted to store the data at a configurable first predetermined rate in the at least one local memory, wherein the first predetermined rate is greater than zero seconds and up to five minutes. - View Dependent Claims (14, 15, 16, 17, 18)
-
Specification