Detecting anomalous events to trigger the uploading of video to a video storage server

• US 10,455,185 B2
• Filed: 08/10/2016
• Issued: 10/22/2019
• Est. Priority Date: 08/10/2016
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Corp.
• Original Assignee: International Business Machines Corporation
• Inventors: Bostick, James E., Ganci, Jr., John M., Keen, Martin G., Rakshit, Sarbajit K.
• Primary Examiner(s): Cattungal, Rowina J
• Application Number:
  US15/233,314
• Publication Number:
  US 20180048850A1
• Time in Patent Office: 1,168 Days
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/162 Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A computer-implemented method includes: monitoring, by a computing device, video or image data captured by a plurality of cameras implemented within a vehicle; monitoring, by the computing device, vehicle information associated with the vehicle, wherein the vehicle information includes sensor information reported by tire pressure sensors or impact sensors of the vehicle, or vehicle diagnostic information; detecting, by the computing device, satisfaction of particular video upload event criteria for which video should be uploaded for secure storage and future analysis, wherein the detecting the satisfaction of the video upload criteria is based on the monitoring the video or image data and the vehicle information; and uploading, by the computing device, video captured by a subset of the plurality of cameras to a video storage server, wherein the subset of the plurality of cameras include cameras capture the video or image data used to detect the satisfaction of the video upload event criteria or are associated with the vehicle information used to detect the satisfaction of the video upload event criteria.

Claims

1. A computer-implemented method comprising:

monitoring, by a computing device, video or image data captured by a plurality of cameras implemented within a vehicle;

monitoring, by the computing device, vehicle information associated with the vehicle, wherein the vehicle information includes sensor information reported by tire pressure sensors or impact sensors of the vehicle, or vehicle diagnostic information;

analyzing, by the computing device, the monitored video or image data for objects, patterns, or motions within respective fields of view of the plurality of cameras;

storing pixel-based classification rules in a memory of the computing device;

storing video uploading rules that identify a subset of the plurality of cameras for which video should be uploaded in the memory of the computing device;

detecting, by the computing device, satisfaction of video upload event criteria based on the analyzed monitored video or image data and the vehicle information, wherein the video upload event criteria identifies the subset of the plurality of cameras that captured video from a field of view facing an anomalous event defined by a particular set of objects, patterns, or motions, a rule to upload video from the subset of the plurality of cameras, and the stored pixel-based classification rules to identify the anomalous event from the video or image data;

determining, by the computing device, the subset of the plurality of cameras based on the detecting the satisfaction of the video upload event criteria; and

uploading, by the computing device, video captured by only the subset of the plurality of cameras to a video storage server.

2. The method of claim 1, further comprising determining an event type based on the satisfaction of the video upload event criteria, wherein the subset of the plurality of cameras are further determined based on the event type.

3. The method of claim 2, wherein the event type includes at least one of:

a road hazard;

a vehicle accident;

a surrounding vehicle accident; and

aggressive driving.

4. The method of claim 2, wherein the uploading the video includes uploading the video to a video server, wherein the video storage server is determined based on the event type.

5. The method of claim 2, wherein the uploading the video includes uploading metadata associated with the video, the metadata including:

date and time of the video capture;

the event type;

vehicle owner information;

registration information;

license plate information;

vehicle make and model; and

vehicle location based on global positioning system (GPS) data received by vehicle diagnostic system; and

wherein the plurality of cameras implemented within the vehicle includes;

a front-facing camera;

a rear-facing camera;

side-facing cameras; and

diagonal-facing cameras, all of which capture video while the vehicle is being driven.

6. The method of claim 1, wherein the uploading the video includes uploading a particular snippet of video for a time window.

7. The method of claim 6, wherein the time window is determined based on satisfaction of the video upload event criteria.

8. The method of claim 1, wherein the monitoring the video or image data includes detecting objects, motions, or patterns based on the pixel-based classification rules, and further comprising:

receiving, by the computing device, manual instruction to upload video captured by the plurality of cameras to a video storage server;

creating, by the computing device, a new rule based on the receiving the manual instruction;

automatically detecting, by the computing device, another event based on the new rule; and

automatically uploading, by the computing device, video data based on the automatically detecting.

9. The method of claim 1, wherein the detecting the satisfaction of the video upload event criteria includes detecting that a value for the tire pressures or impact sensors satisfies a threshold.

10. The method of claim 1, wherein a service provider at least one of creates, maintains, deploys and supports the computing device.

11. The method of claim 1, wherein steps of claim 1 are provided by a service provider on a subscription, advertising, and/or fee basis.

12. The method of claim 1, wherein the computing device includes software provided as a service in a cloud environment.

13. The method of claim 1, further comprising deploying a system for triggering the uploading of video, comprising providing a computer infrastructure operable to perform the steps of claim 1.

14. A computer program product for triggering the uploading of video from a subset of cameras of a plurality of cameras implemented in a vehicle, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device to cause the computing device to:

monitor video or image data captured by the plurality of cameras;

analyze the monitored video or image data for objects, patterns, or motions within respective fields of view of the plurality of cameras;

store pixel-based classification rules in the computer readable storage medium;

store video uploading rules that identify a subset of the plurality of cameras for which video should be uploaded in the computer readable storage medium;

detect an anomalous event using the analyzed monitored video or image data and the stored pixel-based classification rules to identify the anomalous event from the video or image data, wherein the anomalous event is defined by a particular set of objects, patterns, or motions and relates to a collision or a road hazard;

determine the subset of cameras of the plurality of cameras that were used to detect the anomalous event and that captured the video or image data having objects, patterns, or motions consistent with the anomalous event and captured from a field of view facing and associated with the anomalous event; and

upload video captured by only the subset of cameras of the plurality of cameras to a video storage server.

15. The computer program product of claim 14, wherein a field of view of the subset of cameras face a direction of the anomalous event.

16. The computer program product of claim 14, wherein the program instructions further cause the computing device to monitor vehicle information from a vehicle diagnostic system, wherein the vehicle information includes sensor information reported by tire pressure sensors or impact sensors of the vehicle, or vehicle diagnostic information,

wherein determining the subset of cameras of the plurality of cameras is further based on the monitoring of the vehicle information.

17. The computer program product of claim 14, wherein the program instructions further cause the computing device to determine an event type associated with the anomalous event based on the monitoring of the video or image data, wherein the determining the subset of cameras of the plurality of cameras is further based on the event type.

18. The computer program product of claim 17, wherein the uploading the video captured by the subset of cameras of the plurality of cameras of the plurality of cameras includes uploading video from a particular time window, wherein the particular time window is based on the event type.

19. A system comprising:

a CPU, a computer readable memory and a computer readable storage medium associated with a computing device;

program instructions to monitor video or image data captured by a plurality of cameras implemented within a vehicle;

program instructions to analyze the monitored video or image data for objects, patterns, or motions within respective fields of view of the plurality of cameras;

program instructions to monitor vehicle information associated with the vehicle;

program instructions to store pixel-based classification rules in the computer readable memory;

program instructions to store video uploading rules that identify a subset of the plurality of cameras for which video should be uploaded in the computer readable memory;

program instructions to detect an anomalous event using the analyzed monitored video or image data and the monitored vehicle information using the stored pixel-based classification rules to identify the anomalous event from the video or image data, wherein the detecting the anomalous event includes detecting a satisfaction of criteria defining the anomalous event, wherein the anomalous event is defined by a particular set of objects, patterns, or motions and relates to a collision or a road hazard;

program instructions to determine the subset of the plurality of cameras of the plurality of cameras that were used to detect the anomalous event and that captured the video or image data having objects, patters, or motions consistent with the anomalous event and captured from a field of view facing and associated with the anomalous event; and

program instructions to upload video captured by only the subset of cameras of the plurality of cameras within a particular time window to a video storage server,

wherein the program instructions are stored on the computer readable storage medium for execution by the CPU via the computer readable memory.

20. The system of claim 19, further comprising program instructions to direct a computing device from a surrounding vehicle to upload video captured by one or more cameras implemented in the surrounding vehicle to the video storage server.