System and method for enhanced video image recognition using motion sensors
First Claim
1. A method for improving image recognition by using information from sensor data, the method comprising:
- receiving one or more sensor records, the one or more sensor records representing timestamped sensor data collected by a sensor recording device;
selecting an event based on the one or more sensor records;
identifying a time associated with the event;
retrieving a plurality of timestamped video frames;
synchronizing the one or more sensor records and the plurality of timestamped video frames, wherein synchronizing the one or more sensor records and the plurality of timestamped video frames comprises;
synchronizing the timestamped sensor data with individual frames of the plurality of timestamped video frames according to a common timeframe,classifying the plurality of timestamped video frames using an image recognition to obtain classified video frames, andidentifying a start video frame and end video frame in the classified video frames, the start video frame representing a start of the event and the end video frame representing an end of the event; and
selecting a subset of video frames from the plurality of timestamped video frames based on a start timestamp associated with the start video frame and an end timestamp associated with the end video frame.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are systems and methods for improving image recognition by using information from sensor data. In one embodiment, the method comprises receiving one or more sensor records, the sensor records representing timestamped sensor data collected by a sensor recording device; selecting an event based on the sensor records; identifying a time associated with the event; retrieving a plurality of timestamped video frames; synchronizing the sensor records and the video frames, wherein synchronizing the sensor records and the video frames comprises synchronizing the timestamped sensor data with individual frames of the timestamped video frames according to a common timeframe; and selecting a subset of video frames from the plurality of timestamped video frames based on the selected event.
82 Citations
18 Claims
-
1. A method for improving image recognition by using information from sensor data, the method comprising:
-
receiving one or more sensor records, the one or more sensor records representing timestamped sensor data collected by a sensor recording device; selecting an event based on the one or more sensor records; identifying a time associated with the event; retrieving a plurality of timestamped video frames; synchronizing the one or more sensor records and the plurality of timestamped video frames, wherein synchronizing the one or more sensor records and the plurality of timestamped video frames comprises; synchronizing the timestamped sensor data with individual frames of the plurality of timestamped video frames according to a common timeframe, classifying the plurality of timestamped video frames using an image recognition to obtain classified video frames, and identifying a start video frame and end video frame in the classified video frames, the start video frame representing a start of the event and the end video frame representing an end of the event; and selecting a subset of video frames from the plurality of timestamped video frames based on a start timestamp associated with the start video frame and an end timestamp associated with the end video frame. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for improving image recognition by using information from sensor data, the system comprising:
-
a sensor recording device configured to capture one or more sensor records, the one or more sensor records representing timestamped sensor data collected by the sensor recording device; one or more cameras configured to record a plurality of timestamped video frames; and an event processing system configured to; receive the one or more sensor records, the one or more sensor records representing timestamped sensor data collected by a sensor recording device; select an event based on the one or more sensor records; identify a time associated with the event; retrieve the plurality of timestamped video frames; synchronize the one or more sensor records and the plurality of timestamped video frames, wherein synchronizing the one or more sensor records and the plurality of timestamped video frames comprises; synchronizing the timestamped sensor data with individual frames of the plurality of timestamped video frames according to a common timeframe, classifying the plurality of timestamped video frames using an image recognition to obtain classified video frames, identifying a start video frame and end video frame in the classified video frames, the start video frame representing a start of the event and the end video frame representing an end of the event; and select a subset of video frames from the plurality of timestamped video frames based on a start timestamp associated with the start video frame and an end timestamp associated with the end video frame. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
Specification