System for object detection and recognition in videos using stabilization
First Claim
1. A system for stabilizing, detecting, and recognizing objects in video captured from a mobile platform, comprising:
- one or more processors and a memory, the memory having instructions encoded thereon such that upon execution of the instructions, the one or more processors perform operations of;
receiving a video captured from a mobile platform, the video having a plurality of image frames;
stabilizing the video by registering the image frames to a global coordinate system to generate stabilized image frames;
applying a bio-inspired attention algorithm to the stabilized image frames to produce a set of locations in the stabilized image frames that are salient points representative of an object of interest;
generating an image chip that surrounds each salient point;
extracting high-dimensional feature vectors from the image chip; and
classifying the feature vectors as an object class, whereby through classifying the feature vectors, an object of interest can be identified in the video as captured from the mobile platform.
2 Assignments
0 Petitions
Accused Products
Abstract
Described is a system for stabilizing, detecting, and recognizing objects in video captured from a mobile platform. The system first receives a video (with a plurality of image frames) captured from a mobile platform. The video is stabilized by registering the image frames to a global coordinate system to generate stabilized image frames. A bio-inspired attention algorithm is applied to the stabilized image frames to produce a set of locations in the stabilized image frames that are salient points representative of an object of interest. An image chip is generated that surrounds each salient point. High-dimensional feature vectors are extracted from the image chip. The feature vectors are then classified as an object class. Thus, through classifying the feature vectors, an object of interest can be identified in the video as captured from the mobile platform.
-
Citations
21 Claims
-
1. A system for stabilizing, detecting, and recognizing objects in video captured from a mobile platform, comprising:
-
one or more processors and a memory, the memory having instructions encoded thereon such that upon execution of the instructions, the one or more processors perform operations of; receiving a video captured from a mobile platform, the video having a plurality of image frames; stabilizing the video by registering the image frames to a global coordinate system to generate stabilized image frames; applying a bio-inspired attention algorithm to the stabilized image frames to produce a set of locations in the stabilized image frames that are salient points representative of an object of interest; generating an image chip that surrounds each salient point; extracting high-dimensional feature vectors from the image chip; and classifying the feature vectors as an object class, whereby through classifying the feature vectors, an object of interest can be identified in the video as captured from the mobile platform. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer implemented method for stabilizing, detecting, and recognizing objects in video captured from a mobile platform, comprising an act of causing a data processor to execute instructions stored on a non-transitory computer-readable medium such that upon execution, the data processor performs operations of:
-
receiving a video captured from a mobile platform, the video having a plurality of image frames; stabilizing the video by registering the image frames to a global coordinate system to generate stabilized image frames; applying a bio-inspired attention algorithm to the stabilized image frames to produce a set of locations in the stabilized image frames that are salient points representative of an object of interest; generating an image chip that surrounds each salient point; extracting high-dimensional feature vectors from the image chip; and classifying the feature vectors as an object class, whereby through classifying the feature vectors, an object of interest can be identified in the video as captured from the mobile platform. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer program product for stabilizing, detecting, and recognizing objects in video captured from a mobile platform, the computer program product comprising computer-readable instructions stored on a non-transitory computer-readable medium that are executable by a computer having a processor for causing the processor to perform operations of:
-
receiving a video captured from a mobile platform, the video having a plurality of image frames; stabilizing the video by registering the image frames to a global coordinate system to generate stabilized image frames; applying a bio-inspired attention algorithm to the stabilized image frames to produce a set of locations in the stabilized image frames that are salient points representative of an object of interest; generating an image chip that surrounds each salient point; extracting high-dimensional feature vectors from the image chip; and classifying the feature vectors as an object class, whereby through classifying the feature vectors, an object of interest can be identified in the video as captured from the mobile platform. - View Dependent Claims (16, 17, 18, 19, 20, 21)
-
Specification