Motion recognition via a two-dimensional symbol having multiple ideograms contained therein
First Claim
1. A method of recognizing motions of an object in a video clip or an image sequence comprising:
- selecting a plurality of frames out of a video clip or an image sequence of interest;
obtaining a reduced-size image in each frame by pooling imagery data of said each frame to a desired size such that an object of interest including the object'"'"'s pose is recognized in the reduced-size image;
forming a super-character by embedding respective reduced-size images of the plurality of frames as corresponding ideograms in a two-dimensional (2-D) symbol having multiple ideograms contained therein and the super-character representing a meaning formed from a specific combination of the multiple ideograms; and
recognizing a particular motion of the object by obtaining the meaning of the super-character with image classification of the 2-D symbol via a trained convolutional neural networks model for various motions of the object derived from specific sequential combinations of respective reduced-size images.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods of recognizing motions of an object in a video clip or an image sequence are disclosed. A plurality of frames are selected out of a video clip or an image sequence of interest. A text category is associated with each frame by applying an image classification technique with a trained deep-learning model for a set of categories containing various poses of an object within each frame. A “super-character” is formed by embedding respective text categories of the frames as corresponding ideograms in a 2-D symbol having multiple ideograms contained therein. Particular motion of the object is recognized by obtaining the meaning of the “super-character” with image classification of the 2-D symbol via a trained convolutional neural networks model for various motions of the object derived from specific sequential combinations of text categories. Ideograms may contain imagery data instead of text categories, e.g., detailed images or reduced-size images.
54 Citations
6 Claims
-
1. A method of recognizing motions of an object in a video clip or an image sequence comprising:
-
selecting a plurality of frames out of a video clip or an image sequence of interest; obtaining a reduced-size image in each frame by pooling imagery data of said each frame to a desired size such that an object of interest including the object'"'"'s pose is recognized in the reduced-size image; forming a super-character by embedding respective reduced-size images of the plurality of frames as corresponding ideograms in a two-dimensional (2-D) symbol having multiple ideograms contained therein and the super-character representing a meaning formed from a specific combination of the multiple ideograms; and recognizing a particular motion of the object by obtaining the meaning of the super-character with image classification of the 2-D symbol via a trained convolutional neural networks model for various motions of the object derived from specific sequential combinations of respective reduced-size images. - View Dependent Claims (2, 3, 4, 5, 6)
-
Specification