×

Video concept classification using audio-visual atoms

  • US 8,135,221 B2
  • Filed: 10/07/2009
  • Issued: 03/13/2012
  • Est. Priority Date: 10/07/2009
  • Status: Expired due to Fees
First Claim
Patent Images

1. A method for determining a classification for a video segment, comprising using a processor to perform the steps of:

  • a) breaking the video segment into a plurality of short-term video slices, each including a plurality of video frames and an audio signal;

    b) analyzing the video frames for each short-term video slice to form a plurality of region tracks, wherein the region tracks provide an indication of the position of identified image regions in a plurality of video frames;

    c) analyzing each region track to form a corresponding visual feature vector providing an indication of visual features for the image region, and a motion feature vector providing an indication of inter-frame motion for the image region;

    d) analyzing the audio signal for each short-term video slice to determine an audio feature vector providing a characterization of the audio signal;

    e) forming a plurality of short-term audio-visual atoms for each short-term video slice by combining the visual feature vector and the motion feature vector for a particular region track with the corresponding audio feature vector; and

    f) using a classifier to determine a classification for the video segment responsive to the short-term audio-visual atoms.

View all claims
  • 12 Assignments
Timeline View
Assignment View
    ×
    ×