×

Tree structured CRF with unary potential function using action unit features of other segments as context feature

  • US 10,445,582 B2
  • Filed: 12/20/2016
  • Issued: 10/15/2019
  • Est. Priority Date: 12/20/2016
  • Status: Active Grant
First Claim
Patent Images

1. A method of determining a classification of a composite action including a plurality of action units in a video clip, the method comprising:

  • extracting a plurality of features from the video clip;

    determining a corresponding feature in the plurality of features for each of temporal segments of the video clip;

    determining an initial estimate of an action unit for each of the temporal segments using a potential function for each segment modeling dependency between a concatenation of features and a classification of a corresponding action unit by inputting a feature from a current temporal segment and a feature from at least one of preceding temporal segments or subsequent temporal segments as the concatenation of features;

    aggregating the potential functions into a probability distribution; and

    determining the classification of the composite action using the probability distribution by jointly inferring the classification of the composite action and classifications of the action units of the temporal segments based on the initial estimate of each action unit for each of the temporal segments.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×