×

Deep learning internal state index-based search and classification

  • US 10,380,997 B1
  • Filed: 08/22/2018
  • Issued: 08/13/2019
  • Est. Priority Date: 07/27/2018
  • Status: Active Grant
First Claim
Patent Images

1. A non-transitory computer-readable medium comprising instructions for:

  • providing a trained speech recognition neural network, the speech recognition neural network including a plurality of layers each having a plurality of nodes;

    transcribing speech audio by the speech recognition neural network;

    while the speech recognition neural network is transcribing the speech audio, generating one or more feature representations from a subset of nodes, the one or more feature representations representing an internal state of the speech recognition neural network at a plurality of timestamps during transcription, each of the feature representations comprising a vector of quantized values where each of the quantized values is obtained by quantizing an activation output of a node in the subset of nodes;

    storing the one or more feature representations;

    receiving a first set of classifications for a first portion of the speech audio;

    training a classification model, the classification model being different than the trained speech recognition neural network, on a first set of feature representations corresponding to the first portion of the speech audio and the first set of classifications, the first set of feature representations comprising a first subset of the feature representations generated during the speech audio transcription; and

    determining a second set of classifications for a second portion of the speech audio by inputting a second set of feature representations corresponding to the second portion of the speech audio into the trained classification model, the second set of feature representations comprising a second subset of the feature representations generated during the speech audio transcription.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×