×

Image segmentation and modification of a video stream

  • US 10,198,819 B2
  • Filed: 11/30/2015
  • Issued: 02/05/2019
  • Est. Priority Date: 11/30/2015
  • Status: Active Grant
First Claim
Patent Images

1. A computer implemented method for manipulating portions of a video stream, comprising:

  • determining, using one or more processors of a client device, an approximate location of a mouth within a video stream including a face and comprising a first set of images and a second set of images;

    identifying, by the client device, an area of interest within the one or more images of the first set of images, the area of interest being a portion of the one or more images encompassing the approximate location of the mouth;

    generating, by the client device, a modified area of interest by converting the pixels within the area of interest to values along a grayscale to generate a grayscale area of interest, the pixels converted to grayscale by, for each pixel, generating a grayscale value by multiplying a fixed intensity value with a quotient of a triplet of color saturation values of the pixel;

    identifying a set of teeth visible within the mouth in the grayscale area of interest;

    identifying, by the client device, a first set of pixels and a second set of pixels within the grayscale area of interest and adding at least a portion of the first set of pixels as a set of landmark points within a binary mask of the face, the first set of pixels corresponding to the set of teeth within the mouth; and

    when the teeth are visible within the second set of images, modifying, by the client device, a color value for the first set of pixels within the second set of images of the video stream.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×