IMAGE SEGMENTATION AND MODIFICATION OF A VIDEO STREAM
First Claim
Patent Images
1. A computer implemented method for manipulating portions of a video stream, comprising:
- determining, using one or more processors of a client device, an approximate location of a mouth within a video stream including a face and comprising a first set of images and a second set of images;
identifying, by the client device, an area of interest within the one or more images of the first set of images, the area of interest being a portion of the one or more images encompassing the approximate location of the mouth;
generating, by the client device, a modified area of interest;
identifying a set of teeth visible within the mouth in the modified area of interest;
identifying, by the client device, a first set of pixels and a second set of pixels within the modified area of interest and adding at least a portion of the first set of pixels as a set of landmark points within a binary mask of the face, the first set of pixels corresponding to the set of teeth within the mouth; and
when the teeth are visible within the second set of images, modifying, by the client device, a color value for the first set of pixels within the second set of images of the video stream.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
50 Citations
20 Claims
-
1. A computer implemented method for manipulating portions of a video stream, comprising:
-
determining, using one or more processors of a client device, an approximate location of a mouth within a video stream including a face and comprising a first set of images and a second set of images; identifying, by the client device, an area of interest within the one or more images of the first set of images, the area of interest being a portion of the one or more images encompassing the approximate location of the mouth; generating, by the client device, a modified area of interest; identifying a set of teeth visible within the mouth in the modified area of interest; identifying, by the client device, a first set of pixels and a second set of pixels within the modified area of interest and adding at least a portion of the first set of pixels as a set of landmark points within a binary mask of the face, the first set of pixels corresponding to the set of teeth within the mouth; and when the teeth are visible within the second set of images, modifying, by the client device, a color value for the first set of pixels within the second set of images of the video stream. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for manipulating portions of a video stream, comprising:
-
one or more processor; and a non-transitory machine-readable storage medium storing processor executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising; determining an approximate location of a mouth within a video stream including a face and comprising a first set of images and a second set of images; identifying an area of interest within the one or more images of the first set of images, the area of interest being a portion of the one or more images encompassing the approximate location of the mouth; generating a modified area of interest; identifying a set of teeth visible within the mouth in the modified area of interest; identifying a first set of pixels and a second set of pixels within the modified area of interest and adding at least a portion of the first set of pixels as a set of landmark points within a binary mask of the face, the first set of pixels corresponding to the set of teeth within the mouth; and when the teeth are visible within the second set of images, modifying a color value for the first set of pixels within the second set of images of the video stream. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A non-transitory machine-readable storage medium storing processor executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:
-
determining an approximate location of a mouth within a video stream including a face and comprising a first set of images and a second set of images; identifying an area of interest within the one or more images of the first set of images, the area of interest being a portion of the one or more images encompassing the approximate location of the mouth; generating a modified area of interest; identifying a set of teeth visible within the mouth in the modified area of interest; identifying a first set of pixels and a second set of pixels within the modified area of interest and adding at least a portion of the first set of pixels as a set of landmark points within a binary mask of the face, the first set of pixels corresponding to the set of teeth within the mouth; and when the teeth are visible within the second set of images, modifying a color value for the first set of pixels within the second set of images of the video stream. - View Dependent Claims (19, 20)
-
Specification