Automatic facial animation using an image of a user

• US 20080158230A1
• Filed: 12/29/2006
• Published: 07/03/2008
• Est. Priority Date: 12/29/2006
• Status: Abandoned Application

• Current Assignee: Pictureal Corp. (Glam Holdings Ltd.)
• Original Assignee: Pictureal Corp. (Glam Holdings Ltd.)
• Inventors: Sharma, Sanjay, Arawattigi, Kevin B., Schram, Arthur, Sathe, Shashank, Mand, Inderjit, Sharma, Yogesh, Abhyankar, Prasad, Raut, Divesh Vijay, Sakpal, Dharmendra, Kini, Abhijeet, Allarakha, Arfat, Khan, Riyaz
• Application Number:
  US11/648,258
• Publication Number:
  US 20080158230A1
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings

Abstract

In one embodiment, a method for facial animation is provided. The method first determines an image of a user. Facial feature information for a facial region is then detected in the image. For example, a number of points around the face for a user are determined. The facial region is then normalized based on the content and the facial feature information. The normalized facial region is then animated into a series of animated facial images. These series of animated facial images may be automatically inserted in the content. Accordingly, an image of a user'"'"'s face may be automatically inserted into the content from the image of the user using the above method. The content may then be played where the animated series of facial images is included in the content being played.

Claims

1. A method for facial animation for content, the method comprising:

determining an image of a user;

detecting facial feature information for a facial region in the image;

normalizing the facial region based on the content and the information for the facial region; and

automatically animating the normalized facial region into a series of animated facial images such that the series of animated facial images can be automatically inserted in the content in place of another facial region in the content.

2. The method of claim 1, wherein determining the image comprises receiving an uploaded image from a user device.

3. The method of claim 1, wherein determining the image comprises determining the image from a search of web pages, a scan of a document, a uniform resource locator (URL), video, or an uploaded picture.

4. The method of claim 1, wherein detecting facial feature information for comprises detecting a plurality of points on the facial region indicating facial features of a face.

5. The method of claim 4, wherein normalizing the facial region comprises standardizing the facial region using the plurality of points to generate a standard sized image.

6. The method of claim 5, wherein the normalizing standardizes the image to a form that is usable to generate the series of animated facial images for insertion in the content.

7. The method of claim 1, wherein animating the normalized facial region into a series of animated facial images comprises:

determining one or more pixels to modify to create an animated facial image; and

modifying the one or more pixels to create the animated facial image for insertion in the content.

8. The method of claim 1, further comprising:

inserting each of the series of animated facial images in the content; and

playing the content with the series of animated facial images to create content that includes the animated facial images in place of a second facial region in the content.

9. The method of claim 1, wherein determining the image of the user comprises receiving the image through a website, wherein the detecting, normalizing, and animating are performed automatically without any other user intervention.

10. The method of claim 1, wherein automatically animating comprises automatically animating the normalized facial region based on information determined for a conversation occurring for the user.

11. The method of claim 1, wherein the normalized facial region is an image of a face different from a second face found originally in the content.

12. A user interface configured to provide facial animation, the user interface comprising:

an uploader configured to allow uploading of an image of a user; and

a media player configured to, in response to the uploading of the image, automatically play content including a series of animated facial images inserted in the content in place of a first facial region in the content, wherein the series of animated facial images is automatically detected from the image facial feature information for a second facial region in the image.

13. The user interface of claim 12, wherein the user interface is included in a website.

14. The user interface of claim 13, wherein the image is uploaded through the website.

15. The user interface of claim 12, wherein the animated facial images are normalized based on the content in which the animated facial images are inserted into.

16. The user interface of claim 12, wherein the second facial region is automatically detected based on facial feature information.

17. The user interface of claim 12, wherein the content is automatically played including a series of animated facial images inserted in the content in place of a first facial region in the content without any user intervention after the uploading of the image.

18. An apparatus configured to provide facial animation for content, the apparatus comprising:

one or more processors; and

logic encoded in one or more tangible media for execution by the one or more processors and when executed operable to;

determine an image of a user;

detect facial feature information for a facial region in the image;

normalize the facial region based on the content and the information for the facial region; and

automatically animate the normalized facial region into a series of animated facial images such that the series of animated facial images can be automatically inserted in the content in place of another facial region in the content.

19. The apparatus of claim 18, wherein the logic when executed operable to determine the image comprises receiving an uploaded image from a user device.

20. The apparatus of claim 18, wherein the logic when executed operable to determine the image comprises determining the image from a search of web pages, a scan of a document, a uniform resource locator (URL), video, or an uploaded picture.