Emoji recording and sending

• US 10,379,719 B2
• Filed: 03/29/2018
• Issued: 08/13/2019
• Est. Priority Date: 05/16/2017
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Scapel, Nicolas, Guzman, Aurelio, Bauer, Sebastian, Yerkes, Giancarlo, Barlier, Guillaume Pierre Andre, Jones, Matthew
• Primary Examiner(s): Young, Kevin L
• Assistant Examiner(s): Huynh, Linda
• Application Number:
  US15/940,232
• Publication Number:
  US 20180335930A1
• Time in Patent Office: 502 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/08 Annexed information, e.g. attachments
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 51/58 Message adaptation for wireless communication
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72439 for image or video messaging
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements

Abstract

The present disclosure generally relates to generating and modifying virtual avatars. An electronic device having a camera and a display apparatus displays a virtual avatar that changes appearance in response to changes in a face in a field of view of the camera. In response to detecting changes in one or more physical features of the face in the field of view of the camera, the electronic device modifies one or more features of the virtual avatar.

Claims

1. An electronic device, comprising:

one or more cameras;

a display apparatus;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying, via the display apparatus, a graphical representation, wherein the graphical representation includes a plurality of graphical features that are reactive to changes in one or more physical features of a face within a field of view of the one or more cameras and includes a respective portion that does not include a graphical feature;

while displaying the graphical representation, detecting a change in a plurality of physical features of the face, the plurality of physical features of the face including a first physical feature that corresponds to one or more of the plurality of graphical features and a second physical feature that does not correspond to any of the plurality of graphical features; and

in response to detecting the change in the plurality of physical features of the face;

changing an appearance of a respective graphical feature of the plurality of graphical features wherein a magnitude or direction of change of the respective graphical feature is based on a magnitude or direction of change in the first physical feature; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face into one or more protrusions that were not displayed prior to detecting the change in the plurality of physical features of the face, wherein a magnitude or direction of deforming the respective portion of the graphical representation is based on the magnitude or direction of change in the second physical feature, including;

in accordance with a determination that the second physical feature has moved by a first amount of movement, the magnitude of deforming the respective portion of the graphical representation is a first amount of deforming; and

in accordance with a determination that the second physical feature has moved by a second amount of movement that is different from the first amount of movement, the magnitude of deforming the respective portion of the graphical representation is a second amount of deforming that is different from the first amount of deforming.

2. The electronic device of claim 1, wherein the plurality of graphical features that are displayed prior to detecting the change in the plurality of physical features of the face are displayed without regard to a current position of the physical features of the face.

3. The electronic device of claim 1, wherein the one or more physical features include a third physical feature, the one or more programs further including instructions for:

while a first physical feature value of the third physical feature is below a first graphical feature inclusion threshold and the graphical representation does not include a first graphical feature that is at least partially reactive to the third physical feature, detecting a change in the third physical feature from the first physical feature value to a second physical feature value;

in accordance with the second physical feature value of the third physical feature meeting or exceeding the first graphical feature inclusion threshold, modifying the graphical representation to include the first graphical feature; and

in accordance with the second physical feature value of the third physical feature not meeting or exceeding the first graphical feature inclusion threshold, forgoing modifying the graphical representation to include the first graphical feature.

4. The electronic device of claim 3, wherein:

the third physical feature includes at least a portion of a user'"'"'s eye;

the first graphical feature includes at least a portion of a graphical eyebrow;

the first graphical feature inclusion threshold is met or exceeded when a size of the at least a portion of the user'"'"'s eye is greater than a threshold size value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the at least a portion of the graphical eyebrow.

5. The electronic device of claim 3, wherein:

the third physical feature includes at least a portion of a user'"'"'s eye;

the first graphical feature includes at least a portion of a graphical eyebrow and at least a portion of a graphical cheek;

the first graphical feature inclusion threshold is met or exceeded when a size of the at least a portion of the user'"'"'s eye is less than a threshold size value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the at least a portion of the graphical eyebrow and the at least a portion of the graphical cheek.

6. The electronic device of claim 3, wherein:

the third physical feature includes at least a portion of a user'"'"'s eyebrow;

the first graphical feature includes one or more protrusions;

the first graphical feature inclusion threshold is met or exceeded when a magnitude of a vertical displacement of the at least a portion of the user'"'"'s eyebrow is greater than a threshold displacement value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the one or more protrusions positioned on at least an upper portion of a graphical head.

7. The electronic device of claim 3, wherein:

the third physical feature includes at least a portion of a user'"'"'s cheek;

the first graphical feature includes one or more protrusions;

the first graphical feature inclusion threshold is met or exceeded when the at least a portion of the user'"'"'s cheek is expanded greater than a threshold expanding value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the one or more protrusions positioned on at least a portion of a graphical cheek.

8. The electronic device of claim 3, wherein:

the third physical feature includes at least a portion of a user'"'"'s eyebrow;

the first graphical feature includes a curved orientation of an upper portion of the graphical representation about a lower portion of the graphical representation;

the first graphical feature inclusion threshold is met or exceeded when a magnitude of a vertical displacement of the at least a portion of the user'"'"'s eyebrow is greater than a threshold displacement value; and

modifying the graphical representation to include the first graphical feature includes modifying the upper portion of the graphical representation to curve about the lower portion of the graphical representation.

9. The electronic device of claim 1, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye opening wider and the at least a portion of the user'"'"'s eyebrow raising;

changing an appearance of the respective graphical feature includes opening the at least a portion of the graphical eye wider; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation above the at least a portion of the graphical eye by introducing a graphical eyebrow feature.

10. The electronic device of claim 1, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye narrowing and the at least a portion of the user'"'"'s eyebrow lowering;

changing an appearance of the respective graphical feature includes closing the at least a portion of the graphical eye; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation above the at least a portion of the graphical eye by introducing a graphical eyebrow feature and deforming a portion of the graphical representation below the at least a portion of the graphical eye by introducing a graphical cheek feature.

11. The electronic device of claim 1, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyelid;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye narrowing and the at least a portion of the user'"'"'s eyelid lowering;

changing an appearance of the respective graphical feature includes closing the at least a portion of the graphical eye; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical eye by introducing a graphical eyelid feature.

12. The electronic device of claim 1, wherein:

the first physical feature includes at least a portion of a user'"'"'s lip;

the respective graphical feature includes at least a portion of a graphical mouth;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s lip having a pucker pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical mouth to include a set of graphical lips having a pucker pose.

13. The electronic device of claim 1, wherein:

the first physical feature includes at least a portion of a user'"'"'s lip;

the respective graphical feature includes at least a portion of a graphical beak;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s lip having a pucker pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical beak to include a set of graphical lips having a pucker pose.

14. The electronic device of claim 1, wherein the one or more physical features include a third physical feature that does not correspond to any of the plurality of graphical features, the one or more programs further including instructions for:

deforming a second portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face, wherein a magnitude or direction of deforming the second portion of the graphical feature is based on a magnitude or direction of change in the third physical feature.

15. The electronic device of claim 14, wherein:

the second physical feature includes at least a portion of a user'"'"'s eyelid;

the third physical feature includes at least a portion of a user'"'"'s cheek;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eyelid closing and a change in the at least a portion of the user'"'"'s cheek;

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation by introducing a graphical eyelid feature; and

deforming a second portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming the second portion of the graphical representation by introducing a cheek feature.

16. The electronic device of claim 1, wherein:

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eyebrow raising; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming an upper portion of a graphical head by introducing one or more protrusions extending from the upper portion of the graphical head.

17. The electronic device claim 1, wherein:

the first physical feature includes at least a portion of a user'"'"'s cheek;

the respective graphical feature includes at least a portion of a graphical cheek;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s cheek having an expanded pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical cheek to include one or more protrusions extending from the graphical cheek.

18. The electronic device of claim 1, the one or more programs further including instructions for:

while displaying the graphical representation, detecting a second change in the plurality of physical features of the face; and

in response to detecting the second change in the plurality of physical features of the face;

changing the appearance of the respective graphical feature of the plurality of graphical features wherein the magnitude or direction of change of the respective graphical feature is based on the magnitude or direction of the second change in the first physical feature; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face into one or more protrusions that were not displayed prior to detecting the change in the plurality of physical features of the face, wherein the magnitude or direction of deforming the respective portion of the graphical representation is based on the magnitude or direction of the second change in the second physical feature.

19. The electronic device of claim 1, wherein the graphical representation is a virtual avatar, and the graphical feature is an avatar feature.

20. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with one or more cameras and a display apparatus, the one or more programs including instructions for:

displaying, via the display apparatus, a graphical representation, wherein the graphical representation includes a plurality of graphical features that are reactive to changes in one or more physical features of a face within a field of view of the one or more cameras and includes a respective portion that does not include a graphical feature;

while displaying the graphical representation, detecting a change in a plurality of physical features of the face, the plurality of physical features of the face including a first physical feature that corresponds to one or more of the plurality of graphical features and a second physical feature that does not correspond to any of the plurality of graphical features; and

in response to detecting the change in the plurality of physical features of the face;

changing an appearance of a respective graphical feature of the plurality of graphical features wherein a magnitude or direction of change of the respective graphical feature is based on a magnitude or direction of change in the first physical feature; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face into one or more protrusions that were not displayed prior to detecting the change in the plurality of physical features of the face, wherein a magnitude or direction of deforming the respective portion of the graphical representation is based on the magnitude or direction of change in the second physical feature, including;

in accordance with a determination that the second physical feature has moved by a first amount of movement, the magnitude of deforming the respective portion of the graphical representation is a first amount of deforming; and

in accordance with a determination that the second physical feature has moved by a second amount of movement that is different from the first amount of movement, the magnitude of deforming the respective portion of the graphical representation is a second amount of deforming that is different from the first amount of deforming.

21. The non-transitory computer-readable storage medium of claim 20, wherein the plurality of graphical features that are displayed prior to detecting the change in the plurality of physical features of the face are displayed without regard to a current position of the physical features of the face.

22. The non-transitory computer-readable storage medium of claim 20, wherein the one or more physical features include a third physical feature, the one or more programs further including instructions for:

while a first physical feature value of the third physical feature is below a first graphical feature inclusion threshold and the graphical representation does not include a first graphical feature that is at least partially reactive to the third physical feature, detecting a change in the third physical feature from the first physical feature value to a second physical feature value;

in accordance with the second physical feature value of the third physical feature meeting or exceeding the first graphical feature inclusion threshold, modifying the graphical representation to include the first graphical feature; and

in accordance with the second physical feature value of the third physical feature not meeting or exceeding the first graphical feature inclusion threshold, forgoing modifying the graphical representation to include the first graphical feature.

23. The non-transitory computer-readable storage medium of claim 22, wherein:

the third physical feature includes at least a portion of a user'"'"'s eye;

the first graphical feature includes at least a portion of a graphical eyebrow;

the first graphical feature inclusion threshold is met or exceeded when a size of the at least a portion of the user'"'"'s eye is greater than a threshold size value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the at least a portion of the graphical eyebrow.

24. The non-transitory computer-readable storage medium of claim 22, wherein:

the third physical feature includes at least a portion of a user'"'"'s eye;

the first graphical feature includes at least a portion of a graphical eyebrow and at least a portion of a graphical cheek;

the first graphical feature inclusion threshold is met or exceeded when a size of the at least a portion of the user'"'"'s eye is less than a threshold size value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the at least a portion of the graphical eyebrow and the at least a portion of the graphical cheek.

25. The non-transitory computer-readable storage medium of claim 22, wherein:

the third physical feature includes at least a portion of a user'"'"'s eyebrow;

the first graphical feature includes one or more protrusions;

the first graphical feature inclusion threshold is met or exceeded when a magnitude of a vertical displacement of the at least a portion of the user'"'"'s eyebrow is greater than a threshold displacement value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the one or more protrusions positioned on at least an upper portion of a graphical head.

26. The non-transitory computer-readable storage medium of claim 22, wherein:

the third physical feature includes at least a portion of a user'"'"'s cheek;

the first graphical feature includes one or more protrusions;

the first graphical feature inclusion threshold is met or exceeded when the at least a portion of the user'"'"'s cheek is expanded greater than a threshold expanding value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the one or more protrusions positioned on at least a portion of a graphical cheek.

27. The non-transitory computer-readable storage medium of claim 22, wherein:

the third physical feature includes at least a portion of a user'"'"'s eyebrow;

the first graphical feature includes a curved orientation of an upper portion of the graphical representation about a lower portion of the graphical representation;

the first graphical feature inclusion threshold is met or exceeded when a magnitude of a vertical displacement of the at least a portion of the user'"'"'s eyebrow is greater than a threshold displacement value; and

modifying the graphical representation to include the first graphical feature includes modifying the upper portion of the graphical representation to curve about the lower portion of the graphical representation.

28. The non-transitory computer-readable storage medium of claim 20, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye opening wider and the at least a portion of the user'"'"'s eyebrow raising;

changing an appearance of the respective graphical feature includes opening the at least a portion of the graphical eye wider; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation above the at least a portion of the graphical eye by introducing a graphical eyebrow feature.

29. The non-transitory computer-readable storage medium of claim 20, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye narrowing and the at least a portion of the user'"'"'s eyebrow lowering;

changing an appearance of the respective graphical feature includes closing the at least a portion of the graphical eye; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation above the at least a portion of the graphical eye by introducing a graphical eyebrow feature and deforming a portion of the graphical representation below the at least a portion of the graphical eye by introducing a graphical cheek feature.

30. The non-transitory computer-readable storage medium of claim 20, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyelid;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye narrowing and the at least a portion of the user'"'"'s eyelid lowering;

changing an appearance of the respective graphical feature includes closing the at least a portion of the graphical eye; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical eye by introducing a graphical eyelid feature.

31. The non-transitory computer-readable storage medium of claim 20, wherein:

the first physical feature includes at least a portion of a user'"'"'s lip;

the respective graphical feature includes at least a portion of a graphical mouth;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s lip having a pucker pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical mouth to include a set of graphical lips having a pucker pose.

32. The non-transitory computer-readable storage medium of claim 20, wherein:

the first physical feature includes at least a portion of a user'"'"'s lip;

the respective graphical feature includes at least a portion of a graphical beak;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s lip having a pucker pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical beak to include a set of graphical lips having a pucker pose.

33. The non-transitory computer-readable storage medium of claim 20, wherein the one or more physical features include a third physical feature that does not correspond to any of the plurality of graphical features, the one or more programs further including instructions for:

deforming a second portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face, wherein a magnitude or direction of deforming the second portion of the graphical feature is based on a magnitude or direction of change in the third physical feature.

34. The non-transitory computer-readable storage medium of claim 33, wherein:

the second physical feature includes at least a portion of a user'"'"'s eyelid;

the third physical feature includes at least a portion of a user'"'"'s cheek;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eyelid closing and a change in the at least a portion of the user'"'"'s cheek;

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation by introducing a graphical eyelid feature; and

deforming a second portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming the second portion of the graphical representation by introducing a cheek feature.

35. The non-transitory computer-readable storage medium of claim 20, wherein:

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eyebrow raising; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming an upper portion of a graphical head by introducing one or more protrusions extending from the upper portion of the graphical head.

36. The non-transitory computer-readable storage medium of claim 20, wherein:

the first physical feature includes at least a portion of a user'"'"'s cheek;

the respective graphical feature includes at least a portion of a graphical cheek;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s cheek having an expanded pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical cheek to include one or more protrusions extending from the graphical cheek.

37. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

while displaying the graphical representation, detecting a second change in the plurality of physical features of the face; and

in response to detecting the second change in the plurality of physical features of the face;

changing the appearance of the respective graphical feature of the plurality of graphical features wherein the magnitude or direction of change of the respective graphical feature is based on the magnitude or direction of the second change in the first physical feature; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face into one or more protrusions that were not displayed prior to detecting the change in the plurality of physical features of the face, wherein the magnitude or direction of deforming the respective portion of the graphical representation is based on the magnitude or direction of the second change in the second physical feature.

38. The non-transitory computer-readable storage medium of claim 20, wherein the graphical representation is a virtual avatar, and the graphical feature is an avatar feature.

39. A method comprising:

at an electronic device having one or more cameras and a display apparatus;

displaying, via the display apparatus, a graphical representation, wherein the graphical representation includes a plurality of graphical features that are reactive to changes in one or more physical features of a face within a field of view of the one or more cameras and includes a respective portion that does not include a graphical feature;

while displaying the graphical representation, detecting a change in a plurality of physical features of the face, the plurality of physical features of the face including a first physical feature that corresponds to one or more of the plurality of graphical features and a second physical feature that does not correspond to any of the plurality of graphical features; and

in response to detecting the change in the plurality of physical features of the face;

changing an appearance of a respective graphical feature of the plurality of graphical features wherein a magnitude or direction of change of the respective graphical feature is based on a magnitude or direction of change in the first physical feature; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face into one or more protrusions that were not displayed prior to detecting the change in the plurality of physical features of the face, wherein a magnitude or direction of deforming the respective portion of the graphical representation is based on the magnitude or direction of change in the second physical feature, including;

in accordance with a determination that the second physical feature has moved by a first amount of movement, the magnitude of deforming the respective portion of the graphical representation is a first amount of deforming; and

in accordance with a determination that the second physical feature has moved by a second amount of movement that is different from the first amount of movement, the magnitude of deforming the respective portion of the graphical representation is a second amount of deforming that is different from the first amount of deforming.

40. The method of claim 39, wherein the plurality of graphical features that are displayed prior to detecting the change in the plurality of physical features of the face are displayed without regard to a current position of the physical features of the face.

41. The method of claim 39, wherein the one or more physical features include a third physical feature, the one or more programs further including instructions for:

while a first physical feature value of the third physical feature is below a first graphical feature inclusion threshold and the graphical representation does not include a first graphical feature that is at least partially reactive to the third physical feature, detecting a change in the third physical feature from the first physical feature value to a second physical feature value;

in accordance with the second physical feature value of the third physical feature meeting or exceeding the first graphical feature inclusion threshold, modifying the graphical representation to include the first graphical feature; and

in accordance with the second physical feature value of the third physical feature not meeting or exceeding the first graphical feature inclusion threshold, forgoing modifying the graphical representation to include the first graphical feature.

42. The method of claim 41, wherein:

the third physical feature includes at least a portion of a user'"'"'s eye;

the first graphical feature includes at least a portion of a graphical eyebrow;

the first graphical feature inclusion threshold is met or exceeded when a size of the at least a portion of the user'"'"'s eye is greater than a threshold size value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the at least a portion of the graphical eyebrow.

43. The method of claim 41, wherein:

the third physical feature includes at least a portion of a user'"'"'s eye;

the first graphical feature includes at least a portion of a graphical eyebrow and at least a portion of a graphical cheek;

the first graphical feature inclusion threshold is met or exceeded when a size of the at least a portion of the user'"'"'s eye is less than a threshold size value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the at least a portion of the graphical eyebrow and the at least a portion of the graphical cheek.

44. The method of claim 41, wherein:

the third physical feature includes at least a portion of a user'"'"'s eyebrow;

the first graphical feature includes one or more protrusions;

the first graphical feature inclusion threshold is met or exceeded when a magnitude of a vertical displacement of the at least a portion of the user'"'"'s eyebrow is greater than a threshold displacement value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the one or more protrusions positioned on at least an upper portion of a graphical head.

45. The method of claim 41, wherein:

the third physical feature includes at least a portion of a user'"'"'s cheek;

the first graphical feature includes one or more protrusions;

the first graphical feature inclusion threshold is met or exceeded when the at least a portion of the user'"'"'s cheek is expanded greater than a threshold expanding value; and

modifying the graphical representation to include the first graphical feature includes modifying the graphical representation to include the one or more protrusions positioned on at least a portion of a graphical cheek.

46. The method of claim 41, wherein:

the third physical feature includes at least a portion of a user'"'"'s eyebrow;

the first graphical feature includes a curved orientation of an upper portion of the graphical representation about a lower portion of the graphical representation;

the first graphical feature inclusion threshold is met or exceeded when a magnitude of a vertical displacement of the at least a portion of the user'"'"'s eyebrow is greater than a threshold displacement value; and

modifying the graphical representation to include the first graphical feature includes modifying the upper portion of the graphical representation to curve about the lower portion of the graphical representation.

47. The method of claim 39, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye opening wider and the at least a portion of the user'"'"'s eyebrow raising;

changing an appearance of the respective graphical feature includes opening the at least a portion of the graphical eye wider; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation above the at least a portion of the graphical eye by introducing a graphical eyebrow feature.

48. The method of claim 39, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye narrowing and the at least a portion of the user'"'"'s eyebrow lowering;

changing an appearance of the respective graphical feature includes closing the at least a portion of the graphical eye; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation above the at least a portion of the graphical eye by introducing a graphical eyebrow feature and deforming a portion of the graphical representation below the at least a portion of the graphical eye by introducing a graphical cheek feature.

49. The method of claim 39, wherein:

the first physical feature includes at least a portion of a user'"'"'s eye;

the respective graphical feature includes at least a portion of a graphical eye;

the second physical feature includes at least a portion of a user'"'"'s eyelid;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eye narrowing and the at least a portion of the user'"'"'s eyelid lowering;

changing an appearance of the respective graphical feature includes closing the at least a portion of the graphical eye; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical eye by introducing a graphical eyelid feature.

50. The method of claim 39, wherein:

the first physical feature includes at least a portion of a user'"'"'s lip;

the respective graphical feature includes at least a portion of a graphical mouth;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s lip having a pucker pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical mouth to include a set of graphical lips having a pucker pose.

51. The method of claim 39, wherein:

the first physical feature includes at least a portion of a user'"'"'s lip;

the respective graphical feature includes at least a portion of a graphical beak;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s lip having a pucker pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical beak to include a set of graphical lips having a pucker pose.

52. The method of claim 39, wherein the one or more physical features include a third physical feature that does not correspond to any of the plurality of graphical features, the one or more programs further including instructions for:

deforming a second portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face, wherein a magnitude or direction of deforming the second portion of the graphical feature is based on a magnitude or direction of change in the third physical feature.

53. The method of claim 52, wherein:

the second physical feature includes at least a portion of a user'"'"'s eyelid;

the third physical feature includes at least a portion of a user'"'"'s cheek;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eyelid closing and a change in the at least a portion of the user'"'"'s cheek;

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming a portion of the graphical representation by introducing a graphical eyelid feature; and

deforming a second portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming the second portion of the graphical representation by introducing a cheek feature.

54. The method of claim 39, wherein:

the second physical feature includes at least a portion of a user'"'"'s eyebrow;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s eyebrow raising; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face includes deforming an upper portion of a graphical head by introducing one or more protrusions extending from the upper portion of the graphical head.

55. The method of claim 39, wherein:

the first physical feature includes at least a portion of a user'"'"'s cheek;

the respective graphical feature includes at least a portion of a graphical cheek;

detecting the change in the plurality of physical features of the face includes detecting the at least a portion of the user'"'"'s cheek having an expanded pose; and

changing an appearance of the respective graphical feature includes modifying the at least a portion of the graphical cheek to include one or more protrusions extending from the graphical cheek.

56. The method of claim 39, the one or more programs further including instructions for:

while displaying the graphical representation, detecting a second change in the plurality of physical features of the face; and

in response to detecting the second change in the plurality of physical features of the face;

changing the appearance of the respective graphical feature of the plurality of graphical features wherein the magnitude or direction of change of the respective graphical feature is based on the magnitude or direction of the second change in the first physical feature; and

deforming the respective portion of the graphical representation that did not include a graphical feature prior to detecting the change in the one or more physical features of the face into one or more protrusions that were not displayed prior to detecting the change in the plurality of physical features of the face, wherein the magnitude or direction of deforming the respective portion of the graphical representation is based on the magnitude or direction of the second change in the second physical feature.

57. The method of claim 39, wherein the graphical representation is a virtual avatar, and the graphical feature is an avatar feature.