SYSTEM AND METHOD FOR FACIAL EXPRESSION CONTROL OF A USER INTERFACE

• US 20090110246A1
• Filed: 11/15/2007
• Published: 04/30/2009
• Est. Priority Date: 10/30/2007
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Andersson, Jonas, Katz, Darius, OLSSON, Stefan
• Application Number:
  US11/940,358
• Publication Number:
  US 20090110246A1
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264

Abstract

A mobile device obtains user input of message media for transmission to a remote device. The mobile device comprises a user interface including a display screen displaying information in accordance with a selected emotional indicator and an input device for obtaining the user input of the message media. A storage comprising a plurality of records, each associated with one of a plurality of predetermined emotional categories. A camera is directed towards the user for capturing an image of the user'"'"'s face at a time proximate to user input of the message media. An emotional categorization module categorizes the image of the user'"'"'s face to one of the plurality of predetermined emotional categories and selects the emotional indicator associated therewith as the selected emotional indicator.

Claims

1. A mobile device for obtaining user input of message media for transmission in association with a selected emotional indicator to a remote device, the mobile device comprising:

a user interface comprising an input device for obtaining the user input of the message media;

a camera directed for capturing an image of the user'"'"'s face at a time proximate to user input of the message media;

an emotional categorization module categorizing the image of the user'"'"'s face to one of the plurality of predetermined emotional categories and selecting an emotional indicator associated with the predetermined emotional category as the selected emotional indicator for transmission to the remote device.

2. The mobile device of claim 1, wherein:

the message media comprises a text message; and

the selected emotional indicator comprises an emoticon; and

the emotional categorization module further inserts into the text message, the emoticon.

3. The mobile device of claim 1, wherein:

the selected emotional indicator comprises at least one style parameter whereby the remote device may drive display of the message media in accordance with the style parameter.

4. The mobile device of claim 3, wherein the style parameter comprises at least one of:

background color, font color, font style, and frame border.

5. The mobile device of claim 4, wherein the style parameter includes at least two cultural variations;

and

the emotional categorization module further determines, in accordance with user demographic data, a selected cultural variation for transmission to the remote device.

6. The mobile device of claim 3, wherein:

the message media comprises a text message; and

the selected emotional indicator further comprises an emoticon; and

the emotional categorization module further inserts into the text message, the emoticon.

7. The mobile device of claim 1, wherein:

the selected emotional indicator comprises at least one style parameter whereby the remote device may drive display of the message media in accordance with the style parameter; and

the user interface further comprises a display screen displaying the message media in accordance with the style parameter.

8. The mobile device of claim 7, wherein the style parameter comprises at least one of:

background color, font color, font style, and frame border.

9. The mobile device of claim 8, wherein the style parameter includes at least two cultural variations;

and

the emotional categorization module further determines, in accordance with user demographic data, a selected cultural variation for transmission to the remote device.

10. The mobile device of claim 7, wherein:

the message media comprises a text message; and

the selected emotional indicator further comprises an emoticon; and

the emotional categorization module further inserts into the text message, the emoticon.

11. A mobile device for obtaining user input of message media for transmission to a remote device, the mobile device comprising:

a user interface comprising a display screen displaying information in accordance with a selected emotional indicator an input device for obtaining the user input of the message media;

a camera directed for capturing an image of the user'"'"'s face at a time proximate to user input of the message media;

an emotional categorization module categorizing the image of the user'"'"'s face to one of the plurality of predetermined emotional category and selecting an emotional indicator associated with the predetermined emotional category as the selected emotional indicator.

12. The mobile device of claim 11, wherein:

the message media comprises a text message; and

the selected emotional indicator comprises an emoticon; and

the emotional categorization module further inserts into the text message, the emoticon.

13. The mobile device of claim 11, wherein:

the selected emotional indicator comprises at least one style parameter; and

the display screen displays information in accordance with the style parameter.

14. The mobile device of claim 13, wherein the style parameter comprises at least one of:

background color, font color, font style, and frame border.

15. The mobile device of claim 13, wherein the style parameter includes at least two cultural variations;

and

the emotional categorization module further determines, in accordance with user demographic data, a selected cultural variation for control of rendering information on the display screen.

16. The mobile device of claim 13, wherein:

the message media comprises a text message; and

the selected emotional indicator further comprises an emoticon; and

the emotional categorization module further inserts into the text message, the emoticon.

17. The mobile device of claim 11, wherein the selected emotional indicator is transferred to the remote device in conjunction with the message media.

18. The mobile device of claim 17, wherein:

the message media comprises a text message; and

the selected emotional indicator comprises an emoticon; and

the emotional categorization module further inserts into the text message, the emoticon.

19. The mobile device of claim 11, wherein:

the selected emotional indicator comprises at least one style parameter; and

the display screen displays information in accordance with the style parameter.

20. The mobile device of claim 19, wherein the style parameter comprises at least one of:

background color, font color, font style, and frame border.