Integrating user personas with chat sessions

• US 9,774,548 B2
• Filed: 12/18/2013
• Issued: 09/26/2017
• Est. Priority Date: 12/18/2013
• Status: Active Grant

• Current Assignee: Personify Incorporated (Wilson Human Capital Group, Inc.)
• Original Assignee: Personify Incorporated (Wilson Human Capital Group, Inc.)
• Inventors: Lin, Dennis, Kowshik, Sumant, Patel, Sanjay
• Primary Examiner(s): Bycer, Eric J
• Application Number:
  US14/132,606
• Publication Number:
  US 20150172069A1
• Time in Patent Office: 1,378 Days
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04N 2005/2726 for simulating a person's appearance, e.g. hair style, glasses, clothes
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

Embodiments disclose extracting a user persona from a video of arbitrary duration and associating that persona with text for a chat session. Embodiments cause the persona to be extracted at the moment text is sent or received to convey the body language associated with the text.

Claims

1. A computer-implemented method for combining extracted personas with respective associated content during a chat session, the method comprising:

displaying a first-user persona associated with a first user and at least a second-user persona associated with a second user;

creating a plurality of first-user scenes, wherein creating a given first-user scene comprises;

receiving respective first-user content-balloon text;

extracting a respective contemporaneous first-user persona from a first video of the first user responsive to receiving the respective first-user content-balloon text; and

associating the respective contemporaneous first-user persona with the respective first-user content-balloon text so as to associate a respective expression of the first user with the respective first-user content-balloon text;

transmitting the respective first-user content-balloon texts and the respective contemporaneous first-user personas associated with the plurality of first-user scenes into the chat session;

sequentially displaying the plurality of first-user scenes, wherein displaying a given first-user scene comprises (i) serially displaying the respective first-user content-balloon text and (ii) updating the displayed first-user persona with the respective contemporaneous first-user persona that is associated with the respective first-user content-balloon text;

receiving a plurality of second-user scenes, wherein a given second-user scene associates a respective contemporaneous second-user persona from a second video of the second user with respective second-user content-balloon text; and

sequentially displaying the plurality of second-user scenes together with the displayed plurality of first-user scenes, wherein displaying a given second-user scene comprises (i) serially displaying the respective second-user content-balloon text and (ii) updating the displayed second-user persona with the respective contemporaneous second-user persona that is associated with the respective second-user content-balloon text.

2. The computer-implemented method of claim 1, further comprising receiving a contemporaneous first-user-persona approval for the respective contemporaneous first-user persona prior to updating the displayed first-user persona with the respective contemporaneous first-user persona and prior to transmitting the respective contemporaneous first-user persona.

3. The computer-implemented method of claim 1, further comprising receiving a selection corresponding to a displayed instance of first-user content-balloon text that is associated with a previously-displayed first-user persona, and responsively updating the displayed first-user persona with the previously-displayed first-user persona.

4. The computer-implemented method of claim 1, further comprising creating a textless scene in response to detecting a facial expression or physical gesture of the first user, wherein no first-user content-balloon text is received in connection with the textless scene, such that the textless scene contains a first-user persona representing the first user without associated first-user content-balloon text.

5. A non-transient computer-readable medium comprising a set of instructions which, when executed by a computer, combine extracted personas with respective associated content during a chat session, said set comprising instructions for:

displaying a first-user persona associated with a first user and at least a second-user persona associated with a second user;

creating a plurality of first-user scenes, wherein creating a given first-user scene comprises;

receiving respective first-user content-balloon text;

extracting a respective contemporaneous first-user persona from a first video of the first user responsive to receiving the respective first-user content-balloon text; and

associating the respective contemporaneous first-user persona with the respective first-user content-balloon text so as to associate a respective expression of the first user with the respective first-user content-balloon text;

transmitting the respective first-user content-balloon texts and the respective contemporaneous first-user personas associated with the plurality of first-user scenes into the chat session;

sequentially displaying the plurality of first-user scenes, wherein displaying a given first-user scene comprises (i) serially displaying the respective first-user content-balloon text and (ii) updating the displayed first-user persona with the respective contemporaneous first-user persona that is associated with the respective first-user content-balloon text;

receiving a plurality of second-user scenes, wherein a given second-user scene associates a respective contemporaneous second-user persona from a second video of the second user with respective second-user content-balloon text; and

sequentially displaying the plurality of second-user scenes together with the displayed plurality of first-user scenes, wherein displaying a given second-user scene comprises (i) serially displaying the respective second-user content-balloon text and (ii) updating the displayed second-user persona with the respective contemporaneous second-user persona that is associated with the respective second-user content-balloon text.

6. The non-transient computer-readable medium of claim 5, said set further comprising instructions for receiving a contemporaneous first-user-persona approval for the respective contemporaneous first-user persona prior to updating the displayed first-user persona with the respective contemporaneous first-user persona and prior to transmitting the respective contemporaneous first-user persona.

7. The non-transient computer-readable medium of claim 5, said set further comprising instructions for receiving a selection corresponding to a displayed instance of first-user content-balloon text that is associated with a previously-displayed first-user persona, and responsively updating the displayed first-user persona with the previously-displayed first-user persona.

8. The non-transient computer-readable medium of claim 5, said set further comprising instructions for creating a textless scene in response to detecting a facial expression or physical gesture of the first user, wherein no first-user content-balloon text is received in connection with the textless scene, such that the textless scene contains a first-user persona representing the first user without associated first-user content-balloon text.

9. A system for combining extracted personas with respective associated content during a chat session, the system comprising:

at least one computer; and

a non-transitory computer readable medium having stored thereon one or more programs, which when executed by the computer, cause the computer to;

display a first-user persona associated with a first user and at least a second-user persona associated with a second user;

create a plurality of first-user scenes, wherein creating a given first-user scene comprises;

receiving respective first-user content-balloon text;

extracting a respective contemporaneous first-user persona from a first video of the first user responsive to receiving the respective first-user content-balloon text; and

associating the respective contemporaneous first-user persona with the respective first-user content-balloon text so as to associate a respective expression of the first user with the respective first-user content-balloon text;

transmit the respective first-user content-balloon texts and the respective contemporaneous first-user personas associated with the plurality of first-user scenes into the chat session;

sequentially display the plurality of first-user scenes, wherein displaying a given first-user scene comprises (i) serially displaying the respective first-user content-balloon text and (ii) updating the displayed first-user persona with the respective contemporaneous first-user persona that is associated with the respective first-user content-balloon text;

receive a plurality of second-user scenes, wherein a given second-user scene associates a respective contemporaneous second-user persona from a second video of the second user with respective second-user content-balloon text; and

sequentially display, together with the displayed plurality of first-user scenes, the plurality of second-user scenes, wherein displaying a given second-user scene comprises (i) serially displaying the respective second-user content-balloon text and (ii) updating the displayed second-user persona with the respective contemporaneous second-user persona that is associated with the respective second-user content-balloon text.

10. The system of claim 9, wherein the system is further configured to receive a contemporaneous first-user-persona approval for the respective contemporaneous first-user persona prior to updating the displayed first-user persona with the respective contemporaneous first-user persona and prior to transmitting the respective contemporaneous first-user persona.

11. The system of claim 9, wherein the system is further configured to receive a selection corresponding to a displayed instance of first-user content-balloon text that is associated with a previously-displayed first-user persona, and to responsively update the displayed first-user persona with the previously-displayed first-user persona.

12. The system of claim 9, further comprising one or more programs, which when executed by the computer, cause the computer to create a textless scene in response to detecting a facial expression or physical gesture of the first user, wherein no first-user content-balloon text is received in connection with the textless scene, such that the textless scene contains a first-user persona representing the first user without associated first-user content-balloon text.