Computer-Implemented System And Method For Enhancing Visual Representation To Individuals Participating In A Conversation

• US 20140046665A1
• Filed: 10/18/2013
• Published: 02/13/2014
• Est. Priority Date: 02/28/2003
• Status: Active Grant

• Current Assignee: III Holdings 6, LLC (Intellectual Ventures LLC)
• Original Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Inventors: Aoki, Paul M., Szymanski, Margaret H., Thornton, James, Wilson, Daniel H., Woodruff, Allison G.
• Granted Patent: US 9,412,377 B2
• Time in Patent Office: Days
• US Class Current: 704/248
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04M 3/564 whereby the feature is a sub-conference
• CPC Class Codes: H04M 3/566 relating to a participants right to speak arrangements for multi-party communication with floor control, e.g. for conferences, H04L65/4038, H04L65/4046, H04L65/4053
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04M 3/569 using the instant speaker's algorithm speech detection per se G10L25/78

Abstract

A system and method for enhancing visual representation to individuals participating in a conversation is provided. Visual data for a plurality of individuals participating in one or more conversations is analyzed. Possible conversational configurations of the individuals are generated. Each possible conversational configuration includes one or more pair-wise probabilities of at least two of the individuals. A probability weight is assigned to each of the pair-wise probabilities having a likelihood that the individuals of that pair-wise probability are participating in a conversation. A probability of each possible conversational configuration is determined by combining the probability weights for the pair-wise probabilities of that possible conversational configuration. The possible conversational configuration with the highest probability is selected as a most probable configuration. The individuals participating in the conversations based on the pair-wise probabilities with the most probable configuration are determined. Visual representation is enhanced for each individual participating in the determined conversations.

Claims

1. A computer-implemented method for enhancing visual representation to individuals participating in a conversation, comprising:

analyzing visual data for a plurality of individuals participating in one or more conversations;

generating based on the visual data, a plurality of possible conversational configurations of the individuals, each possible conversational configuration comprising one or more pair-wise probabilities of at least two of the individuals;

assigning a probability weight to each of the pair-wise probabilities comprising a likelihood that the individuals of that pair-wise probability are participating in one of the conversations;

determining a probability of each possible conversational configuration by combining the probability weights for the pair-wise probabilities of that possible conversational configuration;

selecting one of the possible conversational configurations with the highest probability as a most probable configuration;

determining the individuals participating in the conversations based on the pair-wise probabilities of the most probable configuration; and

enhancing visual representation for each individual participating in the determined conversations.

2. A method according to claim 1, further comprising:

calculating a mean of the combined probability weights for the pair-wise probabilities of each possible conversational configuration as the probability of that possible conversational configuration.

3. A method according to claim 1, further comprising:

determining at least one of the possible conversational configurations, comprising;

representing each of the plurality of individuals as a node;

forming the pair-wise probabilities by connecting two or more nodes with at least one edge; and

combining the pair-wise probabilities as the possible conversational configuration.

4. A method according to claim 1, further comprising:

maintaining at least one of the determined conversations for a minimum number of timeslices.

5. A method according to claim 1, further comprising:

providing the individuals of one of the conversations with a different visual representation than members of a different conversation.

6. A method according to claim 1, further comprising:

highlighting for one of the individuals in one of the conversations, the other individuals in that conversation.

7. A method according to claim 1, further comprising:

generating a participant graph comprising a mapping of all possible parings of the plurality of individuals; and

assigning a weight to each pairing of the plurality of individuals.

8. A method according to claim 7, further comprising:

identifying for each pair-wise probability, the pairing represented by that pair-wise probability; and

assigning the weight of the pairing to the pair-wise probability.

9. A method according to claim 1, wherein the visual representations comprise at least one of graphical and textual representations.

10. A method according to claim 1, further comprising:

providing at least one of the individuals with an override option; and

allowing vocalizations from other individuals to be replaced by vocalizations from the individual with the override option.

11. A computer-implemented system for enhancing visual representation to individuals participating in a conversation, comprising:

a data analysis module to analyze visual data for a plurality of individuals participating in one or more conversations;

a configuration module to generate based on the visual data, a plurality of possible conversational configurations of the individuals, each possible conversational configuration comprising one or more pair-wise probabilities of at least two of the individuals;

a weight module to assign a probability weight to each of the pair-wise probabilities comprising a likelihood that the individuals of that pair-wise probability are participating in one of the conversations;

a probability module to determine a probability of each possible conversational configuration by combining the probability weights for the pair-wise probabilities of that possible conversational configuration;

a selection module to select one of the possible conversational configurations with the highest probability as a most probable configuration;

a conversation determination module to determine the individuals participating in the conversations based on the pair-wise probabilities of the most probable configuration; and

an enhancement module to enhance visual representation for each individual participating in the determined conversations.

12. A system according to claim 11, further comprising:

a calculation module to calculate a mean of the combined probability weights for the pair-wise probabilities of each possible conversational configuration as the probability of that possible conversational configuration.

13. A system according to claim 11, further comprising:

a configuration determination module to determine at least one of the possible conversational configurations by representing each of the plurality of individuals as a node, forming the pair-wise probabilities by connecting two or more nodes with at least one edge, and combining the pair-wise probabilities as the possible conversational configuration.

14. A system according to claim 11, further comprising:

a threshold module to maintain at least one of the determined conversations for a minimum number of timeslices.

15. A system according to claim 11, further comprising:

a display to provide the individuals of one of the conversations with a different visual representation than members of a different conversation.

16. A system according to claim 11, further comprising:

a visual display module to highlight for one of the individuals in one of the conversations, the other individuals in that conversation.

17. A system according to claim 11, further comprising:

a graph module to generate a participant graph comprising a mapping of all possible parings of the plurality of individuals; and

a pairing module to assign a weight to each pairing of the plurality of individuals.

18. A system according to claim 17, further comprising:

an identification module to identify for each pair-wise probability, the pairing represented by that pair-wise probability and to assign the weight of the pairing to the pair-wise probability.

19. A system according to claim 11, wherein the visual representations comprise at least one of graphical and textual representations.

20. A system according to claim 11, further comprising:

an override module to provide at least one of the individuals with an override option and to allow vocalizations from other individuals to be replaced by vocalizations from the individual with the override option.