Determining a mood for a group

• US 10,496,875 B1
• Filed: 07/17/2018
• Issued: 12/03/2019
• Est. Priority Date: 04/20/2015
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Chang, Sheldon
• Primary Examiner(s): Ahmed, Samir A
• Application Number:
  US16/037,870
• Time in Patent Office: 504 Days
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A system and method for determining a mood for a crowd is disclosed. In example embodiments, a method includes identifying an event that includes two or more attendees, receiving at least one indicator representing emotions of attendees, determining a numerical value for each of the indicators, and aggregating the numerical values to determine an aggregate mood of the attendees of the event.

Claims

1. A non-transitory computer readable medium comprising instructions that when executed configure hardware processing circuitry to perform operations comprising:

receiving, from a plurality of mobile computing devices, over a computer network, a corresponding plurality of messages from respective social network members to a corresponding second plurality of social network members, each message including one or more indicators comprising an image of a face of an attendee of an event;

determining a numerical value representing an intensity of emotion for each of the images based on a distribution of points on the face of the attendee within the image; and

causing display of a chart on a mobile computing device of the plurality of mobile computing devices that is based on an aggregation of the numerical values.

2. The non-transitory computer readable medium of claim 1, wherein the chart displays separate indicators for attendees having different demographical characteristics.

3. The non-transitory computer readable medium of claim 1, wherein the operations further comprise aggregating the numerical values to determine an aggregate mood of the attendees of the event, wherein the chart further plots the aggregate mood of the attendees over a period of time.

4. The non-transitory computer readable medium of claim 1, wherein the one or more indicators comprise a video and determining the numerical value is further based on a magnitude of an audio signal included with the video.

5. The non-transitory computer readable medium of claim 1, wherein the operations further comprise receiving additional indicators and updating an aggregate mood based on the additional indicators and displaying an updated chart based on the receiving of the additional indicators.

6. The non-transitory computer readable medium of claim 1, wherein the operations further comprise transmitting an aggregate mood to a device of a host for the event.

7. A method comprising:

receiving, from a plurality of mobile computing devices, over a computer network, a corresponding plurality of messages from respective social network members to a corresponding second plurality of social network members, each message including one or more indicators comprising an image of a face of an attendee of an event;

determining a numerical value representing an intensity of emotion for each of the images based on a distribution of points on the face of the attendee within the image; and

displaying a chart that is based on an aggregation of the numerical values.

8. The method of claim 7, wherein the chart displays separate indicators for attendees having different demographical characteristics.

9. The method of claim 7, further comprising aggregating the numerical values to determine an aggregate mood of the attendees of the event, wherein the chart further plots the aggregate mood of the attendees over a period of time.

10. The method of claim 7, wherein the one or more indicators comprise a video and determining a numerical values is further based on a magnitude of an audio signal included with the video.

11. The method of claim 7, further comprising receiving additional indicators and updating an aggregate mood based on the additional indicators and displaying an updated chart based on the receiving of the additional indicators.

12. A system comprising:

hardware processing circuitry;

a hardware memory storing instructions that when executed configure the hardware processing circuitry to perform operations comprising;

identifying an event based on receiving a threshold number of messages from different client devices of attendees of the event, the event including two or more attendees;

receiving at least one indicator representing a mood of the attendees from one or more of the different client devices, the indicator comprising an image of a face of an attendee;

determining a numerical value representing an intensity of emotion for each of the images based on a distribution of points on the face of the attendee within the image

generating a graphical representation based on the numerical values.

13. The system of claim 12, wherein the graphical representation includes separate indicators based on different demographical attributes of the attendees.

14. The system of claim 12, wherein the graphical representation further plots an aggregate mood of the attendees over a period of time based on the numerical values.

15. The system of claim 12, wherein the one or more indicators comprises a video and the operations further comprise determining the numerical values based on a magnitude of an audio signal included with the video.

16. The system of claim 12, wherein the indicators are extracted from the messages received from the different client devices of the attendees, and the images were captured by a respective camera operating as part of each attendee'"'"'s mobile computing device.

17. The system of claim 12, the operations further comprising aggregating the numerical values to determine an aggregate mood of the attendees of the event, wherein the graphical representation is further displayed to indicate the aggregate mood level.

18. The system of claim 17, the operations further comprising presenting the aggregate mood on a user interface viewable by a host for the event.

19. The system of claim 12, the operations further comprising receiving a message from the computer network, the message requesting to monitor attendee sentiment at the event.

20. The system of claim 12, wherein each image is captured by a camera operating as part of an attendee'"'"'s mobile computing device.