MEASURING USER ENGAGEMENT OF CONTENT

• US 20140270683A1
• Filed: 03/15/2013
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yang, Nan, Koushik, Meghana, Zhu, Yingnan, Kashyap, Praveen, Gava, Fabio
• Granted Patent: US 9,531,985 B2
• Time in Patent Office: Days
• US Class Current: 386/224
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/44226 on social networks
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4662 characterized by learning algorithms
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A system for measuring user engagement of content comprises an electronic device for playing a piece of content, at least one sensor for capturing data relating to environment context and user activity during playback of the piece of content, and an engagement measurement application for measuring user engagement of the piece of content. The engagement measurement application measures user engagement of the piece of content based on data captured by the sensors.

Claims

1. A system for measuring user engagement of content, comprising:

an electronic device for playing a piece of content;

at least one sensor for capturing data relating to environment context and user activity during playback of said piece of content; and

an engagement measurement application module for measuring user engagement of said piece of content based on data captured by said at least one sensor.

2. The system of claim 1, wherein:

data relating to environment context includes data relating to a user environment.

3. The system of claim 2, wherein:

said at least one sensor includes a camera configured to capture images and videos showing user activity and the user environment.

4. The system of claim 2, wherein:

said at least one sensor includes a microphone configured to capture audio of user activity and the user environment.

5. The system of claim 1, wherein:

data relating to user activity includes one or more of;

facial expressions of one or more users, body movements of said one or more users, user interactions with a remote control unit, and user interactions with a connected device.

6. The system of claim 2, wherein:

data relating to the user environment includes one or more of;

lighting conditions of the user environment, and noise levels of the user environment.

7. The system of claim 2, further comprising:

a content metadata application module for capturing metadata relating to said piece of content; and

a feature extraction application module for extracting different engagement features from the data captured by said at least one sensor, wherein each engagement feature is a metric corresponding to a particular user activity.

8. The system of claim 7, further comprising:

a data structure maintaining information relating to user engagement of different pieces of content in different contexts.

9. A method for measuring user engagement of content, comprising:

playing a piece of content using an electronic device;

capturing data relating to environment context and

user activity during playback of said piece of content; and

measuring user engagement of said piece of content based on data captured.

10. The method of claim 9, wherein:

data relating to environment context includes data relating to a user environment.

11. The method of claim 10, wherein:

capturing data relating to user activity comprises capturing images and videos showing user activity; and

capturing data relating to user activity comprises capturing images and videos showing the user environment.

12. The method of claim 10, wherein:

capturing data relating to user activity comprises capturing audio of user activity; and

capturing data relating to user activity comprises capturing audio of the user environment.

13. The method of claim 9, wherein:

data relating to user activity includes one or more of;

facial expressions of one or more users, body movements of said one or more users, user interactions with a remote control unit, and user interactions with a connected device.

14. The method of claim 10, wherein:

data relating to the user environment includes one or more of;

lighting conditions of the user environment, and noise levels of the user environment.

15. The method of claim 10, further comprising:

capturing metadata relating to said piece of content; and

extracting different engagement features from the data captured, wherein each engagement feature is a metric corresponding to a particular user activity.

16. The method of claim 15, further comprising:

maintaining information relating to user engagement of different pieces of content in different contexts.

17. A non-transitory computer-readable medium having instructions which when executed on a computer perform a method comprising:

playing a piece of content;

capturing data relating to environment context and user activity during playback of said piece of content; and

measuring user engagement of said piece of content based on the data captured.

18. The medium of claim 17, wherein:

data relating to environment context includes data relating to a user environment.

19. The medium of claim 18, further executable by the computer to:

capture images and videos showing user activity; and

capture images and videos showing the user environment.

20. The medium of claim 18, further executable by the computer to:

capture audio of user activity; and

capture audio of the user environment.

21. The medium of claim 17, wherein:

data relating to user activity includes one or more of;

facial expressions of one or more users, body movements of said one or more users, user interactions with a remote control unit, and user interactions with a connected device.

22. The medium of claim 18, wherein:

data relating to the user environment includes one or more of;

lighting conditions of the user environment, and noise levels of the user environment.

23. The medium of claim 18, further executable by the computer to:

capture metadata relating to said piece of content; and

extract different engagement features from the data captured, wherein each engagement feature is a metric corresponding to a particular user activity.

24. The medium of claim 23, further executable by the computer to:

maintain information relating to user engagement of different pieces of content in different contexts.

25. An apparatus for measuring user engagement of content, comprising:

a data processing unit configured to receive data relating to environment context and user activity during playback of a piece of content; and

an engagement measurement application module configured to measure user engagement of said piece of content based on the data received.

26. The apparatus of claim 25, wherein:

data relating to environment context includes data relating to a user environment.

27. The apparatus of claim 26, wherein:

the data received includes images and videos showing user activity and the user environment.

28. The apparatus of claim 26, wherein:

the data received includes audio of user activity and the user environment.

29. The apparatus of claim 26, further comprising:

a content metadata application module for capturing metadata relating to

said piece of content; and

a feature extraction application module for extracting different engagement features from the data received, wherein each engagement feature is a metric corresponding to a particular user activity.

30. The apparatus of claim 29, further comprising:

a data structure maintaining information relating to user engagement of different pieces of content in different contexts.