System and Method for User-Behavior Based Content Recommendations

• US 20170185669A1
• Filed: 12/29/2015
• Published: 06/29/2017
• Est. Priority Date: 12/29/2015
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Chang, E-Cheng, Huang, Yuning
• Granted Patent: US 10,664,500 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/287 Visualization; Browsing
• CPC Class Codes: G06F 16/288 Entity relationship models
• CPC Class Codes: G06F 16/437 Administration of user profiles, e.g. generation, initialisation, adaptation, distribution
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/90324 using system suggestions

Abstract

A system and method of predicting a user'"'"'s most meaningful multimedia content includes enabling a sensing device on a user device in response to a user requesting a multimedia operation, performing the multimedia operation for a multimedia content, in response to the multimedia operation, identifying behavioral and interaction cues of the user with the sensing device substantially when the multimedia operation is being performed, updating a recommendation from a set of multimedia content including the multimedia content represented by the behavioral and interaction cues identified, and presenting the updated recommendation to the user.

Claims

1. A method comprising:

enabling a sensing device on a user device in response to a user requesting a multimedia operation;

performing the multimedia operation for a multimedia content;

in response to the multimedia operation, identifying behavioral and interaction cues of the user with the sensing device substantially when the multimedia operation is being performed;

updating a recommendation from a set of multimedia content including the multimedia content represented by the behavioral and interaction cues identified; and

presenting the updated recommendation to the user.

2. The method of claim 1, further comprising:

requesting feedback from the user in response to presenting the updated recommendation;

classifying the feedback from the user as a positive reaction or a negative reaction to produce feedback cues; and

further updating the recommendation from the set of multimedia content in accordance with the feedback cues.

3. The method of claim 1, wherein identifying the behavioral and interaction cues of the user comprises:

searching for multimedia sub-cues in the behavioral and interaction cues; and

classifying the multimedia sub-cues as positive reactions or negative reactions.

4. The method of claim 3, wherein searching for multimedia sub-cues comprises producing the multimedia sub-cues in response to a view time for the multimedia content.

5. The method of claim 3, wherein searching for multimedia sub-cues comprises producing the multimedia sub-cues in response to the user sharing the multimedia content.

6. The method of claim 3, wherein searching for multimedia sub-cues comprises producing the multimedia sub-cues in response to the user editing the multimedia content.

7. The method of claim 3, wherein searching for multimedia sub-cues comprises producing the multimedia sub-cues in response to the user zooming into the multimedia content.

8. The method of claim 3, wherein searching for multimedia sub-cues comprises producing the multimedia sub-cues in response to the user rotating the user device in order to match an orientation of the user device with an orientation of the multimedia content.

9. The method of claim 1, wherein identifying the behavioral and interaction cues of the user comprises:

capturing facial expressions of the user with the sensing device; and

recognizing the facial expressions of the user to produce the behavioral and interaction cues.

10. The method of claim 9, wherein recognizing the facial expressions comprises classifying the facial expressions of the user as a positive facial reaction, a negative facial reaction, or a lack of facial reaction.

11. The method of claim 9, wherein recognizing the facial expressions comprises recognizing a gaze of the user as the user stares at a hotspot on a display of the user device.

12. The method of claim 1, wherein identifying the behavioral and interaction cues of the user comprises:

capturing ambient activity with the sensing device; and

analyzing the ambient activity to produce the behavioral and interaction cues.

13. The method of claim 12, wherein capturing the ambient activity comprises capturing sound with the sensing device while performing the multimedia operation.

14. The method of claim 12, wherein capturing the ambient activity comprises:

capturing video with the sensing device;

performing facial recognition to detect subjects in the video; and

correlating subjects in the video with entries in a contact list on the user device.

15. The method of claim 1, wherein the multimedia operation comprises capturing a photograph or a video.

16. The method of claim 1, wherein the multimedia operation comprises displaying a photograph or a video.

17. A method comprising:

providing a plurality of multimedia content on a user device;

capturing behavioral and interactive actions of a user with a sensing device when the user accesses the multimedia content;

analyzing the behavioral and interactive actions to produce multimedia cues;

assigning weights to each of the multimedia cues;

generating a score for each of the plurality of multimedia content in accordance with the weights and the multimedia cues; and

presenting recommendations of the multimedia content to the user in accordance with the scores.

18. The method of claim 17, further comprising:

adjusting the weights for each of the multimedia cues in accordance with the behavioral and interactive actions of the user; and

normalizing the weights.

19. The method of claim 17, wherein generating the scores for each of the plurality of multimedia content comprises:

computing and summing raw scores for each of the multimedia cues in accordance with the weights;

computing and applying a correlation factor to the raw scores; and

applying a learning factor to the raw scores to produce the scores.

20. The method of claim 19, wherein producing the scores comprises computing the score according to:

21. A device comprising:

a sensing device;

a processor; and

a computer-readable storage medium storing a program to be executed by the processor, the program including instructions to perform a method comprising;

enabling the sensing device in response to a user requesting a multimedia operation;

identifying behavioral and interaction cues of the user with the sensing device while performing the multimedia operation;

associating the behavioral and interaction cues with the multimedia operation;

ranking multimedia content in accordance with a model, the model including the behavioral and interaction cues; and

presenting recommendations of a subset of the multimedia content to the user in accordance with the ranks of the multimedia content.

22. The device of claim 21, wherein the instructions for identifying the behavioral and interaction cues comprise instructions for capturing and analyzing ambient sounds to produce the behavioral and interaction cues.

23. The device of claim 21, wherein the instructions for identifying the behavioral and interaction cues comprise instructions for capturing and recognizing facial expressions of the user to produce the behavioral and interaction cues.

24. The device of claim 21, wherein the instructions for identifying the behavioral and interaction cues comprise instructions for searching for photo sub-cues in the multimedia content and classifying the photo sub-cues as positive reactions or negative reactions to produce the behavioral and interaction cues.

25. The device of claim 21, wherein the program further includes instructions for:

presenting the multimedia content to the user;

requesting feedback from the user in response to presenting the multimedia content;

classifying the feedback from the user as a positive reaction or a negative reaction to produce feedback cues; and

further ranking the multimedia content in accordance with the model, the model including the feedback cues and the behavioral and interaction cues.

26. A device comprising:

a sensing device;

a memory storing a plurality of multimedia content;

a processor; and

a computer-readable storage medium storing a program to be executed by the processor, the program including instructions for;

receiving a request from a user to perform a multimedia operation;

performing the multimedia operation while retrieving data with the sensing device;

updating a recommendation of a subset of the multimedia content in accordance with the request and the retrieved data; and

presenting the updated recommendation to the user.

27. The device of claim 26, wherein the program further includes instructions for:

requesting feedback from the user in response to presenting the updated recommendation; and

further updating the recommendation of the subset of the multimedia content in accordance with the feedback.

28. The device of claim 26, wherein the instruction for retrieving data with the sensing device comprises instructions for sensing behavior of the user with the sensing device.

29. The device of claim 26, wherein the sensing device is one of a microphone or a front camera.