Facilitating television based interaction with social networking tools

• US 10,524,005 B2
• Filed: 08/07/2017
• Issued: 12/31/2019
• Est. Priority Date: 09/12/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Li, Wenlong, Tong, Xiaofeng, Du, Yangzhou, Li, Jianguo, Wang, Peng
• Primary Examiner(s): Bruckart, Benjamin R
• Assistant Examiner(s): Nguyen, Tien M
• Application Number:
  US15/670,024
• Publication Number:
  US 20170347151A1
• Time in Patent Office: Days
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

Video analysis may be used to determine who is watching television and their level of interest in the current programming Lists of favorite programs may be derived for each of a plurality of viewers of programming on the same television receiver.

Claims

1. An entertainment-related system for use in association with a television, a camera, and an Internet-accessible source of streaming video, the source being to provide streaming video related to an interactive game playable via an Internet network, the streaming video to be displayed via the television, the entertainment-related system comprising:

a processor;

storage to store program instructions to be executed by the processor, the program instructions, when executed by the processor, resulting in the entertainment-related system being capable of performing operations comprising;

performing facial recognition-related processing, based upon (1) facial image information associated with facial image capture by the camera of multiple users presently in front of and viewing the television and (2) previously stored facial image data the multiple users comprising at least one of the multiple users at the television who is to be logged in to the entertainment-related system, the facial recognition-related processing to be used by the entertainment-related system for;

automatic user identification determination of the multiple users presently in front of and viewing the television; and

logging in to the entertainment-related system of at least one of the multiple users;

performing facial expression analysis based upon the facial image information, the facial expression analysis to be used to determine at least one facial expression of the at least one of the multiple users;

capturing, for social network distribution, video clip data comprising at least a portion of the streaming video that is currently being viewed by the at least one of the multiple users at the television; and

providing, via a social interaction networking tool, for the social network distribution, current viewing-related activity information of the at least one of the multiple users for use in facilitating social interaction via the tool, the current viewing-related activity information indicating (1) user viewing status of the at least one of the multiple users at the television and (2) satisfaction level of the at least one of the multiple users at the television the satisfaction level being capable of being based upon the at least one facial expression the video clip data to be provided for use in the social network distribution together with the current viewing-related activity information.

2. The entertainment-related system of claim 1, wherein:

the previously stored facial data is to be stored in the storage during set up of the entertainment-related system;

the camera is to be coupled to an interface of the entertainment-related system; and

the entertainment-related system is also to permit a password-based user login.

3. The entertainment-related system of claim 1, wherein:

the entertainment-related system is capable of providing, via the social network distribution, user like information, user dislike information, user interest information, and/or user disinterest information; and

/or

the entertainment-related system further comprises the camera.

4. The entertainment-related system of claim 1, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by the entertainment-related system.

5. The entertainment-related system of claim 1, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by a remote server.

6. At least one non-transitory computer-readable medium storing instructions for execution by an entertainment-related system, the entertainment-related system being for use in association with a television, a camera, and an Internet-accessible source of streaming video, the source being to provide streaming video related to an interactive game playable via an Internet network, the streaming video to be displayed via the television, the instructions when executed by the entertainment-related system resulting in the entertainment-related system being capable of performing operations comprising:

performing facial recognition-related processing, based upon (1) facial image information associated with facial image capture by the camera of multiple users presently in front of and viewing the television and (2) previously stored facial image data the multiple users comprising at least one of the multiple users at the television who is to be logged in to the entertainment-related system, the facial recognition-related processing to be used by the entertainment-related system for;

automatic user identification determination of the multiple users presently in front of and viewing the television; and

logging in to the entertainment-related system of the at least one of the multiple users;

performing facial expression analysis based upon the facial image information, the facial expression analysis to be used to determine at least one facial expression of the at least one of the multiple users;

capturing, for social network distribution, video clip data comprising at least a portion of the streaming video that is currently being viewed by the at least one of the multiple users at the television; and

providing, via a social interaction networking tool, for the social network distribution, current viewing-related activity information of the at least one of the multiple users for use in facilitating social interaction via the tool, the current viewing-related activity information indicating (1) user viewing status of the at least one of the multiple users at the television and (2) satisfaction level of the at least one of the multiple users at the television the satisfaction level being capable of being based upon the at least one facial expression the video clip data to be provided for use in the social network distribution together with the current viewing-related activity information.

7. The at least one non-transitory computer-readable medium of claim 6, wherein:

the previously stored facial data is to be stored in storage of the entertainment-related system during set up of the entertainment-related system;

the camera is separate from the television and is to be coupled to an interface of the entertainment-related system; and

the entertainment-related system is also to permit a password-based user login.

8. The at least one non-transitory computer-readable medium of claim 6, wherein:

the entertainment-related system is capable of providing, via the social network distribution, user like information, user dislike information, user interest information, and/or user disinterest information; and

/or

the entertainment-related system further comprises the camera.

9. The at least one non-transitory computer-readable medium of claim 6, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by the entertainment-related system.

10. The at least one non-transitory computer-readable medium of claim 6, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by a remote server.

11. A method implemented, at least in part, using an entertainment-related system, the entertainment-related system being for use in association with a television, a camera, and an Internet-accessible source of streaming video, the source being to provide streaming video related to an interactive game playable via an Internet network, the streaming video to be displayed via the television, the method comprising:

performing facial recognition-related processing, based upon (1) facial image information associated with facial image capture by the camera of multiple users presently in front of and viewing the television and (2) previously stored facial image data the multiple users comprising at least one of the multiple users at the television who is to be logged in to the entertainment-related system, the facial recognition-related processing to be used by the entertainment-related system for;

automatic user identification determination of the multiple users presently in front of and viewing the television; and

logging in to the entertainment-related system of at least one of the multiple users;

performing facial expression analysis based upon the facial image information, the facial expression analysis to be used to determine at least one facial expression of the at least one of the multiple users;

capturing, for social network distribution, video clip data comprising at least a portion of the streaming video that is currently being viewed by the at least one of the multiple users; and

providing, via a social interaction networking tool, for the social network distribution, current viewing-related activity information of the user present at the television for use in facilitating social interaction via the tool, the current viewing-related activity information indicating (1) user viewing status of the at least one of the multiple users at the television and (2) satisfaction level of the at least one of the multiple users at the television the satisfaction level being capable of being based upon the at least one facial expression, the video clip data to be provided for use in the social network distribution together with the current viewing-related activity information.

12. The method of claim 11, wherein:

the previously stored facial data is to be stored in storage of the entertainment-related system during set up of the entertainment-related system;

the camera is separate from the television and is to be coupled to an interface of the entertainment-related system; and

the entertainment-related system is also to permit a password-based user login.

13. The method of claim 11, wherein:

the entertainment-related system is capable of providing, via the social network distribution, user like information, user dislike information, user interest information, and/or user disinterest information; and

/or

the entertainment-related system further comprises the camera.

14. The method of claim 11, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by the entertainment-related system.

15. The method of claim 11, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by a remote server.

16. An entertainment-related system for use in association with a television, a camera, and an Internet-accessible source of streaming video, the source being to provide streaming video related to an interactive game playable via an Internet network, the streaming video to be displayed via the television, the entertainment-related system comprising:

facial recognition-related processor to perform processing, based upon (1) facial image information associated with facial image capture by the camera of multiple users presently in front of and viewing the television and (2) previously stored facial image data the multiple users comprising at least one of the multiple users at the television who is to be logged in to the entertainment-related system, the facial recognition-related processing to be used by the entertainment-related system for;

automatic user identification determination of the multiple users presently in front of and viewing the television; and

logging in to the entertainment-related system of at least one of the multiple users;

the entertainment-related system being to perform facial expression analysis based, upon the facial image information, the facial expression analysis to be used to determine at least one facial expression of the at least one of the multiple users;

the entertainment-related system being to capture, for social network distribution, video clip data comprising at least a portion of the streaming video that is currently being viewed by the at least one of the multiple users at the television; and

the entertainment-related system being to provide, via a social interaction networking tool, for the social network distribution, current viewing-related activity information of the at least one of the multiple users for use in facilitating social interaction via the tool, the current viewing-related activity information indicating (1) user viewing status of the at least one of the multiple users at the television and (2) satisfaction level of the at least one of the multiple users at the television the satisfaction level being capable of being based upon the at least one facial expression, the video clip data to be provided for use in the social network distribution together with the current viewing-related activity information.

17. The entertainment-related system of claim 16, wherein:

the previously stored facial data is to be stored in storage of the entertainment-related system during set up of the entertainment-related system;

the camera is separate from the television and is to be coupled to an interface of the entertainment-related system; and

/or

the entertainment-related system is also to permit a password-based user login.

18. The entertainment-related system of claim 16, wherein:

the entertainment-related system is capable of providing, via the social network distribution, user like information, user dislike information, user interest information, and/or user disinterest information; and

/or

the entertainment-related system further comprises the camera.

19. The entertainment-related system of claim 16, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by the entertainment-related system.

20. The entertainment-related system of claim 16, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by a remote server.

21. An entertainment-related system for use in association with a television, a camera, and an Internet-accessible source of streaming video, the source being to provide streaming video related to an interactive game playable via an Internet network, the streaming video to be displayed via the television, the entertainment-related system comprising:

a processor;

storage to store program instructions to be executed by the processor, the program instructions, when executed by the processor, resulting in the entertainment-related system being capable of performing operations comprising;

performing facial recognition-related processing based upon (1) facial image information associated with facial image capture by the camera of multiple users presently in front of and viewing the television and (2) previously stored facial image data the multiple users comprising at least one of the multiple users at the television who is to be logged in to the entertainment-related system, the facial recognition-related processing to be used by the entertainment-related system for;

automatic user identification determination of the multiple users presently in front of and viewing the television; and

logging in to the entertainment-related system of at least one of the multiple users;

performing facial expression analysis based upon the facial image information, the facial expression analysis to be used to determine at least one facial expression of the at least one of the multiple users;

capturing, for social network distribution, video clip data comprising at least a portion of the streaming video that is currently being viewed by the at least one of the multiple users at the television; and

providing, via a social interaction networking tool, for the social network distribution, current viewing-related activity information of the at least one of the multiple users for use in facilitating social interaction via the tool, the current viewing-related activity information indicating (1) user viewing status of the at least one of the multiple users at the television and (2) satisfaction level of the at least one of the multiple users at the television the satisfaction level being capable of being based upon the at least one facial expression, the video clip data to be provided for use in the social network distribution together with the current viewing-related activity information;

wherein;

the camera is separate from the television.

22. The entertainment-related system of claim 21, wherein:

the previously stored facial data is to be stored in the storage during set up of the entertainment-related system;

the camera is to be coupled to an interface of the entertainment-related system; and

the entertainment-related system is also to permit a password-based user login.

23. The entertainment-related system of claim 21, wherein:

the entertainment-related system is capable of providing, via the social network distribution, user like information, user dislike information, user interest information, and/or user disinterest information; and

/or

the entertainment-related system further comprises the camera.

24. The entertainment-related system of claim 21, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by the entertainment-related system.

25. The entertainment-related system of claim 21, wherein:

the facial recognition-related processing and the facial expression analysis are performed, at least in part, by a remote server.