SOCIAL SYSTEM AND METHOD USED FOR BRINGING VIRTUAL SOCIAL NETWORK INTO REAL LIFE

• US 20130169680A1
• Filed: 03/15/2012
• Published: 07/04/2013
• Est. Priority Date: 12/29/2011
• Status: Active Grant

• Current Assignee: National Taiwan University (Government of The Republic of China)
• Original Assignee: National Taiwan University (Government of The Republic of China)
• Inventors: CHIEN, SHAO-YI, LAI, JUI-HSIN, LIN, JHE-YI, SU, MIN-YIAN, WU, PO-CHEN, KAO, CHIEH-CHI
• Granted Patent: US 9,329,677 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

The present invention is related to a social system and process used for bringing virtual social network into real life, which is allowed for gathering and analyzing a social message of at least one interlocutor from virtual social network so as to generate at least one recommended topic, allowing a user to talk with the interlocutor through the utilization of the recommended topic, and then capturing and analyzing at least one speech and behavior and/or physiological response of the interlocutor during talking so as to generate an emotion state of the interlocutor. The user is allowed to determine whether the interlocutor is interested in the recommended topic through the emotion state of interlocutor. Thus, it is possible to bring the social message on virtual network into real life, so as to increase communication topics between persons in real life.

Claims

1. A social system used for bringing virtual social network into real life comprising:

a social message processing module, gathering and analyzing a social message of at least one interlocutor from virtual social network so as to generate at least one recommended topic, said recommended topic being used by a user to talk with the interlocutor;

a video/audio capture module, capturing at least one speech and behavior of the interlocutor; and

an emotion analysis module, analyzing said speech and behavior of the interlocutor so as to generate an emotion state of the interlocutor.

2. The social system according to claim 1, wherein said recommended topic and said emotion state of the interlocutor are displayed on an image window.

3. The social system according to claim 1, wherein said video/audio capture module comprises a face recognition unit, said face recognition unit being used to recognize the face feature of interlocutor, and then to compare the recognized face feature of interlocutor with at least one personal picture to which each identity account on social network corresponds, so as to ascertain the identity of interlocutor.

4. The social system according to claim 2, further comprising a camera module, said camera module being used to shoot a real scene in which the user talks with the interlocutor, the video content of said real scene being displayed on said image window.

5. The social system according to claim 4, further comprising an augmented reality processing module, said augmented reality processing module comprising an unsalient region recognition unit, said unsalient region recognition unit recognizing at least one unsalient region from said real scene, said augmented reality processing module drawing said recommended topic and said emotion state in said unsalient region.

6. The social system according to claim 5, wherein said recommended topic and said emotion state are drawn in said unsalient region via the means of an object type.

7. The social system according to claim 6, wherein said augmented reality processing module further comprises:

a photorealistic rendering unit, performing a photorealistic rendering procedure on said recommended topic and said emotion state of the object type drawn in said unsalient region; and

a stable rendering unit, used to render said recommended topic and said emotion state of the object type in an appropriate place of said unsalient region steady;

wherein when said unsalient region within said real scene is moved since the shooting angle changes, said recommended topic and said emotion state of the object type are adjusted in placement by said stable rendering unit correspondingly.

8. The social system according to claim 4, further comprising an augmented reality processing module, said augmented reality processing module comprising a scene recognition unit, said scene recognition unit being used to recognize and analyze the content of scene, location of scene and/or shooting time of said real scene so as to generate a scene recognition result, said social message of the interlocutor and/or said scene recognition result being analyzed by said social message processing module so as to generate said recommended topic.

9. The social system according to claim 1, wherein said social system is installed in a mobile phone, a computer, an electronic glasses capable of displaying data message, or an electronic device capable of displaying data message.

10. A social system used for bringing virtual social network into real life comprising:

a social message processing module, gathering and analyzing a social message of at least one interlocutor from virtual social network so as to generate at least one recommended topic, said recommended topic being used by a user to talk with the interlocutor;

a physiology capture module, capturing at least one physiological response of the interlocutor; and

an emotion analysis module, analyzing said physiological response of the interlocutor so as to generate an emotion state of the interlocutor.

11. The social system according to claim 10, wherein said recommended topic and said emotion state of the interlocutor are displayed on an image window.

12. The social system according to claim 10, wherein said physiology capture module is a body temperature sensor, a blood pressure monitor, a breath monitor, a brain waves inspector, a pupil detector and/or an equipment capable of inspecting the physiological response of body.

13. The social system according to claim 10, further comprising a video/audio capture module having a face recognition unit, said face recognition unit being used to recognize the face feature of interlocutor, and then to compare the recognized face feature of interlocutor with at least one personal picture to which each identity account on social network corresponds, so as to ascertain the identity of interlocutor.

14. The social system according to claim 11, further comprising a camera module, said camera module being used to shoot a real scene in which the user talks with the interlocutor, the video content of said real scene being displayed on said image window.

15. The social system according to claim 14, further comprising an augmented reality processing module, said augmented reality processing module comprising an unsalient region recognition unit, said unsalient region recognition unit recognizing at least one unsalient region from said real scene, said augmented reality processing module drawing said recommended topic and said emotion state in said unsalient region.

16. The social system according to claim 15, wherein said recommended topic and said emotion state are drawn in said unsalient region via the means of an object type.

17. The social system according to claim 16, wherein said augmented reality processing module further comprises:

a photorealistic rendering unit, performing a photorealistic rendering procedure on said recommended topic and said emotion state of the object type drawn in said unsalient region; and

a stable rendering unit, used to render said recommended topic and said emotion state of the object type in an appropriate place of said unsalient region steady;

wherein

when said unsalient region of said real scene is moved since the shooting angle changes, said recommended topic and said emotion state of the object type are adjusted in placement by said stable rendering unit correspondingly.

18. The social system according to claim 14, further comprising an augmented reality processing module, said augmented reality processing module comprising a scene recognition unit, said scene recognition unit being used to recognize and analyze the content of scene, location of scene and/or shooting time of said real scene so as to generate a scene recognition result, said social message of the interlocutor and/or said scene recognition result being analyzed by said social message processing module so as to generate said recommended topic.

19. The social system according to claim 10, wherein said social system is installed in a mobile phone, a computer, an electronic glasses capable of displaying data message, or an electronic device capable of displaying data message.

20. A social method used for bringing virtual social network into real life comprising:

gathering and analyzing a social message of at least one interlocutor from virtual social network so as to generate at least one recommended topic;

allowing a user to talk with the interlocutor through the utilization of said recommended topic;

capturing at least one speech and behavior and/or physiological response of the interlocutor; and

analyzing said speech and behavior and/or said physiological response of the interlocutor so as to generate an emotion state of the interlocutor.

21. The social method according to claim 20, the steps thereof further comprising:

shooting a real scene in which the user talks with the interlocutor;

recognizing the content of scene, location of scene and/or shooting time of said real scene so as to generate a scene recognition result; and

analyzing said social message of the interlocutor and/or said scene recognition result so as to generate said recommended topic.