Method and apparatus for generating meta data of content

• US 20080101660A1
• Filed: 03/30/2007
• Published: 05/01/2008
• Est. Priority Date: 10/27/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Seo, Joon-kyu
• Granted Patent: US 7,953,254 B2
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

A method and apparatus are provided for generating emotional information including a user'"'"'s impressions in relation to multimedia content or meta data regarding the emotional information, and a computer readable recording medium storing the method. The meta data generating method includes receiving emotional information in relation to the content from at least one client system which receives and reproduces the content; generating meta data for an emotion using the emotional information; and coupling the meta data for the emotion to the content. Accordingly, it is possible to automatically acquire emotional information by using the facial expression of a user who is appreciating multimedia content, and use the emotional information as meta data.

Claims

1. A method of generating meta data of content, the method comprising:

receiving emotional information in relation to the content from at least one client system which receives and reproduces the content;

generating meta data for an emotion using the emotional information; and

coupling the meta data for the emotion to the content.

2. The method of claim 1, wherein the generating the meta data for the emotion comprises determining a representative type of emotion representing the content.

3. The method of claim 1, wherein the generating the meta data for the emotion comprises determining a representative type of emotion representing each scene of the content.

4. The method of claim 1, wherein the generating the meta data for the emotion comprises determining a representative type of emotion for each predetermined time period during reproduction of the content.

5. The method of claim 1, wherein the coupling the meta data for the emotion to the content comprises adding the meta data for the emotion to existing meta data of the content.

6. The method of claim 5, wherein the adding the meta data for the emotion comprises, if the content is a broadcast program, adding the meta data for the emotion to an electronic program guide for the broadcast program.

7. The method of claim 5, wherein the adding the meta data for the emotion comprises adding the meta data for the emotion to header information of the content.

8. The method of claim 1, further comprising, before providing the content to the at least one client system, adding information about a time required for acquiring a user image to the meta data of the content, to allow the at least one client system to acquire the emotional information.

9. A computer readable recording medium storing a computer program for performing a method of generating meta data of content, the method comprising:

receiving emotional information in relation to the content from at least one client system which receives and reproduces the content;

generating meta data for an emotion using the emotional information; and

coupling the meta data for the emotion to the content.

10. A method of generating emotional information in relation to content, the method comprising:

acquiring a user image while the content is reproduced;

extracting facial information from the user image;

generating the emotional information in relation to the content by comparing the facial information with facial expression template information; and

transmitting the emotional information to a server which provides the content.

11. The method of claim 10, wherein the acquiring the user image comprises acquiring the user image whenever each scene of the content is reproduced.

12. The method of claim 10, wherein the acquiring the user image comprises receiving at least two user images from an image input unit while the content is reproduced.

13. The method of claim 12, wherein the generating the emotional information comprises generating representative emotional information representing emotional information generated from the at least two user images.

14. The method of claim 10, wherein the acquiring the user image comprises acquiring the user image at a time corresponding to an emotional information acquiring time included in the meta data of the content.

15. The method of claim 10, wherein the generating the emotional information comprises, if a plurality of pieces of the facial information are extracted from the user image, generating emotional information corresponding to each piece of the facial information.

16. The method of claim 10, wherein the generating the emotional information comprises generating emotional information including a type and strength of an emotion when the user image is acquired, with reference to the facial expression template information.

17. The method of claim 10, further comprising, before generating the emotional information, normalizing a size of the extracted facial information in correspondence to a size of the facial expression template information.

18. A computer readable recording medium storing a computer program for performing a method of generating emotional information in relation to content, the method comprising:

acquiring a user image while the content is reproduced;

extracting facial information from the user image;

generating the emotional information in relation to the content by comparing the facial information with facial expression template information; and

transmitting the emotional information to a server which provides the content.

19. An apparatus for generating meta data of content, the apparatus comprising:

a communication unit which receives emotional information in relation to the content from at least one client system which receives and reproduces the content; and

a meta data generating unit which generates meta data for an emotion using the emotional information, and couples the meta data for the emotion to the content.

20. The apparatus of claim 19, wherein the meta data generating unit determines a representative type of emotion representing the content.

21. The apparatus of claim 19, wherein the meta data generating unit determines a representative type of emotion representing each scene of the content.

22. The apparatus of claim 19, wherein the meta data generating unit determines a representative type of emotion for each predetermined time period.

23. The apparatus of claim 19, wherein the meta data generating unit adds the meta data for the emotion to existing meta data of the content.

24. The apparatus of claim 23, wherein, if the content is a broadcast program, the meta data generating unit adds the meta data for the emotion to an electronic program guide for the broadcast program.

25. The apparatus of claim 23, wherein the meta data generating unit adds the meta data for the emotion to header information of the content.

26. The apparatus of claim 19, wherein the meta data generating unit adds information about a time required for acquiring a user image to the meta data of the content, to allow the at least one client system to acquire the emotional information, before providing the content to the at least one client system.

27. An apparatus for generating emotional information in relation to content, the apparatus comprising:

an image input unit which acquires a user image while the content is reproduced;

a facial image extraction unit which extracts facial information from the user image;

an emotional information generating unit which compares the facial information with facial expression template information, and generates the emotional information in relation to the content based on a result of the comparison; and

a communication unit which transmits the emotional information to a server which provides the content.

28. The apparatus of claim 27, wherein the image input unit acquires the user image whenever each scene of the content is reproduced.

29. The apparatus of claim 27, wherein the image input unit acquires at least two user images while the content is reproduced.

30. The apparatus of claim 29, wherein the emotional information generating unit generates representative emotional information which represents the emotional information generated from the at least two user images.

31. The apparatus of claim 27, wherein the image input unit acquires the user image at a time corresponding to an emotional information acquiring time included in the meta data of the content.

32. The apparatus of claim 27, wherein the emotional information generating unit generates the emotional information corresponding to each piece of the facial information, if a plurality of pieces of the facial information are extracted from the user image.

33. The apparatus of claim 27, wherein the emotional information generating unit generates the emotional information including a type and strength of an emotion when the user image is acquired, with reference to the facial expression template information.

34. The apparatus of claim 27, further comprising a facial image normalization unit which normalizes a size of the extracted facial information in correspondence to a size of the facial expression template information, wherein the emotional information generating unit compares the normalized facial information with the facial expression template information.