Apparatus and method for extracting context and providing information based on context in multimedia communication system

• US 20060173859A1
• Filed: 12/29/2005
• Published: 08/03/2006
• Est. Priority Date: 12/30/2004
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jung, Jun-Young, Lim, Han-Na, Ryu, Jung-Hee, Kim, Jun-Hwan, Moon, Bong-Kyo
• Application Number:
  US11/321,935
• Publication Number:
  US 20060173859A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents

Abstract

An apparatus and a method for providing a multimedia service which can automatically recognize various media corresponding to communication contents and provide information regarding to the media in bi-directional or multipoint communication. The method includes the steps of classifying a type of input multimedia data, detecting context of the multimedia data through a search scheme corresponding to the classified multimedia data, determining a search request condition of related/accessory information corresponding to the detected context, receiving the related/accessory information about the context by searching the related/accessory information corresponding to the context if a related/accessory search condition is satisfied as a determination result of a search condition, and providing the multimedia data and the related/accessory information about the context of the multimedia data to a user.

Claims

1. An apparatus for extracting context and providing accessory information related to the context to provide multimedia data in a communication system, the apparatus comprising:

a multimedia data receiving module for receiving multimedia data and related/accessory information corresponding to the multimedia data from one of a user equipment and a Web server;

a context extracting module for extracting context of the multimedia data received through the multimedia data receiving module;

a context classifying module for determining and classifying a type of the context extracted in the context extracting module

a search controller for determining a search request condition for related/accessory information about the context extracted and classified in the context extracting module and searching for the related/accessory information about the context according to the search request condition; and

a related information providing module for converting the related/accessory information about the context searched by the search controller through a predetermined Interface scheme and providing the related/accessory information.

2. The apparatus as claimed in claim 1, further comprising a database module for forming a field for storing at least one piece of information corresponding to the context extracted in the context extracting module and storing the at least one piece of information corresponding to the extracted contents;

wherein the search controller searches for related/accessory information about the extracted context in the database module correspondingly to the search request condition and extracts the related/accessory information.

3. The apparatus as claimed in claim 1, wherein the search controller accesses an external web server through internetworking with a network to search for and extract the related/accessory information corresponding to the context, receives a corresponding result from the web server, stores the result in the database module, and provides the result to the user equipment.

4. The apparatus as claimed in claim 2, wherein the database module comprises at least one of a person information field, a company information field, and a language information field, the person information field including related/accessory information corresponding to a specific person, the company information field including related/accessory information corresponding to a specific company, and the language information filed including an electronic dictionary proving related/accessory information corresponding to a specific text.

5. The apparatus as claimed in claim 1, wherein the context extracting module classifies a type of the multimedia data based on a header of the multimedia data received through the multimedia data receiving module.

6. The apparatus as claimed in claim 1, wherein the context extracting module extracts the context by extracting keywords, if the type of the multimedia data is text.

7. The apparatus as claimed in claim 1, wherein the context extracting module extracts the context by converting audio data into corresponding text and extracting keywords, from the text data, if the type of the multimedia data is voice.

8. The apparatus as claimed in claim 1, wherein the context extracting module extracts the context by performing image recognition and extracting an object, if the type of the multimedia data is an image.

9. The apparatus as claimed in claim 1, wherein the related/accessory information about the context provided through the related information providing module is displayed on a display module of the user equipment together with multimedia data.

10. A user equipment enabling a multimedia service in a multimedia communication system, the user equipment comprising:

an input module including an information input unit, an image acquisition unit, and a voice recognition unit, the information input unit receiving predetermined text information from a user, the image acquisition unit acquiring an external image, and the voice recognition unit receiving a predetermined audio signal;

a multimedia data communication module for transmitting and receiving one of only multimedia data and multimedia data and related/accessory information about the context with a predetermined Web server through a network interface;

a smart interpreter for extracting context of multimedia data received through the multimedia data communication module, determining and classifying a type of the extracted context, and searching and providing related/accessory information corresponding to the extracted and classified context; and

an output module for simultaneously providing the received multimedia data and related/accessory information about the multimedia data.

11. The user equipment as claimed in claim 10, wherein the smart interpreter comprises:

a context extracting module for extracting and classifying context of multimedia data input through one of the input module and the multimedia data communication module;

a database module for forming a field for related/accessory information about a context of the multimedia data and storing the related/accessory information;

a search controller for determining a search request condition of the related/accessory information about the context extracted and classified in the context extracting module and controlling a search of the related/accessory information about the context according to the search request condition; and

a related information providing module for converting the related/accessory information searched by the search controller through a scheme corresponding to an interface scheme of the user equipment and providing the related/accessory information to the output module.

12. The user equipment as claimed in claim 11, wherein the search controller searches for related/accessory information about the extracted context in the database module in response to a user search request and extracts the related/accessory information.

13. The user equipment as claimed in claim 12, wherein, if the related/accessory information does not exist, the search controller searches for the related/accessory information corresponding to the context through an external Web server by internetworking with the multimedia data communication module, extracts the related/accessory information, receives a corresponding result, stores the related/accessory information in the database module, and provides the related/accessory information to the output module.

14. The user equipment as claimed in claim 11, wherein the database module comprises at least one of a person information field, a company information field, and a language information field, the person information field including related/accessory information corresponding to a specific person, the company information field including related/accessory information corresponding to a specific company, and the language information filed including an electronic dictionary proving related/accessory information corresponding to a specific text.

15. The user equipment as claimed in claim 11, wherein the context extracting module classifies a type of the multimedia data based on a header of the multimedia data input through the input module or the multimedia data communication module.

16. The user equipment as claimed in claim 11, wherein the context extracting module extracts the context by extracting keywords, if the type of the multimedia data is text.

17. The user equipment as claimed in claim 11, wherein the context extracting module extracts the context by converting audio data into text data corresponding to the voice data and extracting keywords from the text data, if the type of the multimedia data is voice.

18. The user equipment as claimed in claim 11, wherein the context extracting module extracts the context by performing image recognition and extracting an object, if the type of the multimedia data is an image.

19. The user equipment as claimed in claim 11, wherein the related/accessory information about the context provided through the related information providing module is provided to the output module together with multimedia data.

20. The user equipment as claimed in claim 11, wherein the user equipment requests accessory information about the multimedia data through a network interface, receives the requested accessory information from a predetermined search server, and provides the requested accessory information.

21. A method for extracting a context of multimedia data and providing accessory information related to the context in a communication system, the method comprising the steps of:

classifying a type of input multimedia data;

detecting context of the multimedia data through a search scheme corresponding to the classified multimedia data;

determining a search request condition of related/accessory information corresponding to the detected context;

receiving the related/accessory information about the context by searching the related/accessory information corresponding to the context, if a related/accessory search condition is satisfied as a determination result of a search condition; and

providing the multimedia data and the related/accessory information about the context of the multimedia data to a user.

22. The method as claimed in claim 21, wherein, in the step of classifying the type of the multimedia data, comprises the step of classifying the type of the multimedia data based on a header of the multimedia data.

23. The method as claimed in claim 21, wherein, in the step of detecting the context of the multimedia data, corresponding keywords are extracted, if the type of the multimedia data is text.

24. The method as claimed in claim 23, wherein the keywords are extracted by natural language processing text data and determining if a natural language corresponding to preset keywords exists.

25. The method as claimed in claim 23, wherein, in the step of detecting the context of the multimedia data, text keywords corresponding to voice data are extracted, if the type of the multimedia data is the voice.

26. The method as claimed in claim 25, wherein the keywords are extracted by converting the voice data into corresponding text data using a voice recognition scheme processing the text through natural language processing, and determining if a natural language corresponding to predetermined keywords exists.

27. The method as claimed in claim 21, wherein, in the step of detecting the context of the multimedia data, the context is extracted by performing image recognition and object extraction, if the type of the multimedia data is an image.

28. The method as claimed in claim 27, wherein the image recognition and the object extraction steps employ one of a neural network scheme and a template matching scheme, to extract the context.

29. The method as claimed in claim 21, wherein, in the step of determining the search request condition of the related/accessory information, the determination for the search request condition is achieved correspondingly to at least one of a user direct triggering, a user request, and a predetermined request condition of a service provider.

30. The method as claimed in claim 29, further comprising the steps of:

checking a context selected by the user in multimedia data in a case of a request condition through the user direct triggering;

checking the context according to a situation preset by the user by determining if the request condition corresponds to the preset situation; and

checking the context according to a situation preset by a service provider by determining if the request condition corresponds to the situation.

31. The method as claimed in claim 21, wherein, in the step of searching the related/accessory information, related/accessory information about the context for the multimedia data corresponding the search condition is searched in a database module.

32. The method as claimed in claim 21, wherein, in the step of searching the related/accessory information, if related/accessory information about context corresponding to the search request condition does not exist in a database module, the related/accessory information corresponding to the context is searched through access to an external web server, and the search result is received from the web server and stored in the database module.

33. The method as claimed in claim 21, wherein, in the step of searching the related/accessory information, at least one piece of related/accessory information corresponding to a specific person, related/accessory information corresponding to a specific company, and related/accessory information corresponding to a specific text is searched.

34. The method as claimed in claim 21, wherein, in the step of providing the multimedia data and related/accessory information about context of the multimedia data to a user, the related/accessory information is provided to a display module together with the multimedia data.

35. A method for extracting a context and providing accessory information related to the context in a multimedia communication system, the method comprising the steps of:

transmitting the multimedia data to a smart interpreter, if predetermined multimedia data is requested;

extracting, by the smart interpreter a context for the multimedia data;

searching related/accessory information corresponding to the extracted context;

providing the related/accessory to a user equipment; and

displaying the related/accessory information about the context together with the multimedia data, if the related/accessory information is received from the smart interpreter.

36. The method as claimed in claim 35, further comprising the steps of:

classifying a type of the received multimedia data;

detecting the context by extracting keywords if the type of the multimedia data is text;

performing conversion into text corresponding to voice and extracting keywords if the type of the multimedia data is voice;

performing image recognition and extracting an object if the type of the multimedia data is an image;

determining a search condition of the related/accessory information about the detected context; and

receiving related/accessory information about context through search of the related/accessory information corresponding to the context, if it is determined that the search condition satisfies a search condition for the related/accessory information,

wherein the related/accessory information is provided to the user equipment together with the multimedia data.

37. The method as claimed in claim 36, wherein, in the step of classifying the type of the received multimedia data, the type of the received multimedia data is classified based on a header of the multimedia data.

38. The method as claimed in claim 36, wherein, in the step of determining the search request condition of the related/accessory information, the determination for the search request condition is achieved corresponding to at least one of a user direct triggering, a user request, and a preset request condition of a service provider.

39. The method as claimed in claim 36, wherein, in the step of searching the related/accessory information, related/accessory information about context for the multimedia data corresponding to the search condition is searched in a database module.

40. The method as claimed in claim 36, wherein, in the step of searching the related/accessory information, if related/accessory information about context corresponding to the search request condition does not exist in a database module, the related/accessory information corresponding to the context is searched through access to an external web server, and the search result is received from the web server and stored in the database module.