SYSTEM AND METHOD OF MULTIMODALITY-APPENDED RICH MEDIA COMMENTS

• US 20120317173A1
• Filed: 07/29/2011
• Published: 12/13/2012
• Est. Priority Date: 06/09/2011
• Status: Active Grant

• Current Assignee: Quanta Computer
• Original Assignee: Quanta Computer
• Inventors: Chang, Chia-Yuan, Huang, Ting-Han, Huang, Yu-Chen, Lin, Kang-Wen, Huang, Juin-Yi, Wu, Chia-Yi, Chu, Ching-Fan
• Granted Patent: US 8,935,385 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04Q 2209/10 using a centralized architecture
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Abstract

A system of multimodality-appended rich media comments is provided. The system includes a server and an electronic device. The electronic device includes a network access module, at least one sensor and a processing unit. The network access module communicates with the server. The at least one sensor senses a user'"'"'s behavior in a recording mode to obtain a sensing data. The processing unit performs an application to provide a source medium, wherein a rich media comment function of the application can be activated to provide multiple interactive objects for selection and then trigger the recording mode. The application uploads the sensing data to the server after the recording mode finishes. The server analyzes the sensing data and accordingly modifies the selected interactive object, combines the source medium with the modified interactive object into a rendered medium, and then delivers the rendered medium to the application.

Claims

1. A system of multimodality-appended rich media comments, comprising:

a server; and

an electronic device, comprising;

a network access module for communicating with the server;

at least one sensor for sensing a user'"'"'s behavior in a recording mode to obtain a sensing data; and

a processing unit for performing an application to provide a source medium, wherein a rich media comment function of the application can be activated to provide a plurality of interactive objects for selection and trigger the recording mode, and the application uploads the sensing data to the server after the recording mode finishes;

wherein, the server analyzes the sensing data and accordingly modifies the selected interactive object, combines the source medium with the modified interactive object into a rendered medium, and then delivers the rendered medium to the application or a database stored in the server.

2. The system of multimodality-appended rich media comments according to claim 1, wherein the source medium is such as a video frequency medium, an audio frequency medium, an article medium or a webpage medium.

3. The system of multimodality-appended rich media comments according to claim 1, wherein the server analyzes the sensing data to obtain an environmental context, interprets the environmental context to determine a situation factor, and then modifies the selected interactive object according to the situation factor.

4. The system of multimodality-appended rich media comments according to claim 3, wherein the server modifies attributes of the selected interactive object such as size, scale, frequency, sound, motion and color according to the situation factor.

5. The system of multimodality-appended rich media comments according to claim 3, wherein the server collects the identifier of the selected interactive object, the duration of the recording mode, the situation factor and the sensing data as a recorded information.

6. The system of multimodality-appended rich media comments according to claim 3, wherein the situation factor comprises an emotion color or an emotion intensity.

7. The system of multimodality-appended rich media comments according to claim 6, wherein the server further combines the situation factor with the rendered medium in a graphic format.

8. The system of multimodality-appended rich media comments according to claim 1, wherein the application further filters the rendered medium according to a user preferred setting.

9. A method of multimodality-appended rich media comments, wherein the method is used in a multimodality-appended rich media system comprising a server and an electronic device, the electronic device comprises a network access module, at least one sensor and a processing unit, the network access module communicates with the server, and the method of multimodality-appended rich media comments comprises:

performing an application by the processing unit to provide a source medium;

activating a rich media comment function of the application to provide a plurality of interactive objects for selection;

triggering a recording mode, so that at least the sensor senses a user'"'"'s behavior to obtain a sensing data;

uploading the sensing data to the server by the application after the recording mode finishes;

analyzing the sensing data by the server, accordingly modifying the selected interactive object and combining the source medium with the modified interactive object into a rendered medium; and

delivering the rendered medium to the application or a database stored in the server by the server.

10. The method of multimodality-appended rich media comments according to claim 9, wherein the source medium is such as a video frequency medium, an audio frequency medium, an article medium or a webpage medium.

11. The method of multimodality-appended rich media comments according to claim 9, further comprising:

analyzing the sensing data by the server to obtain an environmental context and interpreting the environmental context to determine a situation factor; and

modifying the selected interactive object by the server according to the situation factor.

12. The method of multimodality-appended rich media comments according to claim 11, further comprising:

modifying the attributes of the selected interactive object such as size, scale, frequency, sound, motion or color by the server according to the situation factor.

13. The method of multimodality-appended rich media comments according to claim 11, further comprising:

collecting the identifier of the selected interactive object, the duration of the recording mode, the situation factor and the sensing data as a recorded information by the server.

14. The method of multimodality-appended rich media comments according to claim 11, wherein the situation factor comprises an emotion color or an emotion intensity.

15. The method of multimodality-appended rich media comments according to claim 14, further comprising:

combining the situation factor with the rendered medium by the server in a graphic format.

16. The method of multimodality-appended rich media comments according to claim 9, further comprising:

filtering the rendered medium by the application further according to a user preferred setting.