Visualization and control techniques for multimedia digital content

• US 8,209,623 B2
• Filed: 08/18/2004
• Issued: 06/26/2012
• Est. Priority Date: 12/05/2003
• Status: Expired due to Fees

• Current Assignee: Sony Deutschland GmbH (Sony Group Corp.)
• Original Assignee: Sony Deutschland GmbH (Sony Group Corp.)
• Inventors: Barletta, Antonio, Moser, Boris, Mayer, Matthias
• Primary Examiner(s): Ke, Simon
• Assistant Examiner(s): TILLERY, RASHAWN N
• Application Number:
  US10/581,460
• Publication Number:
  US 20070168413A1
• Time in Patent Office: 2,869 Days
• Field of Search: 715/776, 715/777, 715/817, 715/818, 715/819, 715/820, 715/854, 715/855, 715/863, 715/738, 715/716, 715/719, 715/723, 715/851
• US Class Current: 715/776
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A multimedia preview system in a client/server-based network environment for browsing content of requested multimedia data to be previewed includes a processor. The content is displayed on a client terminal for accessing a multimedia server that holds the requested multimedia data. The processor adapts a detail level of a presentation of at least one of text and an image associated with the requested multimedia data, depending on markup tags associated with the multimedia data and a frequency of commands indicating a speed at which the multimedia preview system is to browse through the at least one of the text and the image, such that the detail level of the presentation of the at least one of the text and the image is higher when the speed is lower and vice versa, and changes a layout of the at least one of the text and the image depending on the speed.

Claims

1. A multimedia preview system in a client/server-based network environment for browsing content of requested multimedia data to be previewed, the content to be displayed on a client terminal for accessing a multimedia server configured to hold the requested multimedia data, the multimedia preview system comprising:

an interface configured to receive commands indicating a speed at which the multimedia preview system is to browse through at least one of text and an image associated with the requested multimedia data; and

controlling means for controlling visual information for different abstraction levels based on a weighted semantic value of the requested multimedia data and for adapting an abstraction level of a presentation of the at least one of the text and the image, depending on at least markup tags descriptive for and associated with the requested multimedia data and a frequency of the commands and depending upon a combination of the spatial, temporal and semantic layout of said data, such that the abstraction level of the presentation of the at least one of the text and the image is lower when the speed is lower and vice versa, and for changing a layout of the at least one of the text and the image, depending on the speed, the controlling means including a touch-sensitive display configured to navigate through the requested multimedia data to be previewed.

2. The system according to claim 1, further comprising:

means for displaying the requested multimedia data with different layouts depending on the speed.

3. The system according to claim 1, further comprising:

means for setting a semantic focus, proportional to the speed, of the requested multimedia data.

4. The system according to claim 1, further comprising:

means for introducing the markup tags in the requested multimedia data for changing the layout of the at least one of the text and the image.

5. The multimedia preview system according to claim 1, wherein the multimedia preview system is a video-on-demand system with video browsing means for varying the speed and the abstraction level of the presentation of the at least one of the text and the image, depending on at least the frequency of the commands instructing the multimedia preview system to change the speed such that the abstraction level is lower when the speed is lower and vice versa.

6. A method for browsing content of multimedia data to be previewed, the content being displayed on a client terminal for accessing a multimedia server which holds the multimedia data, comprising:

downloading the multimedia data from the multimedia server to the client terminal via a network link;

receiving and processing, at the multimedia server, commands of representation parameters demanding a change in at least one of a speed of browsing and in an abstraction level of a presentation of at least one of text and an image associated with the multimedia data;

decomposing the multimedia data into non-redundant and redundant, less relevant parts for obtaining visual information for different abstraction levels based on a weighted semantic value of the requested multimedia data;

adapting the representation parameters by online filtering out a certain amount of the redundant, less relevant parts depending on at least markup tags descriptive for and associated with the multimedia data and a frequency of the commands and depending upon a combination of the spatial, temporal and semantic layout of said data, such that the abstraction level of the presentation of the at least one of the text and the image is lower when the speed of browsing is lower and vice versa; and

displaying an adapted version of the multimedia data on the client terminal, wherein a layout of the at least one of the text and the image is changed depending on the speed of browsing, and the commands are based on movements of a pressure across a touch-sensitive display.

7. The method according to claim 6, wherein the at least one of the text and the image is displayed with different layouts depending on the speed of browsing.

8. The method according to claim 6, wherein a semantic focus of the multimedia data is set proportional to the speed of browsing.

9. The method according to claim 6, wherein the markup tags are introduced in the multimedia data for changing the layout of the at least one of the text and the image.

10. The method according to claim 6, further comprising:

associating the markup tags, allowing identification of segmented parts of the multimedia data to be previewed, to the multimedia data; and

synchronizing the markup tags with the multimedia data.

11. The method according to claim 6, wherein a length of a movement path of one of the movements is directly proportional to at least one of the speed of browsing and the abstraction level of the presentation of the at least one of the text and the image, during the displaying the multimedia data.

12. The method according to claim 6, wherein the commands are based on forces exerted to a surface of the touch-sensitive display, one of the forces being directly proportional to at least one of the speed of browsing and the abstraction level of the presentation of the at least one of the text and the image, during the displaying the multimedia data.

13. The method according to claim 6, wherein the commands are based on a duration of forces exerted to a surface of the touch-sensitive display, the duration being directly proportional to at least one of the speed of browsing and the abstraction level of the presentation of the at least one of the text and the image, during the displaying the multimedia data.

14. A multimedia preview system in a client/server-based network environment for browsing content of requested multimedia data to be previewed, the content to be displayed on a client terminal for accessing a multimedia server configured to hold the requested multimedia data, the multimedia preview system comprising:

a processor configured to control visual information for different abstraction levels based on a weighted semantic value of the requested multimedia data and to adapt an abstraction level of a presentation of at least one of text and an image associated with the requested multimedia data, depending on markup tags descriptive for and associated with the requested multimedia data and a frequency of commands and depending upon a combination of the spatial, temporal and semantic layout of said data indicating a speed at which the multimedia preview system is to browse through the at least one of the text and the image, such that the abstraction level of the presentation of the at least one of the text and the image is lower when the speed is lower and vice versa, and to change a layout of the at least one of the text and the image depending on the speed; and

a touch-sensitive display configured to navigate through the requested multimedia data to be previewed.

15. The system according to claim 14, further comprising:

a display unit configured to display the requested multimedia data with different layouts depending on the speed.

16. The system according to claim 14, further comprising:

a setting unit configured to set a semantic focus, proportional to the speed, of the requested multimedia data.

17. The system according to claim 14, further comprising:

an editing unit configured to introduce the markup tags in the requested multimedia data for changing the layout of the at least one of the text and the image.

18. The multimedia preview system according to claim 14, wherein the multimedia preview system is a video-on-demand system configured to vary the speed and the abstraction level of the presentation of the at least one of the text and the image, depending on at least the frequency of the commands instructing the multimedia preview system to change the speed such that the abstraction level is lower when the speed is lower and vice versa.