Television-based visualization and navigation interface

• US 20030184598A1
• Filed: 06/17/2002
• Published: 10/02/2003
• Est. Priority Date: 12/22/1997
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey
• Granted Patent: US 7,954,056 B2
• Time in Patent Office: Days
• US Class Current: 715/838
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/34 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/483 using metadata automatically derived from the content
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs

Abstract

Techniques for retrieving and displaying multimedia information are provided. A television (TV) interface is provided that displays multimedia information that may be stored in a multimedia document. The interface enables a user to navigate through multimedia information stored on the multimedia document.

Claims

1. A method for displaying multimedia information on a television display, the method comprising:

displaying a section of the multimedia information in a first area of the display; and

displaying a navigation bar in a second area of the display, the navigation bar including one or more thumbnail images, wherein each thumbnail image in the one or more thumbnail images is extracted from the multimedia information, wherein at least one thumbnail image in the one or more of thumbnail images is selectable while the section of multimedia information in the first area of the display is being displayed.

2. The method of claim 1, wherein at least one thumbnail image in the one or more thumbnail images is selectable during playback of the multimedia information in the first area of the display.

3. The method of claim 1, wherein the at least one thumbnail image is selectable using a television remote control.

4. The method of claim 1, wherein the navigation bar includes a progress bar, the progress bar representing a time in the multimedia information corresponding to the section of multimedia information being displayed in the first area of the display.

5. The method of claim 4, wherein the progress bar comprises a symbol related to the playback of the multimedia information in the first area of the display, wherein the symbol comprises at least one of a pause sign, a play sign, a rewind sign, and a fast forward sign.

6. The method of claim 1, further comprising displaying a location box on the navigation bar, the location box associated with at least one thumbnail image in the one or more thumbnail images.

7. The method of claim 6, further comprising:

receiving user input to move the location box from a first position associated with a first thumbnail image to a second position associated with a second thumbnail image; and

in response to the user input, displaying the location box in the second position associated with the second thumbnail image.

8. The method of claim 6, further comprising receiving user input for selecting the at least one thumbnail image.

9. The method of claim 8, further comprising in response to the user input for selecting the at least one thumbnail image, displaying a section of the multimedia information at a time corresponding to the selected at least one thumbnail image in the first area of the display.

10. The method of claim 8, further comprising displaying an indication that the selected at least one thumbnail has been selected.

11. The method of claim 10, wherein the indication is a highlighted location box including the selected at least one thumbnail.

12. The method of claim 1, further comprising displaying a second navigation bar in a third area of the display, the second navigation bar including one or more preview thumbnail images.

13. The method of claim 12, wherein the preview thumbnail images are extracted from the multimedia information in an interval related to a current time of the section of multimedia information being displayed in the first viewing area.

14. The method of claim 1, wherein the multimedia information comprises video information.

15. The method of claim 1, wherein a thumbnail image in the plurality of thumbnail images is a keyframe of multimedia information.

16. The method of claim 1, further comprising:

receiving topic of interest information;

determining one or more thumbnail images related to the topic of interest information from one or more thumbnail images; and

displaying a visual indication with the determined one or more thumbnail images that are related to the topic of interest.

17. A method for displaying multimedia information on a television display, the method comprising:

displaying a section of the multimedia information in a first area of the display;

identifying a second area of the display in which a navigation bar will be displayed;

determining one or more timestamps based on the second area of the display;

extracting a keyframe from the multimedia information corresponding to each timestamp in the one or more timestamps; and

configuring the navigation bar, the navigation bar including a keyframe extracted for at least one timestamp in the one or more time stamps; and

displaying the configured navigation bar in the second area of the display, wherein at least one keyframe included in the navigation bar is selectable while the section of multimedia information in the first area of the display is being displayed.

18. The method of claim 17, wherein at least one keyframe is selectable during playback of the multimedia information in the first area of the display.

19. The method of claim 17, wherein the at least one keyframe is selectable using a television remote control.

20. The method of claim 17, wherein determining one or more timestamps comprises determining a seconds multiplier.

21. The method of claim 20, wherein determining the seconds multiplier comprises dividing a length of the multimedia information by a width of the second area of the display.

22. The method of claim 20, wherein determining the seconds multiplier comprises dividing a length of the multimedia information by a height of the second area of the display.

23. The method of claim 20, wherein determining the one or more timestamps comprises multiplying the seconds multiplier by one or more positions in the second area of the display.

24. The method of claim 23, wherein the one or more positions are one or more X axis positions in the second area of the display.

25. The method of claim 23, wherein the one or more positions are one or more Y axis positions in the second area of the display.

26. The method of claim 17, wherein determining one or more timestamps comprises:

determining a timestamp for a first keyframe at a first position in the second area of the display; and

determining a timestamp for a second keyframe at a second position in the second area of the display, wherein the second position is greater than the first position.

27. The method of claim 26, wherein determining one or more timestamps comprises:

determining a timestamp for a third keyframe at a third position in the second area of the display, wherein the second position is greater than the first position but less than the third position.

28. The method of claim 17, wherein the second area of the display includes one or more cell positions.

29. The method of claim 28, wherein the keyframe extracted for the one or more timestamps are displayed in the one or more cell positions.

30. The method of claim 17, wherein the navigation bar includes a progress bar, the progress bar representing a time in the multimedia information corresponding to the section of multimedia information being displayed in the first area of the display.

31. The method of claim 30, wherein the progress bar comprises a symbol related to the playback of the multimedia information in the first area of the display, wherein the symbol comprises at least one of a pause sign, a play sign, a rewind sign, and a fast forward sign.

32. The method of claim 17, further comprising displaying a location box on the navigation bar, the location box associated with at least one keyframe included in the navigation bar.

33. The method of claim 32, further comprising:

receiving user input to move the location box from a first position associated with a first keyframe to a second position associated with a second keyframe; and

in response to the user input, displaying the location box in the second position associated with the second keyframe.

34. The method of claim 32, further comprising receiving user input for selecting the at least one keyframe.

35. The method of claim 34, further comprising in response to the user input selecting the at least one keyframe, displaying a section of the multimedia information at a time corresponding to the selected at least one keyframe in the first area of the display.

36. The method of claim 34, further comprising displaying an indication that the selected at least one keyframe has been selected.

37. The method of claim 36, wherein the indication is a highlighted location box including the selected at least one keyframe.

38. The method of claim 17, further comprising displaying a second navigation bar in a third area of the display, the second navigation bar including one or more preview keyframes.

39. The method of claim 38, wherein the preview keyframes are extracted from the multimedia information in an interval related to a current time of the section of multimedia information being displayed in the first viewing area.

40. The method of claim 17, wherein the multimedia information comprises video information.

41. The method of claim 17, further comprising:

receiving topic of interest information;

determining one or more keyframes in the navigation bar related to the topic of interest information; and

displaying a visual indication with the determined one or more keyframes that are related to the topic of interest.

42. A data processing system for displaying multimedia information on a television display, the data processing system comprising:

a processor;

a memory coupled to the processor, the memory configured to store one or more code modules for execution by the processor, wherein the one or more code modules comprising;

a module for displaying a section of the multimedia information in a first area of the display; and

a module for displaying a navigation bar in a second area of the display, the navigation bar including one or more thumbnail images, wherein each thumbnail image in the one or more thumbnail images is extracted from the multimedia information, wherein at least one thumbnail image in the one or more of thumbnail images is selectable while the section of multimedia information in the first area of the display is displayed.

43. The data processing system of claim 42, wherein at least one thumbnail image in the one or more thumbnail images is selectable during playback of the multimedia information in the first area of the display.

44. The data processing system of claim 42, wherein the at least one thumbnail image is selectable using a television remote control.

45. The data processing system of claim 42, further comprising a module for displaying a location box on the navigation bar, the location box associated with at least one thumbnail image in the one or more thumbnail images.

46. The data processing system of claim 45, further comprising a module for receiving user input for selecting the at least one thumbnail image;

and

in response to the user input for selecting the at least one thumbnail image, a module for displaying a section of the multimedia information at a time corresponding to the selected at least one thumbnail image in the first area of the display.

47. The data processing system of claim 42, further comprising a module for displaying a second navigation bar in a third area of the display, the second navigation bar including one or more preview thumbnail images.

48. A data processing system for displaying multimedia information on a television display, the data processing system comprising:

a processor;

a memory coupled to the processor, the memory configured to store one or more code modules for execution by the processor, wherein the one or more code modules comprising;

a module for displaying a section of the multimedia information in a first area of the display;

a module for identifying a second area of the display in which a navigation bar will be displayed;

a module for determining one or more timestamps based on the second area of the display;

a module for extracting a keyframe from the multimedia information corresponding to each timestamp in the one or more timestamps; and

a module for configuring the navigation bar, the navigation bar including a keyframe extracted for at least one timestamp in the one or more time stamps; and

a module for displaying the configured navigation bar in the second area of the display, wherein at least one keyframe included in the navigation bar is selectable while the section of multimedia information in the first area of the display is being displayed.

49. The data processing system of claim 48, wherein at least one keyframe is selectable during playback of the multimedia information in the first area of the display.

50. The data processing system of claim 48, wherein the at least one keyframe is selectable using a television remote control.

51. The data processing system of claim 48, wherein determining one or more timestamps comprises determining a seconds multiplier.

52. The data processing system of claim 51, wherein determining the one or more timestamps comprises multiplying the seconds multiplier by one or more positions in the second area of the display.

53. The data processing system of claim 48, wherein the module for determining one or more timestamps comprises:

a module for determining a timestamp for a first keyframe at a first position in the second area of the display; and

a module for determining a timestamp for a second keyframe at a second position in the second area of the display,

wherein the second position is greater than the first position.

54. The data processing system of claim 53, wherein the module for determining one or more timestamps comprises:

a module for determining a timestamp for a third keyframe at a third position in the second area of the display, wherein the second position is greater than the first position but less than the third position.

55. A multimedia system comprising:

a television; and

a data processing system, wherein the data processing is configured to;

display a section of the multimedia information in a first area of the display; and

display a navigation bar in a second area of the display, the navigation bar including one or more thumbnail images, wherein each thumbnail image in the one or more thumbnail images is extracted from the multimedia information, wherein at least one thumbnail image in the one or more of thumbnail images is selectable while the section of multimedia information in the first area of the display is displayed.

56. The multimedia system of claim 55, wherein at least one thumbnail image in the one or more thumbnail images is selectable during playback of the multimedia information in the first area of the display.

57. The multimedia system of claim 55, wherein the at least one thumbnail image is selectable using a television remote control.

58. A multimedia system comprising:

a television; and

a data processing system, wherein the data processing is configured to;

display a section of the multimedia information in a first area of the display;

identify a second area of the display in which a navigation bar will be displayed;

determine one or more timestamps based on the second area of the display;

extract a keyframe from the multimedia information corresponding to each timestamp in the one or more timestamps; and

configure the navigation bar, the navigation bar including a keyframe extracted for at least one timestamp in the one or more time stamps; and

display the configured navigation bar in the second area of the display, wherein at least one keyframe included in the navigation bar is selectable while the section of multimedia information in the first area of the display is being displayed.

59. The multimedia system of claim 58, wherein at least one keyframe is selectable during playback of the multimedia information in the first area of the display.

60. The multimedia system of claim 58, wherein the at least one keyframe image is selectable using a television remote control.

61. A system for displaying multimedia information on a television display, the system comprising:

means for displaying a section of the multimedia information in a first area of the display; and

means for displaying a navigation bar in a second area of the display, the navigation bar including one or more thumbnail images, wherein each thumbnail image in the one or more thumbnail images is extracted from the multimedia information, wherein at least one thumbnail image in the one or more of thumbnail images is selectable while the section of multimedia information in the first area of the display is displayed.

62. A system for displaying multimedia information on a television display, the system comprising:

means for displaying a section of the multimedia information in a first area of the display;

means for identifying a second area of the display in which a navigation bar will be displayed;

means for determining one or more timestamps based on the second area of the display;

means for extracting a keyframe from the multimedia information corresponding to each timestamp in the one or more timestamps; and

means for configuring the navigation bar, the navigation bar including a keyframe extracted for at least one timestamp in the one or more time stamps; and

means for displaying the configured navigation bar in the second area of the display, wherein at least one keyframe included in the navigation bar is selectable while the section of multimedia information in the first area of the display is being displayed.

63. A computer program product for displaying multimedia information on a television display, the computer program product comprising:

code for displaying a section of the multimedia information in a first area of the display; and

code for displaying a navigation bar in a second area of the display, the navigation bar including one or more thumbnail images, wherein each thumbnail image in the one or more thumbnail images is extracted from the multimedia information, wherein at least one thumbnail image in the one or more of thumbnail images is selectable while the section of multimedia information in the first area of the display is displayed.

64. The computer program product of claim 63, wherein at least one thumbnail image in the one or more thumbnail images is selectable during playback of the multimedia information in the first area of the display.

65. The computer program product of claim 63, wherein the at least one thumbnail image is selectable using a television remote control.

66. A computer program product for displaying multimedia information on a television display, the computer program product comprising:

code for displaying a section of the multimedia information in a first area of the display;

code for identifying a second area of the display in which a navigation bar will be displayed;

code for determining one or more timestamps based on the second area of the display;

code for extracting a keyframe from the multimedia information corresponding to each timestamp in the one or more timestamps; and

code for configuring the navigation bar, the navigation bar including a keyframe extracted for at least one timestamp in the one or more time stamps; and

code for displaying the configured navigation bar in the second area of the display, wherein at least one keyframe included in the navigation bar is selectable while the section of multimedia information in the first area of the display is being displayed.

67. The computer program product of claim 66, wherein at least one keyframe is selectable during playback of the multimedia information in the first area of the display.

68. The computer program product of claim 66, wherein the at least one keyframe is selectable using a television remote control.