Method and system for providing an interactive guide for multimedia selection

• US 20040123320A1
• Filed: 12/23/2002
• Published: 06/24/2004
• Est. Priority Date: 12/23/2002
• Status: Abandoned Application

• Current Assignee: HRL Laboratories LLC (The Boeing Co.)
• Original Assignee: HRL Laboratories LLC (The Boeing Co.)
• Inventors: Payton, David W., Fox, Jason, Daily, Mike
• Application Number:
  US10/329,330
• Publication Number:
  US 20040123320A1
• Time in Patent Office: Days
• US Class Current: 725/61
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4821 using a grid, e.g. sorted out by channel and broadcast time
• CPC Class Codes: H04N 5/45 Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

An interactive multimedia selection guide is provided. The guide includes a computer system having a processor, a memory, an input for receiving user input, an input for receiving programs from a program database, and an output for sending display information to a visual display. The interactive guide navigates through a graph structure of multimedia program/channel sources in the program database. The graph structure includes a plurality of nodes representing multimedia and contextual information. Programs and channels as well as groups of programs and channels are represented as nodes in the graph, and as icons or native format representations on a display device. Navigation through the graph structure is performed by allowing the user to affect panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing.

Claims

1. An interactive multimedia selection apparatus comprising a computer system including a processor, a memory coupled with the processor, a first input coupled with the processor for receiving user input, a second input coupled with the processor for receiving data from a program database, and an output coupled with the processor for sending display information to a visual display, wherein the computer system further comprises means, operating in its processor and memory, for navigating through a graph structure of multimedia sources in the program database, where the graph structure includes a plurality of nodes including a starting node, a current node representing a current point of view in the graph structure of the means for navigating, and a plurality of connected nodes, where the connected nodes are connected with the starting node through the graph structure, and where each of the nodes represents at least one type of content selected from a group of links to other nodes, multimedia contents, and contextual information, the means for navigating including means for:

a. providing an output to a visual display with the output including icons representing nodes directly connected with current node;

b. receiving user input in the form of a user command through the first input into the computer system for controlling the navigation of the interactive multimedia selection apparatus to allow the user to cause panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing;

c. in response to a user command for panning, sending display information through the output to the visual display to effect a panning action in order to cause the icons to move in a panning motion on the display in order to provide the user with a better view of the icons;

d. in response to a user command for zooming in, sending display information through the output to the visual display to effect a zooming-in action in order to allow the user to see more detail in a desired portion of the visual display;

e. in response to a user command for zooming out, sending display information through the output to the visual display to effect a zooming-out action in order to allow the user to see a larger area of the visual display;

f. in response to a user command for selecting a node represented by an icon, sending display information through the output to the visual display to effect an opening of the respective node to display its contents on the visual display; and

g. in response to a user command for retracing, sending display information through the output to the visual display to navigate to the immediately previous current node.

2. An interactive multimedia selection apparatus as set forth in claim 1, wherein the nodes are represented in the visual display by information sent through the output as graphical icons, with each icon depicting a representation of the content in the database represented by the node.

3. An interactive multimedia selection apparatus as set forth in claim 2, wherein icons, representing nodes including multimedia content, play a reduced version of the multimedia content in real-time, thereby allowing a user to sense the underlying content of a media source prior to deciding whether to receive a full version of the content.

4. An interactive multimedia selection apparatus as set forth in claim 3, wherein the user input includes a selection means that allows a user perform a preliminary selection in which an icon preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other icons, whereby the multimedia content play of a preliminarily selected icon stands out from the other icons to allow a user to better determine its contents.

5. An interactive multimedia selection apparatus as set forth in claim 4, wherein the first input includes a user input device selected from a group consisting of television remote controls, computer mice, microphones, and eye-trackers.

6. An interactive multimedia selection apparatus as set forth in claim 5, wherein the apparatus further comprises a visual display device for receiving output from the processor for display to a user.

7. An interactive multimedia selection apparatus as set forth in claim 6, wherein the means for navigating further comprises a means for displaying all of the multimedia sources in the program database in a timeline matrix structure;

whereby a user may also browse through the multimedia sources to search for desired content.

8. An interactive multimedia selection apparatus as set forth in claim 7, wherein the means for navigating further comprises a means for adjusting the response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

9. An interactive multimedia selection apparatus as set forth in claim 2, wherein icons, representing nodes including multimedia content, play a reduced version of the multimedia content in real-time, thereby allowing a user to sense the underlying content of a media source prior to deciding whether to receive a full version of the content.

10. An interactive multimedia selection apparatus as set forth in claim 9, wherein the first input includes a user input device selected from a group consisting of television remote controls, computer mice, microphones, and eye-trackers.

11. An interactive multimedia selection apparatus as set forth in claim 10, wherein the apparatus further comprises a visual display device for receiving output from the processor for display to a user.

12. An interactive multimedia selection apparatus as set forth in claim 11, wherein the means for navigating further comprises a means for displaying all of the multimedia sources in the program database in a timeline matrix structure;

whereby a user may also browse through the multimedia sources to search for desired content.

13. An interactive multimedia selection apparatus as set forth in claim 12, wherein the means for navigating further comprises a means for adjusting the response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

14. An interactive multimedia selection apparatus as set forth in claim 1, wherein the means for navigating further comprises a means for displaying all of the multimedia sources in the program database in a timeline matrix structure;

whereby a user may also browse through the multimedia sources to search for desired content.

15. An interactive multimedia selection apparatus as set forth in claim 14, wherein the means for navigating further comprises a means for adjusting the response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

16. An interactive multimedia selection apparatus as set forth in claim 1, wherein the icons representing the nodes are represented in the visual display by information sent through the output as a native format representation, with each native format representation depicting a representation of the multimedia and contextual information in the database represented by the node.

17. An interactive multimedia selection apparatus as set forth in claim 16, wherein icons, representing nodes including multimedia content, play a reduced version of the multimedia content in real-time, thereby allowing a user to sense the underlying content of a media source prior to deciding whether to receive a full version of the content.

18. An interactive multimedia selection apparatus as set forth in claim 17, wherein the user input includes a selection means that allows a user perform a preliminary selection in which a native format representation preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other native format representations, whereby the multimedia content play of a preliminarily selected native format representation stands out from the other native format representations to allow a user to better determine its contents.

19. An interactive multimedia selection apparatus as set forth in claim 18, wherein the first input includes a user input device selected from a group consisting of television remote controls, computer mice, microphones, and eye-trackers.

20. An interactive multimedia selection apparatus as set forth in claim 19, wherein the apparatus further comprises a visual display device for receiving output from the processor for display to a user.

21. An interactive multimedia selection apparatus as set forth in claim 20, wherein the means for navigating further comprises a means for displaying all of the multimedia sources in the program database in a timeline matrix structure;

whereby a user may also browse through the multimedia sources to search for desired content.

22. An interactive multimedia selection apparatus as set forth in claim 21, wherein the means for navigating further comprises a means for adjusting the response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by a native format representation, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

23. An interactive multimedia selection apparatus as set forth in claim 16, wherein icons, representing nodes including multimedia content, play a reduced version of the multimedia content in real-time, thereby allowing a user to sense the underlying content of a media source prior to deciding whether to receive a full version of the content.

24. An interactive multimedia selection apparatus as set forth in claim 23, wherein the first input includes a user input device selected from a group consisting of television remote controls, computer mice, microphones, and eye-trackers.

25. An interactive multimedia selection apparatus as set forth in claim 24, wherein the apparatus further comprises a visual display device for receiving output from the processor for display to a user.

26. An interactive multimedia selection apparatus as set forth in claim 25, wherein the means for navigating further comprises a means for displaying all of the multimedia sources in the program database in a timeline matrix structure;

whereby a user may also browse through the multimedia sources to search for desired content.

27. An interactive multimedia selection apparatus as set forth in claim 26, wherein the means for navigating further comprises a means for adjusting the response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by a native format representation, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

28. An method for interactive multimedia selection apparatus comprising a computer system including a processor, a memory coupled with the processor, a first input coupled with the processor for receiving user input, a second input coupled with the processor for receiving data from a program database, and an output coupled with the processor for sending display information to a visual display, wherein the computer system further comprises means, operating in its processor and memory, for navigating through a graph structure of multimedia sources in the program database, where the graph structure includes a plurality of nodes including a starting node, a current node representing a current point of view in the graph structure of the means for navigating, and a plurality of connected nodes, where the connected nodes are connected with the starting node through the graph structure, and where each of the nodes represents at least one type of content selected from a group of links to other nodes, multimedia contents, and contextual information, the method for interactive television selection comprising steps of:

a. providing an output to a visual display with the output including icons representing nodes directly connected with current node;

b. receiving user input in the form of a user command through the first input into the computer system for controlling the navigation of the interactive multimedia selection apparatus to allow the user to cause panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing;

c. in response to a user command for panning, sending display information through the output to the visual display to effect a panning action in order to cause the icons to move in a panning motion on the display in order to provide the user with a better view of the icons;

d. in response to a user command for zooming in, sending display information through the output to the visual display to effect a zooming-in action in order to allow the user to see more detail in a desired portion of the visual display;

e. in response to a user command for zooming out, sending display information through the output to the visual display to effect a zooming-out action in order to allow the user to see a larger area of the visual display;

f. in response to a user command for selecting a node represented by an icon, sending display information through the output to the visual display to effect an opening of the respective node to display its contents on the visual display; and

g. in response to a user command for retracing, sending display information through the output to the visual display to navigate to the immediately previous current node.

29. A method for interactive multimedia selection as set forth in claim 28, wherein in the step of providing an output to a visual display, the nodes are represented in the display information sent through the output as graphical icons, with each icon depicting a representation of the content in the database represented by the node.

30. A method for interactive multimedia selection as set forth in claim 29, wherein in the step of providing an output to a visual display, the icons, representing nodes including multimedia content, play a reduced version of the multimedia content in real-time, thereby allowing a user to sense the underlying content of a media source prior to deciding whether to receive a full version of the content.

31. A method for interactive multimedia selection as set forth in claim 30, further comprising a step of preliminarily selecting wherein in response to a user performing a preliminary selection of an icon, the icon preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other icons, whereby the multimedia content play of a preliminarily selected icon stands out from the other icons to allow a user to better determine its contents.

32. A method for interactive multimedia selection as set forth in claim 31, wherein the method further comprises a step of displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

33. A method for interactive multimedia selection as set forth in claim 32, wherein the method further comprises a step of adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

34. A method for interactive multimedia selection as set forth in claim 29, further comprising a step of preliminarily selecting wherein in response to a user performing a preliminary selection of an icon, the icon preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other icons, whereby the multimedia content play of a preliminarily selected icon stands out from the other icons to allow a user to better determine its contents.

35. A method for interactive multimedia selection as set forth in claim 34, wherein the method further comprises a step of displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

36. A method for interactive multimedia selection as set forth in claim 35, wherein the method further comprises a step of adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

37. A method for interactive multimedia selection as set forth in claim 28, wherein the method further comprises a step of displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

38. A method for interactive multimedia selection as set forth in claim 37, wherein the method further comprises a step of adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

39. A method for interactive multimedia selection set forth in claim 28, wherein in the step of providing an output to a visual display, the icons representing the nodes are represented in the display information sent through the output as a native format representation, with each native format representation depicting a representation of the multimedia and contextual information in the database represented by the node.

40. A method for interactive multimedia selection as set forth in claim 39, wherein in the step of providing an output to a visual display, the icons, representing nodes including multimedia content, play a reduced version of the multimedia content in real-time, thereby allowing a user to sense the underlying content of a media source prior to deciding whether to receive a full version of the content.

41. A method for interactive multimedia selection as set forth in claim 40, further comprising a step of preliminarily selecting wherein in response to a user performing a preliminary selection of a native format representation, the native format representation preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other native format representations, whereby the multimedia content play of a preliminarily selected native format representation stands out from the other native format representations to allow a user to better determine its contents.

42. A method for interactive multimedia selection as set forth in claim 41, wherein the method further comprises a step of displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

43. A method for interactive multimedia selection as set forth in claim 42, wherein the method further comprises a step of adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by a native format representation, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

44. A method for interactive multimedia selection as set forth in claim 39, further comprising a step of preliminarily selecting wherein in response to a user performing a preliminary selection of a native format representation, the native format representation preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other native format representations, whereby the multimedia content play of a preliminarily selected native format representation stands out from the other native format representations to allow a user to better determine its contents.

45. A method for interactive multimedia selection as set forth in claim 44, wherein the method further comprises a step of displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

46. A method for interactive multimedia selection as set forth in claim 45, wherein the method further comprises a step of adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by a native format representation, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

47. A computer program product for interactive multimedia selection for use with a computer system including a processor, a memory coupled with the processor, a first input coupled with the processor for receiving user input, a second input coupled with the processor for receiving data from a program database, and an output coupled with the processor for sending display information to a visual display, wherein the computer system further comprises means, operating in its processor and memory, for navigating through a graph structure of multimedia sources in the program database, where the graph structure includes a plurality of nodes including a starting node, a current node representing a current point of view in the graph structure of the means for navigating, and a plurality of connected nodes, where the connected nodes are connected with the starting node through the graph structure, and where each of the nodes represents at least one type of content selected from a group of links to other nodes, multimedia contents, and contextual information, the computer program product comprising means for:

a. providing an output to a visual display with the output including icons representing nodes directly connected with current node;

b. receiving user input in the form of a user command through the first input into the computer system for controlling the navigation of the interactive multimedia selection apparatus to allow the user to cause panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing;

c. in response to a user command for panning, sending display information through the output to the visual display to effect a panning action in order to cause the icons to move in a panning motion on the display in order to provide the user with a better view of the icons;

d. in response to a user command for zooming in, sending display information through the output to the visual display to effect a zooming-in action in order to allow the user to see more detail in a desired portion of the visual display;

e. in response to a user command for zooming out, sending display information through the output to the visual display to effect a zooming-out action in order to allow the user to see a larger area of the visual display;

f. in response to a user command for selecting a node represented by an icon, sending display information through the output to the visual display to effect an opening of the respective node to display its contents on the visual display; and

g. in response to a user command for retracing, sending display information through the output to the visual display to navigate to the immediately previous current node.

48. A computer program product for interactive multimedia selection as set forth in claim 47, wherein the means for providing output to a visual display represents the nodes in the visual display by information sent through the output as graphical icons, with each icon depicting a representation of the content in the database represented by the node.

49. A computer program product for interactive multimedia selection as set forth in claim 48, wherein the means for providing an output to a visual display represents the icons, representing nodes by playing a reduced version of the multimedia content in real-time, thereby allowing a user to see the underlying content of a media source prior to deciding whether to receive a full version of the content.

50. A computer program product for interactive multimedia selection as set forth in claim 49, further comprising a means for preliminarily selecting wherein in response to a user performing a preliminary selection of an icon, the icon preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other icons, whereby the multimedia content play of a preliminarily selected icon stands out from the other icons to allow a user to better determine its contents.

51. A computer program product for interactive multimedia selection as set forth in claim 50, further comprising a means for displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

52. A computer program product for interactive multimedia selection as set forth in claim 51, further comprising a means for adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

53. A computer program product for interactive multimedia selection as set forth in claim 48, further comprising a means for preliminarily selecting wherein in response to a user performing a preliminary selection of an icon, the icon preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other icons, whereby the multimedia content play of a preliminarily selected icon stands out from the other icons to allow a user to better determine its contents.

54. A computer program product for interactive multimedia selection as set forth in claim 53, further comprising a means for displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

55. A computer program product for interactive multimedia selection as set forth in claim 54, further comprising a means for adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

56. A computer program product for interactive multimedia selection as set forth in claim 47, further comprising a means for displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

57. A computer program product for interactive multimedia selection as set forth in claim 56, further comprising a means for adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by an icon, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

58. A computer program product for interactive multimedia selection as set forth in claim 47, wherein in the means for providing an output to a visual display, the icons representing the nodes are represented in the visual display by information sent through the output as a native format representation, with each native format representation depicting a representation of the multimedia and contextual information in the database represented by the node.

59. A computer program product for interactive multimedia selection as set forth in claim 58, wherein the means for providing an output to a visual display represents the native format representations representing nodes by playing a reduced version of the multimedia content in real-time, thereby allowing a user to see the underlying content of a media source native format representation prior to fully viewing the content.

60. A computer program product for interactive multimedia selection as set forth in claim 59, further comprising a means for preliminarily selecting wherein in response to a user performing a preliminary selection of a native format representation, the native format representation preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other native format representations, whereby the multimedia content play of a preliminarily selected native format representation stands out from the other native format representations to allow a user to better determine its contents.

61. A computer program product for interactive multimedia selection as set forth in claim 60, further comprising a means for displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

62. A computer program product for interactive multimedia selection as set forth in claim 61, further comprising a means for adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by a native format representation, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.

63. A computer program product for interactive multimedia selection as set forth in claim 58, further comprising a means for preliminarily selecting wherein in response to a user performing a preliminary selection of a native format representation, the native format representation preliminarily selected is enhanced so that its multimedia play is amplified relative to that of the other native format representations, whereby the multimedia content play of a preliminarily selected native format representation stands out from the other native format representations to allow a user to better determine its contents.

64. A computer program product for interactive multimedia selection as set forth in claim 63, further comprising a means for displaying all of the multimedia sources in the program database in a timeline matrix structure in response to a user request;

whereby a user may also browse through the multimedia sources to search for desired content.

65. A computer program product for interactive multimedia selection as set forth in claim 64, further comprising a means for adjusting a response of the apparatus to the user input in order to adjust the speed of the panning of the visual display, zooming-in of a desired portion of the visual display, zooming-out of a desired portion of the visual display, selection of a node represented by a native format representation, and retracing so that the response of the apparatus may be tailored to the needs of a particular user.