Graphical user interface for displaying and navigating in a directed graph structure

• US 5,995,106 A
• Filed: 08/19/1997
• Issued: 11/30/1999
• Est. Priority Date: 05/24/1993
• Status: Expired due to Term

• Current Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: LaVallee, David A., Frank, Edward H., Clanton, Charles H. III, Warth, Chris, Palrang, Joseph M., Payne, Jonathan, Naughton, Patrick J., Gosling, James A., Sheridan, R. Michael
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): Huynh, Ba
• Application Number:
  US08/914,656
• Time in Patent Office: 833 Days
• Field of Search: 345/327, 345/334, 345/336, 345/339, 345/340, 345/343, 345/345, 345/346, 345/348, 345/349, 345/351, 345/352, 345/353, 345/354, 345/356, 345/357, 345/977
• US Class Current: 715/854
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 9/465 Distributed object oriented systems remote method invocation [RMI] G06F9/548
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: H03J 1/0025 in a remote control unit remote control tuning in general H03J9/00
• CPC Class Codes: H03J 2200/25 Remote control device with display
• CPC Class Codes: H03J 2200/26 Remote control device with touch screen display
• CPC Class Codes: H04B 1/202 by remote control
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/2809 indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/2818 from a device located outside both the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04L 69/329 : in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 : Network security protocols
• CPC Class Codes: H04M 1/72415 : for remote control of appliances
• CPC Class Codes: H04N 21/4113 : PC
• CPC Class Codes: H04N 21/41265 : having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4131 : home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/426 : Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4312 : involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 : for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4316 : for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43622 : Interfacing an external recording device
• CPC Class Codes: H04N 21/47 : End-user applications
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4722 : for requesting additional data associated with the content
• CPC Class Codes: H04N 21/478 : Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4821 : using a grid, e.g. sorted out by channel and broadcast time
• CPC Class Codes: H04N 21/485 : End-user interface for client configuration
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: Y10S 715/977 : Dynamic icon, e.g. animated or live action

Abstract

An intuitive graphical user interface is based upon a geographic map structure, and includes a system for controlling remote external electronic devices. In the defined graphical user interface, each space of the geographic map structure is rendered on a touch screen display as a graphic image of a geographic space. Within each space are colored cartoon-like icons called "objects" which can be selected and manipulated by the user. Certain objects, referred to as portals, transport the user from one space to another space when Selected. Other objects, referred to as buttons, perform associated actions or functions when Selected. The graphical user interface is displayed on a hand-held display device used to control remote devices. Each remote electronic device transmits a user interface program object that defines a graphical user interface to the display device. The hand-held display devices displays the graphical user interface associated with the remote device when a user selects an icon associated with the remote device on the display device'"'"'s touch screen display.

Claims

1. A method of providing a dynamic graphical user interface on a computer system, said computer system comprising a CPU, a memory, and graphics display screen, said method comprising the steps of:

providing a plurality of spaces, each of said spaces comprising a graphic background image depicting a real-world scene familiar to users;

providing a plurality of portals, each of said portals comprising a graphical icon which can be duplicated and moved to customize said user interface;

organizing said spaces in a directed graph structure, said spaces connected together in said directed graph structure by said plurality of portals, said directed graph structure connecting at least one portal with at least two succeeding portals and at least one previous portal;

locating each of said plurality of portals in said spaces, each of said portals having an associated target space such that said portal connects in said directed graph structure the space in which said portal is located with said associated target space and said portal provides users access to said associated target space;

rendering a graphic background image of a first space, which belongs to said plurality of spaces, and portals located in said first space on said graphics display screen, said first space having at least a first portal and a second portal;

receiving a data input from a user, said data input comprising a portal selected from said first and second portals located in said first space; and

rendering a graphic background image of one of said target spaces associated with said selected portal on said graphics display screen, said graphic background image of one of said target spaces at least partially replacing said graphic background image of said first space such that said user can view different spaces in said directed graph structure by selecting said portals within spaces,

wherein at least one of said plurality of portals provided in each said space is an agent portal, the agent portal carrying objects designated by the user between the rendered spaces.

2. The method of providing a graphical user interface on a computer system as claimed in claim 1 further wherein said steps of rendering a background image further comprises the steps of:

rendering a first part of said background image on said graphics display screen, said first part corresponding to a first location in said background image;

receiving directional input from said user, said directional input comprising a movement direction; and

rendering a second part of said background image on said graphics display screen, said second part corresponding to a second location in said background image, said second location being said first location plus an offset corresponding to said movement direction;

such that said user can view different parts of a background image associated with a space.

3. The method of providing a graphical user interface on a computer system as claimed in claim 2 further wherein said step of receiving directional input from said user further comprises detecting a finger of said user sliding across said display screen.

4. The method of providing a graphical user interface on a computer system as claimed in claim 1 further comprising the steps of:

providing a plurality of wayback portals distinct from said plurality of portals, each of said wayback portals displayed on a different one of said plurality of spaces;

providing a stack of data structures, each of said data structures comprising a pointer, each said pointer pointing to one of said plurality of spaces;

pushing a first data structure on said stack of data structures when said user selects said first space for display, said first data structure containing a pointer to said first space;

popping a second data structure off said stack of data structures when said user selects one of said plurality of wayback portals, said second data structure containing a pointer to a second space; and

displaying said second space pointed to by said pointer in said second data structure popped off said stack of data structures;

such that said graphical user interface allows a user to trace back along a path of spaces which were consecutively displayed.

5. The method of providing a graphical user interface on a computer system as claimed in claim 4 wherein said data structures further comprise a pair of coordinates, said pair of coordinates identifying a location in said first space that was displayed on said graphical display screen when said user selected a different space for viewing.

6. The method of providing a graphical user interface on a computer system as claimed in claim 4 wherein at least one of said plurality of wayback portals is rendered as a snapshot of a space pointed to by a pointer in a data structure on top of said stack of data structures.

7. The method of providing a graphical user interface on a computer system as claimed in claim 1 further comprising the steps of:

providing a plurality of button objects, each of said button objects associated with a function;

rendering said button objects within said plurality of spaces, said button objects comprising graphic icons; and

executing the function associated with a button object when said button object is selected by a user.

8. The method of providing a graphical user interface on a computer system as claimed in claim 1 wherein said display screen comprises a touch sensitive display screen.

9. The method of providing a graphical user interface on a computer system as claimed in claim 8 wherein said input from said user comprises a finger touching said touch sensitive display screen.

10. The method of providing a graphical user interface on a computer system as claimed in claim 1, said method further comprising the steps of:

rendering an anthropomorphic graphic character on said display;

attracting said user'"'"'s attention by animating said anthropomorphic graphic character; and

conveying state information regarding the current state of said graphical user interface to said user by changing a visual appearance of said anthropomorphic character.

11. The method of claim 2 wherein any location within an image may be displayed on said graphical display screen on any portion of said graphical display screen, such that said graphical display screen may display every part of an image that may not be completely displayed at one time.

12. A method of navigating through a dynamic graphical user interface, said graphical user interface displayed on a display screen, said graphical user interface comprising a plurality of spaces, each of said spaces comprising a graphic background image depicting a real-world scene familiar to users, said spaces organized into a directed graph structure in which said spaces are connected by a plurality of portals, said method comprising the steps of:

displaying a first space on said display screen;

displaying two or more portals from said plurality of portals in said space, wherein;

each of said portals in said plurality of portals has an associated target space such that each of said portals connects in said directed graph structure the space in which each of said portals is disposed with said associated target space;

each of said portals in said plurality of portals provides said user access to the target space associated with said portal;

said directed graph structure connects at least one portal in said plurality of portals with at least two succeeding portals and at least one previous portal; and

each of said portals in said plurality of portals comprises a graphic icon which can be duplicated and moved to customize said user interface;

displaying a wayback portal within at least part of said first space, said wayback portal rendered as an icon representing a space from which said user accessed said first space, said wayback portal distinct from said plurality of portals,

wherein at least one of said plurality of portals provided in each said space is an agent portal, the agent portal carrying objects designated by the user between the spaces.

13. The method of claim 12 wherein said wayback portal is rendered and displayed on said graphical display screen as a snapshot of the space corresponding to said wayback portal.

14. A method of providing a dynamic graphical user interface on a computer system, said computer system comprising a CPU, a memory, and graphics display screen, said method comprising the steps of:

providing a plurality of spaces, each of said spaces comprising a graphic background image depicting a real-world scene familiar to users;

providing a plurality of portals, each of said portals comprising a graphical icon which can be duplicated and moved to customize said user interface;

providing at least one button object, said at least one button object having an associated function;

providing at least one data object, said at least one data object containing information to direct the operation of said associated function;

organizing said spaces in a directed graph structure, said spaces connected together in a directed graph structure by said plurality of portals, said directed graph structure connecting at least one portal with at least two succeeding portals and at least one previous portal;

locating each of said plurality of portals in said spaces, each of said portals having an associated target space such that said portal connects in said directed graph structure the space in which said portal is disposed with said associated target space, and said portal provides users access to said associated target space;

rendering a graphic background image of a first space and portals located in said first space on said graphics display screen, said first space having at least a first portal;

receiving a first data input from a user, said first data input comprising a portal selected from said portals located in said first space;

rendering a graphic background image of one of said target spaces associated with said selected portal on said graphics display screen;

rendering said at least one button object within said spaces, said at least one button object comprising a graphical icon;

rendering said at least one data object within said spaces, said at least one data object comprising a graphical icon;

receiving a second data input from said user, said second data input selecting said at least one data object;

receiving a third data input from said user, said third data input selecting said at least one button object; and

executing the function associated with a button object according to the information in said at least one data object when said button object is selected by said user,

wherein at least one of said plurality of portals provided in each said space is an agent portal, the agent portal carrying objects designated by the user between the spaces.

15. The method of claim 14 wherein said step of receiving said third data input from said user further comprises the step of dropping said data icon into said button icon.

16. The method of claim 15 wherein a data object from a first space may be associated with a button object from a second space.

17. The method of claim 14, where said graphic background images are displayed in desaturated colors and said button objects and data objects are displayed in bright colors.