Graphical user interface for displaying and manipulating objects

• US 6,160,551 A
• Filed: 03/20/1995
• Issued: 12/12/2000
• Est. Priority Date: 05/24/1993
• Status: Expired due to Term

• Current Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Frank, Edward H., Clanton, Charles H. III, Warth, Chris, LaVallee, David A., Palrang, Joseph M., Naughton, Patrick J., Gosling, James A., Sheridan, R. Michael
• Primary Examiner(s): dela Torre, Crescelle N.
• Application Number:
  US08/406,578
• Time in Patent Office: 2,094 Days
• Field of Search: 395/155, 395/157, 395/158, 395/159, 395/160, 395/161, 395/339, 395/348, 395/333, 395/347, 395/342, 395/349, 395/346, 395/335, 345/118, 345/119, 345/121, 345/145, 345/173, 345/339, 345/348, 345/333, 345/347, 345/342, 345/349, 345/346, 345/335, 345/358, 345/156, 345/169, 707/530, 707/539, 707/531
• US Class Current: 715/769
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 9/465 Distributed object oriented systems remote method invocation [RMI] G06F9/548
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: H03J 1/0025 in a remote control unit remote control tuning in general H03J9/00
• CPC Class Codes: H03J 2200/25 Remote control device with display
• CPC Class Codes: H03J 2200/26 Remote control device with touch screen display
• CPC Class Codes: H04B 1/202 by remote control
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/2809 indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/2818 from a device located outside both the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04L 69/329 : in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 : Network security protocols
• CPC Class Codes: H04M 1/72415 : for remote control of appliances
• CPC Class Codes: H04N 21/4113 : PC
• CPC Class Codes: H04N 21/41265 : having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4131 : home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/426 : Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4312 : involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 : for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4316 : for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43622 : Interfacing an external recording device
• CPC Class Codes: H04N 21/47 : End-user applications
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4722 : for requesting additional data associated with the content
• CPC Class Codes: H04N 21/478 : Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4821 : using a grid, e.g. sorted out by channel and broadcast time
• CPC Class Codes: H04N 21/485 : End-user interface for client configuration
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: Y10S 715/977 : Dynamic icon, e.g. animated or live action

Abstract

An intuitive graphical user interface is based upon a geographic map structure, and includes a system for controlling remote external electronic devices. In the defined graphical user interface, each space of the geographic map structure is rendered on a touch screen display as a graphic image of a geographic space. Within each space are colored cartoon-like icons called "objects" which can be selected and manipulated by the user. Certain objects, referred to as portals, transport the user from one space to another space when Selected. Other objects, referred to as buttons, perform associated actions or functions when Selected. The graphical user interface is displayed on a hand-held display device used to control remote devices. Each remote electronic device transmits a user interface program object that defines a graphical user interface to the display device. The hand-held display devices displays the graphical user interface associated with the remote device when a user selects an icon associated with the remote device on the display device'"'"'s touch screen display.

Claims

1. In an object-oriented graphic user interface, said object-oriented graphic user interface illustrating objects as graphical icons, a method of providing information to a program object, said method comprising the steps of:

rendering a graphic image of a data object at an initial position on a graphics display screen;

receiving input from a user comprising a command to move said data object;

receiving input from a user comprising a destination position on the graphics display screen to locate said data object, said program object located at said destination position;

rendering a ghost image comprising an exact copy of said graphic image of said data object drawn in muted colors of said data object at said initial position on said graphics display screen, wherein in response to the command to move said data object, said ghost image and said data object are moved together;

modifying the appearance of said program object to indicate that said program object will accept said data object;

receiving input from a user comprising a command to provide said data object to said program object when the appearance of said program object has been modified;

merging said ghost image and said graphic image of said data object;

providing a plurality of spaces, each of said spaces comprising a graphic background image depicting a real-world scene familiar to users;

rendering on said graphics display screen a portal in at least one of said spaces, said portal having an associated target space such that said portal connects the space where the portal is disposed to the associated target space, said portal comprising a graphic icon; and

wherein said input comprising the destination position to locate said object comprises holding said object over said portal for a predetermined minimum amount of time.

2. The method of providing information to a program object as claimed in claim 1, wherein said command to move said object comprises a finger touching a touch screen display of a hand-held device.

3. The method of providing information to a program object as claimed in claim 2, further comprising the step of

generating a tearing sound from a hand-held device, upon receiving said input comprising a command to move said object.

4. The method of providing information to a program object as claimed in claim 3, further comprising the step of

generating a carrying sound from a hand-held device, after receiving said input comprising a command to move said object and before receiving said input comprising the destination position to locate said object.

5. The method of providing information to a program object as claimed in claim 1, further comprising the step of rendering said ghost image in said associated target space.

6. The method of providing information to a program object as claimed in claim 5, wherein said input comprising the destination position to locate said object further comprises sliding a finger across said graphics display screen of a hand-held device to move said object from said initial position to said portal.

7. The method of providing information to a program object as claimed in claim 5, wherein said input comprising the destination position to locate said object comprises lifting said finger away from said graphics display screen of a hand-held device.

8. The method of providing information to a program object as claimed in claim 1 further comprising the step of:

providing an element for highlighting said program object after receiving command to move said data object.

9. The method of providing information to a program object as claimed in claim 1, wherein said input comprising the destination position to locate said data object further comprises sliding a finger across said graphics display screen of a hand-held device to move said data object from said initial position to said program object.

10. The method of moving an object in a graphical user interface as claimed in claim 9, wherein said input comprising the destination position to locate said data object comprises lifting said finger away from said hand-held device graphics display screen.

11. The method of providing information to a program object as claimed in claim 1, wherein said input from the user further includes a command to copy said data object.

12. A computer-readable medium containing instructions, for controlling a data processing system to perform a method of providing information to a program object, said method comprising the steps of:

rendering a graphic image of a data object at an initial position on a graphics display screen;

receiving input from a user comprising a command to move said data object;

receiving input from a user, said input comprising a destination position on the graphics display screen to locate said data object, said program object located at said destination position;

rendering a ghost image comprising an exact copy of said graphic image of said data object drawn in muted colors of said data object at said initial position on said graphics display screen, wherein in response to the command to move said data object, said ghost image and said data object are moved together;

modifying the appearance of said program object to indicate that said program object will accept said data object;

receiving input from a user comprising a command to provide said data object to said program object when the appearance of said program object has been modified;

merging said ghost image and said graphic image of said data object;

providing a plurality of spaces, each of said spaces comprising a graphic background image depicting a real-world scene familiar to users;

rendering on said graphics display screen a portal in at least one of said spaces, said portal having an associated target space such that said portal connects the space where the portal is disposed to the associated target space, said portal comprising a graphic icon; and

wherein said input comprising the destination position to locate said object comprises holding said object over said portal for a predetermined minimum amount of time.

13. In an object-oriented graphic user interface, said object-oriented graphic user interface illustrating objects as graphical icons, a method of providing information to a program object, said method comprising the steps of:

rendering a graphic image of a data object at an initial position on a graphics display screen;

receiving input from a user comprising a command to move said data object;

receiving input from a user comprising a destination position on the graphics display screen to locate said data object, said program object located at said destination position;

rendering a ghost image comprising an exact copy of said graphic image of said data object drawn in muted colors of said data object at said initial position on said graphics display screen, wherein in response to the command to move said data object, said ghost image and said data object are moved together;

modifying the appearance of said program object to indicate that said program object will accept said data object;

receiving input from a user comprising a command to provide said data object to said program object when the appearance of said program object has been modified;

merging said ghost image and said graphic image of said data object; and

generating a tearing sound from a hand-held device, upon receiving said input comprising a command to move said object.

14. A computer-readable medium containing instructions, for controlling a data processing system to perform a method of providing information to a program object, said method comprising the steps of:

rendering a graphic image of a data object at an initial position on a graphics display screen;

receiving input from a user comprising a command to move said data object;

receiving input from a user, said input comprising a destination position on the graphics display screen to locate said data object, said program object located at said destination position;

rendering a ghost image comprising an exact copy of said graphic image of said data object drawn in muted colors of said data object at said initial position on said graphics display screen, wherein in response to the command to move said data object, said ghost image and said data object are moved together;

modifying the appearance of said program object to indicate that said program object will accept said data object;

receiving input from a user comprising a command to provide said data object to said program object when the appearance of said program object has been modified;

merging said ghost image and said graphic image of said data object; and

generating a tearing sound from a hand-held device, upon receiving said input comprising a command to move said object.