Method and system for providing a user interface for a networked device using panel subunit descriptor information

• US 6,148,241 A
• Filed: 07/01/1998
• Issued: 11/14/2000
• Est. Priority Date: 07/01/1998
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation Of America (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Shima, Hisato, Ludtke, Harold Aaron, Kawamura, Harumi
• Primary Examiner(s): Heckler, Thomas M.
• Application Number:
  US09/108,265
• Time in Patent Office: 867 Days
• Field of Search: 700/83
• US Class Current: 700/83
• CPC Class Codes: G05B 19/0426 Programming the control sequence
• CPC Class Codes: G05B 2219/25057 Configuration stored in distributed database for real time use
• CPC Class Codes: G05B 2219/25083 For each subsystem a configuration
• CPC Class Codes: G05B 2219/25092 Customized control features, configuration
• CPC Class Codes: G05B 2219/25324 Modules connected to serial bus
• CPC Class Codes: H04L 12/2805 Home Audio Video Interoperability [HAVI] networks
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 2012/285 Generic home appliances, e.g. refrigerators

Abstract

A method and system for providing a user interface for a networked target device using panel subunit descriptor information maintained by the target device. The present invention utilizes a panel subunit to allow any compliant device (e.g., a target device) to describe the appearance of its physical (and logical) controls and displays to another device (e.g., an intelligent controller) and allows the controller to trigger actions on the target as if a user had physically manipulated the controls on the target device directly. The panel subunit uses objects defined with several standard types of controls and displays (e.g., push buttons, sliders, dials, LCD screens, etc.) that are commonly found on consumer electronic devices. The control types have well defined behaviors (e.g., buttons are pushed, dials are moved, values are input, etc.). In addition, the panel subunit defines a set of commands which are to be applied to any of these controls when selected by the user. The commands are defined to be sufficiently generic so that they apply to most types of controls. The panel subunit also defines generic user interaction commands (or user events) which can be applied to the controls (e.g., press, press and hold, release, input value, etc.) by a user. The purpose of these user events is to encapsulate the typical user manipulated action for the controls and to let the target device decide the manner in which to interpret the user actions on its own. A status descriptor keeps the intelligent controller informed of the status of the target device being manipulated.

Claims

1. In a network of consumer electronic products, a method of controlling a target device, said method comprising the steps of:

a) in a computer readable memory unit of said target device, defining an identifier descriptor data structure defining a hierarchy for elements of a physical control panel of said target device by pointing to descriptor list data structures;

b) in said computer readable memory unit of said target device, defining at least one descriptor list data structure containing a plurality of control objects wherein each control object defines a physical appearance and a value state for an element of said physical control panel of said target device;

c) in said computer readable memory unit of said target device, defining and updating a status descriptor data structure representing current states for said control objects; and

d) generating a user interface for controlling said target device by accessing said data structures of said target device and communicating generic user events to said target device for interpretation by said target device, said step d) performed by an intelligent controller coupled to said network.

2. A method as described in claim 1 further comprising the steps of:

e) said target device receiving a generic user event and interpreting said generic user event to determine a functionality to implement;

f) said target device implementing said functionality; and

g) said target device updating said status descriptor data structure to reflect any changes resulting from step f).

3. A method as described in claim 1 wherein each control object defines a control image of an element, a size of said control image and a value range of valid states for said element.

4. A method as described in claim 3 wherein each control object additionally defines a first text string defining a name of said element and a second text string defining help information related to said element.

5. A method as described in claim 3 wherein each control object additionally defines a group identification wherein elements are collected into discrete groups that share a common layout area within said physical control panel of said target device.

6. A method as described in claim 1 wherein said elements of said physical control panel include information input controls and display output units.

7. A method as described in claim 6 wherein said step d) comprises the steps of:

d1) accessing said plurality of control objects by accessing said identifier descriptor data structure and said descriptor list data structure;

d2) displaying graphic images of said elements of said physical control panel onto a display of said intelligent controller;

d3) receiving input from a user interacting with said graphic images;

d4) translating said input into generic user events; and

d5) communicating said generic user events to said target device to simulate user interaction with said elements of said physical control panel.

8. A method as described in claim 7 wherein said step d) further comprises the steps of:

d6) accessing said status descriptor data structure upon notification of a change in state of said target device; and

d7) updating said graphic images of said elements of said physical control panel based on said change in state.

9. A method as described in claim 7 wherein said intelligent controller is a set-top-box coupled to a television as said display.

10. In a network of consumer electronic products, a method of controlling a remote target device, said method comprising the steps of:

a) in a computer readable memory unit of said target device, defining an identifier descriptor data structure defining a hierarchy for elements of a control panel of said target device by pointing to descriptor list data structures;

b) in said computer readable memory unit of said target device, defining at least one descriptor list data structure containing a plurality of control objects wherein each control object defines a physical appearance and a value state for an element of said control panel of said target device;

c) in said computer readable memory unit of said target device, defining and updating a status descriptor data structure representing current states for said control objects;

d) generating a user interface for controlling said target device by accessing said data structures of said target device and communicating generic user events to said target device for interpretation by said target device, said step d) performed by an intelligent controller coupled to said network;

e) said target device receiving a generic user event and interpreting said generic user event to determine a functionality to implement;

f) said target device implementing said functionality; and

g) said target device updating said status descriptor data structure to reflect any changes resulting from step f).

11. A method as described in claim 10 wherein each control object defines a control image of an element, a size of said control image and a value range of valid states for said element.

12. A method as described in claim 11 wherein each control object additionally defines a first text string defining a name of said element and a second text string defining help information related to said element.

13. A method as described in claim 11 wherein each control object additionally defines a group identification wherein elements are collected into discrete groups that share a common layout area within said control panel of said remote target device.

14. A method as described in claim 10 wherein said elements of said control panel include information input controls and display output units.

15. A method as described in claim 14 wherein said step d) comprises the steps of:

d1) accessing said plurality of control objects by accessing said identifier descriptor data structure and said descriptor list data structure;

d2) displaying graphic images of said elements of said control panel onto a display of said intelligent controller;

d3) receiving input from a user interacting with said graphic images;

d4) translating said input into generic user events; and

d5) communicating said generic user events to said remote target device to simulate user interaction with said elements of said control panel.

16. A method as described in claim 15 wherein said step d) further comprises the steps of:

d6) accessing said status descriptor data structure upon notification of a change in state of said target device; and

d7) updating said graphic images of said elements of said control panel based on said change in state.

17. A method as described in claim 15 wherein said intelligent controller is a set-top-box coupled to a television as said display.

18. A communication network comprising:

a plurality of electronic devices coupled together with a bus architecture, said devices comprising a remote target device and an intelligent controller;

wherein said remote target device comprises a computer readable memory containing;

an identifier descriptor data structure defining a hierarchy for elements of a control panel of said remote target device by pointing to descriptor list data structures;

at least one descriptor list data structure including control objects wherein each control object defines a physical appearance and a value state for an element of said control panel of said remote target device; and

a status descriptor data structure representing current states for said control objects; and

wherein said intelligent controller is for accessing said data structures of said remote target device and communicating generic user events over said bus to said remote target device for interpretation by said remote target device.

19. A network as described in claim 18 wherein each control object defines a control image of an element, a size of said control image and a value range of valid states for said element.

20. A network as described in claim 18 wherein said remote target device is further for receiving a generic user event and interpreting said generic user event to determine a functionality to implement;

wherein said remote target device is for implementing said functionality; and

wherein said remote target device is for updating said status descriptor data structure to reflect any changes resulting from said implementing said functionality.

21. A network as described in claim 20 wherein said intelligent controller is further for displaying graphic images of said elements of said control panel onto a display;

wherein said intelligent controller is also for receiving input from a user interacting with said graphic images;

wherein said intelligent controller is also for translating said input into generic user events; and

wherein said intelligent controller is also for communicating said generic user events to said remote target device to simulate interaction of a user with said elements of said control panel.

22. A network as described in claim 21 wherein said intelligent controller is further for accessing said status descriptor data structure upon notification of a change in state of said target device;

and

wherein said intelligent controller is further for updating said graphic images of said elements of said control panel based on said change in state.

23. A network as described in claim 21 wherein said control panel is a virtual control panel.