User interface system, scene description generating device and method, scene description distributing method, server device, remote terminal device, recording medium, and sending medium

• US 20010056471A1
• Filed: 02/28/2001
• Published: 12/27/2001
• Est. Priority Date: 02/29/2000
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yagasaki, Yoichi, Negishi, Shinji, Koyanagi, Hideki
• Application Number:
  US09/795,842
• Publication Number:
  US 20010056471A1
• Time in Patent Office: Days
• US Class Current: 709/208
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/637 Control signals issued by the client directed to the server or network components

Abstract

A user interface system comprises a server having a scene description decoding device for decoding input scene description and an equipment control signal generating device for generating equipment control signals, a remote terminal having a scene description decoding device for decoding scene description sent form the server into decoded scenes and a display device for displaying the decoded scenes and a user input device for receiving user input according to this display, a display terminal for displaying decoded scenes from the server, and controlled equipment which is controlled by equipment control signals from the server. Thus, easy operation of the remote terminal is facilitated.

Claims

1. A user interface system using scene description information containing user interaction, said system comprising:

a server; and

a remote terminal comprising

decoding means for decoding scene description information,

display means for displaying scenes, and

input means for inputting user input information;

wherein said server sends scene description information to said remote terminal, said remote terminal decodes scene description information sent from said server with the decoding means thereof and displays on said display means, and user input information input to said input means according to the display is sent to said server.

2. A user interface system according to

claim 1

, said server further comprising storing means for storing scene description information, wherein scene description information stored in said storing means is sent to said remote terminal.

3. A user interface system according to

claim 2

, said server further comprising equipment operating signal generating means for generating equipment control signals for controlling said server or external controlled equipment, wherein scene description information representing a menu for controlling equipment stored in said storing means is sent to said remote terminal, said remote terminal decodes the scene description information with the decoding means thereof and displays the menu for controlling equipment on the display means thereof, user input information input to said input means according to said display is sent to said server, and said server generates equipment control signals at the equipment operating signal generating means thereof based on the user input information.

4. A user interface system according to

claim 2

, said remote terminal further comprising equipment operating signal generating means for generating equipment control signals for controlling said remote terminal or external controlled equipment, wherein said server sends scene description information representing a menu for controlling equipment stored in said storing means to said remote terminal, said remote terminal decodes the scene description information with the decoding means thereof and displays the menu for controlling equipment on the display means thereof, and equipment control signals are generated at the equipment operating signal generating means thereof based on the user input information input to said input means based on the display.

5. A user interface system according to

claim 1

, said server further comprising:

decoding means for decoding scene description information; and

display means for displaying scene description information decoded by said decoding means;

wherein said decoding means decode scene description information of contents containing user interaction and scene description information representing an equipment control menu for controlling said server or external controlled device, and said display means display contents containing user interaction and said controlled equipment menu, thereby enabling operating of user interaction contained in scene description information and said equipment control menu upon said remote terminal without differentiation.

6. A user interface system according to

claim 1

, said server further comprising scene description generating means for generating scene description information, wherein scene description information generated by said scene description generating means is input.

7. A user interface system according to

claim 6

, wherein said scene description generating means generate scene description information for the equipment control menu for controlling said server or external controlled equipment, with the same scene description method as that of the contents.

8. A scene description generating device for generating scene description information containing user interaction, said device comprising generating means generating control scene description information for controlling external controlled equipment, with the same scene description method as that of the contents.

9. A scene description generating device according to

claim 8

, wherein said generating means generate scene description information containing, in a mixed manner, scene description information of contents containing user interaction and scene description information of a control menu for controlling external controlled equipment.

10. A scene description generating method for generating scene description information containing user interaction, said method comprising a generating step for generating control scene description information for controlling external controlled equipment, with the same scene description method as that of the contents.

11. A scene description generating method according to

claim 10

, wherein said generating step generates scene description information containing, in a mixed manner, scene description information of contents containing user interaction and scene description information of a control menu for controlling external controlled equipment.

12. A scene description distribution method using scene description information containing user interaction to distribute scene description information to a system comprising a server and remote terminal;

wherein scene description information of the device control menu generated by the same scene description method as that of the contents is distributed, and scene description information stored in said server or said remote terminal is updated with said scene description information.

13. A scene description distribution method according to

claim 12

, wherein scene description information containing in a mixed manner scene description information of contents containing user interaction and scene description information of an equipment control menu is distributed, and scene description information stored in said server or said remote terminal is updated with said scene description information.

14. A server device which uses scene description information containing user interaction and cooperatively with a remote terminal configures a user interface, wherein scene description information is sent to said remote terminal, and user input information input according to said scene description information which has been decoded and display at said remote terminal is received.

15. A server device according to

claim 14

, comprising storing means for storing scene description information, wherein scene description information stored in said storing means is sent to said remote terminal.

16. A server device according to

claim 15

, comprising equipment operating signal generating means for generating equipment control signals for controlling external controlled devices, wherein scene description information representing a menu for controlling equipment is stored in said storing means, said scene description information is sent to said remote terminal, and user input information input according to said scene description decoded and displayed at said remote terminal is received.

17. A server device according to

claim 15

, wherein scene description information representing a device control menu is stored in said storing means, said scene description information is sent to said remote terminal, and equipment control signals for controlling external controlled devices are generated at said remote terminal based on user input information input according to said scene description information that has been decoded and displayed.

18. A server device according to

claim 14

, further comprising:

decoding means for decoding scene description information; and

display means for displaying scene description information decoded by said decoding means;

wherein said decoding means decode scene description information containing user interaction and scene description information representing a control menu for controlling external controlled device, and said display means display scenes for contents containing user interaction and scenes for said control menu, thereby enabling operating of user interaction contained in scene description information and said control menu at said remote terminal without differentiation.

19. A server device according to

claim 14

, further comprising scene description generating means for generating scene description information, wherein scene description information generated by said scene description generating means is taken as input.

20. A server device according to

claim 19

, wherein said scene description generating means generate scene description information for the equipment control menu for controlling external controlled equipment, with the same scene description method as that of the contents.

21. A remote terminal device which uses scene description information containing user interaction and cooperatively with a server configures a user interface, said device comprising:

decoding means for decoding scene description information;

display means for displaying scenes; and

input means for inputting user input information;

scene description information sent from said server is decoded and displayed on said display means, and user input information input to said input means according to the display is sent to said server.

22. A remote terminal device according to

claim 21

, wherein scenes representing a menu for controlling equipment sent from said server is received, the received scene description information is decoded with said decoding means and displayed on said display means, user input information input to said input means according to said display is sent to said server, and said server generates equipment control signals for controlling external controlled devices based on the user input information.

23. A sending medium for sending scene description information containing user interaction, wherein said scene description information describing the equipment control menu is described with the same scene description method as that of the contents.

24. A sending medium according to

claim 23

, wherein said scene description information comprises scene description information of contents containing user interaction and scene description information of an equipment control menu, in a mixed manner.

25. A recording medium for recording scene description information containing user interaction, wherein said scene description information describing the equipment control menu is recorded with the same scene describing method as that of the contents.

26. A recording medium according to

claim 25

, wherein said scene description information comprises scene description information of contents containing user interaction and scene description information of an equipment control menu, in a mixed manner.