Smart-Remote Protocol

• US 20120198350A1
• Filed: 02/01/2011
• Published: 08/02/2012
• Est. Priority Date: 02/01/2011
• Status: Active Grant

• Current Assignee: Saturn Licensing LLC (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Nhiayi, Kao
• Granted Patent: US 8,990,703 B2
• Time in Patent Office: Days
• US Class Current: 715/740
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G08C 2201/20 Binding and programming of remote control devices
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612

Abstract

A remote menu control function mapping set including user interface control commands that control operation of a second device is obtained at a first device from the second device. The user interface control commands are encoded using a shared cross-communication library that defines a user interface sharing protocol. A menu that maps the encoded user interface control commands to menu items using the shared cross-communication library is generated. The generated menu is displayed on a display of the first device. A selection of a menu item from the displayed menu is detected. An encoded user interface control command that is mapped to the selected menu item is sent to the second device. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Claims

1. A method of controlling devices with different user interface control protocols, comprising:

broadcasting a probe command from a first device;

receiving a service identifier (ID) from a second device in response to the probe command;

obtaining, using the service ID at a first device from a second device, a remote menu control function mapping set comprising user interface control commands that control operation of the second device formatted as an extensible markup language (XML) formatted menu structure and comprising metadata identifying at least one menu style attribute used by the second device during menu display, where the user interface control commands are encoded via a shared cross-communication library that defines a user interface sharing protocol;

determining a menu tree structure for menu and control functions of each encoded user interface control command, where each control function comprises a control function identifier (ID) and a range of selectable values;

determining at least one menuing shortcut that is not provided by the encoded user interface control commands;

determining whether to use the at least one menu style attribute to generate a menu;

generating the menu that maps the encoded user interface control commands to menu items using the shared cross-communication library based upon the determined menu tree structure, the determined at least one menuing shortcut that is not provided by the encoded user interface control commands, and using the at least one menu style attribute in response to determining to use the at least one menu style attribute to generate the menu, where each node of the menu tree structure is mapped to one of the control functions using the control function ID;

encoding the range of selectable values for each node into the menu tree structure;

displaying the generated menu via a display of the first device;

detecting a selection of a menu item from the displayed menu comprising a selection of a value from the range of selectable values; and

sending an encoded user interface control command that is mapped to the selected menu item comprising the control function ID and the selected value to the second device.

2. A method of controlling devices with different user interface control protocols, comprising:

obtaining at a first device from a second device a remote menu control function mapping set comprising user interface control commands that control operation of the second device, where the user interface control commands are encoded via a shared cross-communication library that defines a user interface sharing protocol;

generating a menu that maps the encoded user interface control commands to menu items using the shared cross-communication library;

displaying the generated menu via a display of the first device;

detecting a selection of a menu item from the displayed menu; and

sending an encoded user interface control command that is mapped to the selected menu item to the second device.

3. The method according to claim 2, further comprising:

receiving a request at the first device from a third device for a local menu control function mapping set of the first device comprising user interface control commands that control operation of the first device encoded via the shared cross-communication library that defines the user interface sharing protocol;

sending the local menu control function mapping set of the first device to the third device;

receiving an encoded local menu user interface control command of the local menu control function mapping set from the third device; and

executing a local menu command that is mapped to the received encoded local menu user interface control command.

4. The method according to claim 2, where obtaining at the first device from the second device the remote menu control function mapping set comprising the user interface control commands that control operation of the second device comprises:

broadcasting a device discovery request via at least one communication protocol available on the first device;

discovering the second device via the at least one communication protocol available on the first device; and

requesting the remote menu control function mapping set from the second device.

5. The method according to claim 4, where:

discovering the second device via the at least one communication protocol available on the first device comprises discovering the second device as one of a plurality of discovered devices accessible via the at least one communication protocol available on the first device;

obtaining at the first device from the second device the remote menu control function mapping set comprising the user interface control commands that control operation of the second device comprises obtaining one of a plurality of remote menu control function mapping sets from each of the plurality of discovered devices;

generating the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library comprises generating the menu that maps encoded user interface control commands of each of the plurality of remote menu control function mapping sets to the menu items using the shared cross-communication library; and

sending the encoded user interface control command that is mapped to the selected menu item to the second device comprises sending the encoded user interface control command that is mapped to the selected menu item to each of the plurality of discovered devices.

6. The method according to claim 2, where generating the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library comprises:

determining to use fewer than all of the encoded user interface control commands for the generated menu;

discarding at least one of the encoded user interface control commands; and

generating the menu without the discarded at least one of the encoded user interface control commands.

7. The method according to claim 2, where generating the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library comprises:

determining at least one menuing shortcut that is not provided by the encoded user interface control commands; and

generating the menu using the determined at least one menuing shortcut that is not provided by the encoded user interface control commands.

8. The method according to claim 2, where the obtained remote menu control function mapping set comprises additional information identifying at least one menu style attribute used by the second device during menu display;

and

where generating the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library comprises;

determining whether to use the at least one menu style attribute to generate the menu; and

generating the menu using the at least one menu style attribute in response to determining to use the at least one menu style attribute to generate the menu.

9. The method according to claim 8, where the at least one menu style attribute is encoded as metadata within the obtained remote menu control function mapping set and where the metadata comprises information regarding layout of user interface controls for a user interface of the second device.

10. The method according to claim 2, further comprising:

determining resource requirements to support the remote menu control function mapping set of the second device;

comparing the resource requirements with resource availability of the first device to support the remote menu control function mapping set of the second device;

determining that at least one resource constraint exists that limits use of all features of the remote menu control function mapping set;

obtaining one of a virtual remote control interface that maps to a remote control device associated with the second device to menu commands and an extended remote control interface comprising at least one shortcut menu option; and

where generating the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library comprises generating the menu comprising the one of the virtual remote control interface and the extended remote control interface.

11. A computer readable storage medium storing instructions which, when executed on one or more programmed processors, carry out a method according to claim 2.

12. An apparatus for controlling devices with different user interface control protocols, comprising:

a display; and

a processor programmed to;

obtain from a second device a remote menu control function mapping set comprising user interface control commands that control operation of the second device, where the user interface control commands are encoded via a shared cross-communication library that defines a user interface sharing protocol;

generate a menu that maps the encoded user interface control commands to menu items using the shared cross-communication library;

display the generated menu via the display;

detect a selection of a menu item from the displayed menu; and

send an encoded user interface control command that is mapped to the selected menu item to the second device.

13. The apparatus according to claim 12, where the processor is further programmed to:

receive a request from a third device for a local menu control function mapping set comprising user interface control commands that control operation encoded via the shared cross-communication library that defines the user interface sharing protocol;

send the local menu control function mapping set to the third device;

receive an encoded local menu user interface control command of the local menu control function mapping set from the third device; and

execute a local menu command that is mapped to the received encoded local menu user interface control command.

14. The apparatus according to claim 12, where, in being programmed to obtain from the second device the remote menu control function mapping set comprising the user interface control commands that control operation of the second device, the processor is programmed to:

broadcast a device discovery request via at least one communication protocol;

discover the second device via the at least one communication protocol; and

request the remote menu control function mapping set from the second device.

15. The apparatus according to claim 14, where, in being programmed to:

discover the second device via the at least one communication protocol, the processor is programmed to discover the second device as one of a plurality of discovered devices accessible via the at least one communication protocol;

obtain from the second device the remote menu control function mapping set comprising the user interface control commands that control operation of the second device, the processor is programmed to obtain one of a plurality of remote menu control function mapping sets from each of the plurality of discovered devices;

generate the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library, the processor is programmed to generate the menu that maps encoded user interface control commands of each of the plurality of remote menu control function mapping sets to the menu items using the shared cross-communication library; and

send the encoded user interface control command that is mapped to the selected menu item to the second device, the processor is programmed to send the encoded user interface control command that is mapped to the selected menu item to each of the plurality of discovered devices.

16. The apparatus according to claim 12, where, in being programmed to generate the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library, the processor is programmed to:

determine to use fewer than all of the encoded user interface control commands for the generated menu;

discard at least one of the encoded user interface control commands; and

generate the menu without the discarded at least one of the encoded user interface control commands.

17. The apparatus according to claim 12, where, in being programmed to generate the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library, the processor is programmed to:

determine at least one menuing shortcut that is not provided by the encoded user interface control commands; and

generate the menu using the determined at least one menuing shortcut that is not provided by the encoded user interface control commands.

18. The apparatus according to claim 12, where the obtained remote menu control function mapping set comprises additional information identifying at least one menu style attribute used by the second device during menu display;

and

where, in being programmed to generate the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library, the processor is programmed to;

determine whether to use the at least one menu style attribute to generate the menu; and

generate the menu using the at least one menu style attribute in response to determining to use the at least one menu style attribute to generate the menu.

19. The apparatus according to claim 18, where the at least one menu style attribute is encoded as metadata within the obtained remote menu control function mapping set and where the metadata comprises information regarding layout of user interface controls for a user interface of the second device.

20. The apparatus according to claim 12, where the processor is further programmed to:

determine resource requirements to support the remote menu control function mapping set of the second device;

compare the resource requirements with resource availability to support the remote menu control function mapping set of the second device;

determine that at least one resource constraint exists that limits use of all features of the remote menu control function mapping set;

obtain one of a virtual remote control interface that maps to a remote control device associated with the second device to menu commands and an extended remote control interface comprising at least one shortcut menu option; and

where, in being programmed to generate the menu that maps the encoded user interface control commands to the menu items using the shared cross-communication library, the processor is programmed to generate the menu comprising the one of the virtual remote control interface and the extended remote control interface.