PUSHING A USER INTERFACE TO A REMOTE DEVICE

• US 20100293462A1
• Filed: 01/06/2010
• Published: 11/18/2010
• Est. Priority Date: 05/13/2008
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fadell, Anthony M., Bull, William, Schubert, Emily Clark, Toprani, Shyam S., Dorogusker, Jesse Lee
• Application Number:
  US12/683,218
• Publication Number:
  US 20100293462A1
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131

Abstract

A graphical user interface (“GUI”) can be presented on a remote control accessory device that has user input and display devices. The GUI can be defined and managed by a portable media device that is controlled using the GUI. The portable media device can provide the accessory with a GUI image to be displayed. The accessory can send information to the portable media device indicative of a user operation of an input device in response to the displayed image. The portable media device can process this input to identify the action requested by the user and take the appropriate action, which can include updating the GUI image provided to the accessory.

Claims

1. A method for controlling a portable media device using an accessory, the method comprising, by the accessory:

providing configuration information to a portable media device, the configuration information including information selecting one or more functionalities from a plurality of functionalities of the portable media device as active functionalities;

receiving from the portable media device a first image signal, wherein at least a portion of the first image signal communicates a first graphical user interface image, the first graphical user interface image including a selectable item corresponding to each of the active functionalities;

displaying an image including the first graphical user interface image on a display device of the accessory based on the first image signal;

detecting user operation of an input control of the accessory;

sending to the portable media device an input signal indicating that the input control was operated;

receiving from the portable media device a second image signal, wherein at least a portion of the second image signal specifies a second graphical user interface image, the second graphical user interface image reflecting the operation of the input control; and

displaying an image including the second graphical user interface image on the display device of the accessory.

2. The method of claim 1 wherein the configuration information further includes a plurality of parameters characterizing the display device of the accessory.

3. The method of claim 1 further comprising, by the accessory:

requesting from the portable media device a list of functionalities supported by the portable media device; and

receiving from the portable media device the list of supported functionalities,

wherein the accessory selects the one or more active functionalities based at least in part on the received list of supported functionalities.

4. The method of claim 3 wherein the accessory selects the one or more active functionalities based in part on information about an operating status of the accessory.

5. The method of claim 1 further comprising:

sending a brightness adjustment command to the portable media device to request a change in brightness of the remote image.

6. The method of claim 1 further comprising, by the accessory:

detecting user operation of a video source selection control of the accessory; and

in response to detecting the operation of the video source selector control;

identifying a selected video source;

displaying an image in response to a video signal from the selected video source; and

notifying the portable media device that the video source has been changed.

7. A computer-readable medium containing program instructions, which when executed by a controller in an accessory cause the controller to execute a method of controlling a portable media device, the method comprising:

establishing a connection to a portable media device;

receiving a video signal from the portable media device, the video signal including a portion that represents a remote graphical user interface image generated by the portable media device;

displaying an image on a display screen of the accessory based on the received video signal;

while receiving the video signal and displaying the image, detecting user operation of an input control of the accessory; and

reporting the user operation of the input control to the portable media device, wherein the portable media device modifies the remote graphical user interface image based on the reported user operation of the input control.

8. The computer readable medium of claim 7 wherein reporting the user operation of the input control includes sending one of a plurality of input-reporting commands.

9. The computer readable medium of claim 8 wherein the plurality of input-reporting commands includes a first input-reporting command associated with a button and a second input-reporting command associated with a rotational control.

10. The computer readable medium of claim 9 wherein the plurality of input-reporting commands further includes a third command associated with a touchscreen input device.

11. The computer readable medium of claim 7 wherein the method further comprises:

obtaining from the portable media device a list of available functionalities; and

instructing the portable media device to expose one or more of the available functionalities via the remote graphical user interface image.

12. An accessory comprising:

a display device;

a user input control;

an interface configured to communicate with a portable media device; and

a controller coupled to the display device, the user input control, and the interface, the controller being configured to;

receive a video signal from the portable media device via the interface, the video signal encoding a graphical user interface image;

control the display device to display an image based on the received video signal, the displayed image including the graphical user interface image;

detect operation of the fuser input control; and

send a signal to the portable media device via the interface to indicate the operation of the user input control.

13. The accessory of claim 12 further comprising:

a video source selection control,

wherein the controller is further configured to detect operation of the video source selection control and to select a source for an image to be displayed based on the operation of the video source selection control.

14. The accessory of claim 13 wherein the controller is further configured to send a status message to the portable media device via the interface to indicate whether the selected video source is the portable media device.

15. The accessory of claim 12 wherein the video signal is an analog video signal.

16. The accessory of claim 12 wherein the controller is further configured to:

obtain from the portable media device a list of supported functionalities;

select one or more of the supported functionalities to be exposed via the graphical user interface image, the selection being based at least in part on an operating status of the accessory; and

communicate the selection of exposed functionalities to the portable media device via the interface.

17. A method for operating a portable media device, the method comprising, by the portable media device:

establishing a connection to an accessory having a display device and a user input control;

receiving configuration information from the accessory;

generating a remote graphical user interface image based at least in part on the configuration information;

sending a video signal to the accessory, the video signal representing the remote graphical user interface image;

while sending the video signal, receiving a command from the accessory, the command reporting an operation of the user input control of the accessory; and

modifying the remote graphical user interface image based on the reported operation of the user input control, wherein the modified remote graphical user interface image is subsequently represented in the video signal.

18. The method of claim 17 wherein the portable media device supports a plurality of functionalities and wherein the configuration information received from the accessory includes a selection of one or more of the plurality of functionalities as functionalities to be exposed, and

wherein the remote graphical user interface image includes a user-selectable element corresponding to each of the selected functionalities.

19. The method of claim 18 further comprising:

receiving from the accessory a request for a list of available functionalities; and

sending to the accessory the list of available functionalities, wherein the list includes at least some of the plurality of supported functionalities.

20. A portable media device comprising:

an accessory interface configured to communicate with an accessory; and

a processor coupled to the accessory interface and configured to provide a plurality of functionalities invokable by a user, the processor being further configured to;

receive input commands via the accessory interface, the input commands indicating operation of a user input control of the accessory;

generate remote graphical user interface images based at least in part on the received input commands; and

send a video signal via the accessory interface, at least a portion of the video signal corresponding to a most recently generated remote graphical user interface image.

21. The portable media device of claim 20 wherein the processor is further configured to receive via the accessory interface a list identifying one or more of the plurality of functionalities as being active functionalities and to generate an initial remote graphical user interface image based at least in part on the received list.

22. The portable media device of claim 20 further comprising a display device and wherein the processor is further configured to generate native graphical user interface images for the display device.

23. The portable media device of claim 22 wherein the processor is configured to switch between generating the native graphical user interface images and generating the remote graphical user interface images in response to a mode selection command received via the accessory interface.

24. The portable media device of claim 20 wherein the processor is further configured to:

receive a brightness command from the accessory via the accessory interface; and

modify the video signal based on the command to adjust brightness of the remote graphical user interface image.

25. The portable media device of claim 20 further comprising a digital-to-analog converter for generating an analog video signal and wherein the processor is further configured such that modifying the video signal based on the command includes adjusting a gain parameter of the digital-to-analog converter.