PUSHING A GRAPHICAL USER INTERFACE TO A REMOTE DEVICE WITH DISPLAY RULES PROVIDED BY THE REMOTE DEVICE

• US 20150149920A1
• Filed: 01/23/2015
• Published: 05/28/2015
• Est. Priority Date: 05/13/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Alsina, Thomas M., Huang, Szu Wen, Bull, William, Fadell, Anthony M., Dorogusker, Jesse Lee, Toprani, Shyam S., Schubert, Emily Clark
• Granted Patent: US 9,875,006 B2
• Time in Patent Office: Days
• US Class Current: 715/740
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: H04L 67/55 Push-based network services

Abstract

A graphical user interface (“GUI”) can be presented on a remote control accessory device that has user input and display devices. The GUI can be defined and managed by a portable media device that is controlled using the GUI. The portable media device can provide the accessory with a GUI image to be displayed. The accessory can send information to the portable media device indicative of a user operation of an input device in response to the displayed image. The portable media device can process this input to identify the action requested by the user and take the appropriate action, which can include updating the GUI image provided to the accessory.

Claims

1. A method for operating a portable media device, the method comprising, by the portable media device:

establishing a connection to an accessory having a display device and a user input control;

receiving configuration information from the accessory, the configuration including a display descriptor and a display rule;

determining, based at least in part on the display descriptor and the display rule, information content for a remote graphical user interface image;

generating the remote graphical user interface image including the information content, the remote graphical user interface image including a plurality of selectable items;

sending a video signal to the accessory, the video signal representing the remote graphical user interface image;

while sending the video signal, receiving a command from the accessory, the command reporting selection of a selectable item of the remote graphical user interface image; and

modifying the remote graphical user interface image based on the reported selection of the selectable item, wherein the modified remote graphical user interface image is subsequently represented in the video signal.

2. The method of claim 1, wherein the display rule includes a specification of a minimum character size.

3. The method of claim 1, wherein the display rule includes a region code, the method further comprising:

determining a minimum character size based on the region code.

4. The method of claim 3, wherein the minimum character size is specified as an angular size and wherein the display descriptor includes a screen distance parameter, the method further comprising:

determining a minimum character size in pixels based on the angular size and the screen distance parameter.

5. The method of claim 3, further comprising:

determining a maximum number of lines of text for an image based at least in part on the minimum character size.

6. The method of claim 3, further comprising:

determining a maximum number of characters per line of text for an image based at least in part on the minimum character size.

7. A computer program product comprising a computer readable storage medium encoded with program instructions that, when executed by a processor in a portable media device, cause the portable media device to execute a method, the method comprising:

establishing a connection to an accessory having a display device and a user input control;

receiving configuration information from the accessory, the configuration including a display descriptor and a display rule;

determining, based at least in part on the display descriptor and the display rule, information content for a remote graphical user interface image;

generating the remote graphical user interface image including the information content, the remote graphical user interface image including a plurality of selectable items;

sending a video signal to the accessory, the video signal representing the remote graphical user interface image;

while sending the video signal, receiving a command from the accessory, the command reporting selection of a selectable item of the remote graphical user interface image; and

modifying the remote graphical user interface image based on the reported selection of the selectable item, wherein the modified remote graphical user interface image is subsequently represented in the video signal.

8. The computer program product of claim 7, wherein the method further comprises:

receiving from the accessory information descriptive of a user input control,

wherein the information content for the remote graphical user interface image is determined based in part on the information descriptive of the user input control.

9. The computer program product of claim 7, wherein the display descriptor includes a display size specified in a length unit and a display resolution specified in pixels, wherein the display rule includes a minimum character size, and wherein the method further comprises:

determining a maximum number of lines of text for the remote graphical user interface image;

selecting a plurality of items about which information is to be displayed in the remote graphical interface image; and

selecting specific information to be displayed for each of the plurality of items based at least in part on the maximum number of lines of text.

10. The computer program of claim 9, wherein the information items include a portion of a scrollable list of items and wherein the method further comprises:

determining a scrolling speed for the scrollable list based at least in part on the maximum number of lines of text.

11. A portable media device comprising:

an accessory interface configured to communicate with an accessory; and

a processor coupled to the accessory interface and configured to provide a plurality of functionalities invokable by a user, the processor being further configured to;

receive configuration information via the accessory interface, the configuration information including display dimensions and a display rule;

receive input commands via the accessory interface, the input commands indicating operation of a user input control of the accessory;

generate remote graphical user interface images including a plurality of selectable items based at least in part on the received input commands, the display dimensions, and the display rule; and

send a video signal via the accessory interface, at least a portion of the video signal corresponding to a most recently generated remote graphical user interface image.

12. The portable media device of claim 11, further comprising a display device and wherein the processor is further configured to generate native graphical user interface images for the display device.

13. The portable media device of claim 11, wherein the processor is configured to switch between generating the native graphical user interface images and generating the remote graphical user interface images in response to a mode selection command received via the accessory interface.

14. The portable media device of claim 11, wherein the display dimensions include a display size specified in a length unit and a display resolution specified in pixels, wherein the display rule includes a minimum character size, and wherein the processor is further configured to:

determine a maximum number of lines of text for the remote graphical user interface image;

select a plurality of items about which information is to be displayed in the remote graphical interface image; and

select specific information to be displayed for each of the plurality of items based at least in part on the maximum number of lines of text.