Contextual, two way remote control

• US 10,063,619 B2
• Filed: 08/26/2016
• Issued: 08/28/2018
• Est. Priority Date: 07/03/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Lu, Jeff Ting Yann
• Primary Examiner(s): Aziz, Adnan
• Application Number:
  US15/249,264
• Publication Number:
  US 20160366208A1
• Time in Patent Office: 732 Days
• Field of Search: None
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

This application is directed to enabling interaction between computer devices. An application is executed at a first computer device to access Internet-based media content sources and display media items provided thereby on a display device coupled to the first computer device. The first computer device transmits an information item, a plurality of display instructions and a command to a second computer device. The information item includes a selectable display element corresponding to one of the Internet-based media content sources, and the second computer device is configured to select and implement one of the display instructions for displaying the selectable display element of the information item. In response to a user selection of the selectable display item at the second computer device, the first computer device receives the command from the second computer device, and executes the command in relation to the Internet-based media content sources.

Claims

1. A computer-implemented method for allowing interaction between computer devices, the method comprising:

at a first computer device that is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including an Internet-based media content source accessible via the first computer device;

executing an application that accesses the Internet-based media content source and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device;

generating an information item and a command associated with the information item independently of the second computer device, wherein the information item includes a selectable display element associated with the Internet-based media content source;

transmitting to the second computer device the information item, the command and a plurality of display instructions, wherein the second computer device is configured to select and implement in accordance with an associated functionality and size of the second computer device one of the plurality of display instructions for displaying the selectable display element of the information item, and the plurality of display instructions specify respective display schemes for displaying the selectable display element of the information item on second computer devices of different sizes and functionalities; and

in response to a user selection of the selectable display element at the second computer device, receiving from the second computer device the command associated with the information item; and

executing by the application the command in relation to the Internet-based media content source.

2. The computer-implemented method of claim 1, further comprising:

receiving the command from the second computer device in response to a selection of the information item by the user; and

performing a predefined action in response to receiving the command.

3. The computer-implemented method of claim 2, wherein the predefined action is causing display of media content associated with the information item on the display device associated with the first computer device.

4. The computer-implemented method of claim 3, wherein the media content is one or more of:

a video, a television station, an audio track, an audio station, and a picture.

5. The computer-implemented method of claim 2, wherein the predefined action is a media-device control action.

6. The computer-implemented method of claim 5, wherein the media-device control action is one or more of:

changing a channel, changing volume level, changing a device setting, initiating a record function, adjusting a playback speed, and changing an operating state of a device.

7. The computer-implemented method of claim 1, wherein the information item is a label that includes at least one of a graphic and text.

8. The computer-implemented method of claim 1, wherein the one of the plurality of display instructions is tailored for the second computer device based on form factors of the second computer device.

9. The computer-implemented method of claim 1, further comprising:

transmitting, to the second computer device, a collection of information items, and

transmitting, to the second computer device, a collection display instruction associated with the collection of information items.

10. The computer-implemented method of claim 9, wherein the collection display instruction indicates that the collection of information items is to be displayed in a list format, a tree format, a gallery format, or a hierarchical folder format.

11. An electronic device, wherein the electronic device includes a first computer device that is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including an Internet-based media content source accessible via the first computer device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

executing an application that accesses the Internet-based media content source and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device;

generating an information item and a command associated with the information item independently of the second computer device, wherein the information item includes a selectable display element associated with the Internet-based media content source;

transmitting to the second computer device the information item, the command and a plurality of display instructions, wherein the second computer device is configured to select and implement in accordance with an associated functionality and size of the second computer device one of the plurality of display instructions for displaying the selectable display element of the information item, and the plurality of display instructions specify respective display schemes for displaying the selectable display element of the information item on second computer devices of different sizes and functionalities; and

in response to a user selection of the selectable display element at the second computer device, receiving from the second computer device the command associated with the information item; and

executing by the application the command in relation to the Internet-based media content source.

12. The electronic device of claim 11, wherein the command is part of an action definition, and the information item and the action definition are incorporated in an HTML file.

13. The electronic device of claim 12, wherein the information item is one of a plurality of information items, the action definition is one of a plurality of action definitions, and the plurality of information items and the plurality of action definitions are incorporated in the HTML file.

14. The electronic device of claim 13, wherein the HTML file specifies a graphical layout for the plurality of information items and the plurality of action definitions.

15. The electronic device of claim 11, wherein each of the plurality of display instructions is tailored for a respective computer device based on one or more of a type, form factors and functionality of the respective computer device.

16. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a processor of a first computer device, cause the first computer device to:

at the first computer device, wherein the first computer device is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including an Internet-based media content source accessible via the first computer device;

execute an application that accesses the Internet-based media content source and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device;

generate an information item and a command associated with the information item independently of the second computer device, wherein the information item includes a selectable display element associated with the Internet-based media content source;

transmit to the second computer device the information item, the command and a plurality of display instructions, wherein the second computer device is configured to select and implement in accordance with an associated functionality and size of the second computer device one of the plurality of display instructions for displaying the selectable display element of the information item, and the plurality of display instructions specify respective display schemes for displaying the selectable display element of the information item on second computer devices of different sizes and functionalities; and

in response to a user selection of the selectable display element at the second computer device, receive from the second computer device the command associated with the information item; and

execute by the application the command in relation to the Internet-based media content source.

17. The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further comprising instructions for:

transmitting, to the second computer device, a group of collections; and

transmitting, to the second computer device, a collection display instruction associated with the group of collections.

18. The non-transitory computer-readable storage medium of claim 17, wherein the collection display instruction indicates that a respective collection of the group of collections is to be displayed in a separate tab of a user interface on the second computer device.

19. The non-transitory computer-readable storage medium of claim 17, wherein the collection display instruction indicates that a respective collection of the group of collections is to be displayed in a separate folder of a user interface of the second computer device.

20. The non-transitory computer-readable storage medium of claim 16, wherein the first computer device is configured to execute one or more applications, and the one or more applications are one or more of a web browser, a media browser, and a media player.