Contextual, two way remote control

• US 9,430,937 B2
• Filed: 12/27/2012
• Issued: 08/30/2016
• Est. Priority Date: 07/03/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Lu, Jeff Ting Yann
• Primary Examiner(s): Backer, Firmin
• Assistant Examiner(s): Aziz, Adnan
• Application Number:
  US13/728,970
• Publication Number:
  US 20150194047A1
• Time in Patent Office: 1,342 Days
• Field of Search: 340/12.28
• US Class Current: 1/1
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

Methods and systems for allowing interaction between devices are described. At a first device, an application is executed. The application operates interactively with a remote control application executing on a second device. One or more information items are transmitted to the second device for display as one or more selectable display items. Each respective information item is associated with an action definition. The action definition includes a command to be sent by the second device to the first device in response to a user selection of the respective information item. A command is received from the second device in response to a selection of a first one of the selectable display items by the user. A predefined action is performed in response to receiving the command.

Claims

1. A computer-implemented method for allowing interaction between computer devices, the method comprising:

at a first computer device including a processor and memory, wherein the first computer device is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including one or more Internet-based media content sources;

executing an application that accesses the one or more Internet-based media content sources and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device, the second computer device including a touch-screen display, and another processor and memory;

transmitting to the second computer device an information item and an action definition associated with the information item, the action definition including a command, wherein the information item includes a selectable display element corresponding to one of the one or more Internet-based media content sources accessible via the first computer device, and the selectable display element is configured to be displayed by the remote control application on the second computer device;

transmitting to the second computer device a plurality of display instructions in association with the information item and the action definition, wherein each of the plurality of display instructions is tailored for a respective computer device based on one or more of a type, form factors and functionality of the respective computer device, and the second computer device is configured to select and implement one of the plurality of display instructions for displaying the selectable display element of the information item; and

in response to a user selection of the selectable display element at the second computer device, receiving from the second computer device the command previously transmitted to the second computer device in the action definition associated with the information item; and

executing the command in relation to the one of the one or more Internet-based media content sources.

2. The computer-implemented method of claim 1, further comprising:

receiving the command from the second computer device in response to a selection of the information item by the user; and

performing a predefined action in response to receiving the command.

3. The computer-implemented method of claim 2, wherein the predefined action is causing display of media content associated with the information item on a display device associated with the first computer device.

4. The computer-implemented method of claim 3, wherein the media content is one or more of a video, a television station, an audio track, an audio station, and a picture.

5. The computer-implemented method of claim 2, wherein the predefined action is a media-device control action.

6. The computer-implemented. method of claim 5, wherein the media-device control action is one or more of:

changing a channel, changing volume level, changing a device setting, initiating a record function, adjusting a playback speed, and changing an operating state of a device.

7. The computer-implemented method of claim 1, wherein the information item is a label that includes at least one of a graphic and text.

8. The computer-implemented method of claim 1, wherein the one of the plurality of display instructions is tailored for the second computer device based on form factors of the second computer device.

9. The computer-implemented method of claim 1, further comprising:

transmitting, to the second computer device, a collection of information items, and

transmitting, to the second computer device, a display instruction associated with the collection of information items.

10. The computer-implemented method of claim 9, wherein the display instruction indicates that the collection of information items is to be displayed in list format, a tree format, a gallery format, or a hierarchical folder format.

11. The computer-implemented method of claim 1, further comprising:

transmitting, to the second computer device, a group of collections; and

transmitting, to the second computer device, a display instruction associated with the group of collections.

12. The computer-implemented method of claim 11, wherein the display instruction indicates that a respective collection of the group of collections is to be displayed in a separate tab of a user interface on the second computer device.

13. The computer-implemented method of claim 11, wherein the display instruction indicates that a respective collection of the group of collections is to be displayed in a separate folder of a user interface of the second computer device.

14. The computer-implemented method of claim 1, wherein the information item and the action definition are incorporated in an HTML file.

15. The computer-implemented method of claim 14, Wherein the information item is one of a plurality of information items, the action definition is one of a plurality of action definitions, and the plurality of information items and the plurality of action definitions are incorporated in the HTML file.

16. The computer-implemented method of claim 15, wherein the HTML file specifies a graphical layout for the plurality of information items and the plurality of action definitions.

17. The computer-implemented method of claim 1, wherein the first computer device is configured to execute one or more applications.

18. The computer-implemented method of claim 17, wherein the one or more applications are one or more of a web browser, a media browser, and a media player.

19. An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for, at a first computer device, wherein the first computer device is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including one or more Internet-based media content sources;

executing an application that accesses the one or more Internet-based media content sources and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device, the second computer device including a touch-screen display, and another processor and memory;

transmitting to the second computer device an information item and an action definition associated with the information item, the action definition including a command, wherein the information item includes a selectable display element corresponding to one of the one or more Internet-based media content sources accessible via the first computer device, and the selectable display element is configured to be displayed by the remote control application on the second computer device;

transmitting to the second computer device a plurality of display instructions in association with the information item and the action definition, wherein each of the plurality of display instructions is tailored for a respective computer device based on one or more of a type, form factors and functionality of the respective computer device, and the second computer device is configured to select and implement one of the plurality of display instructions for displaying the selectable display element of the information item; and

in response to a user selection of the selectable display element at the second computer device, receiving from the second computer device the command previously transmitted to the second computer device in the action definition associated with the information item; and

executing the command in relation to the one of the one or more Internet-based media content sources.

20. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a processor of a first computer device, cause the first computer device to:

executing an application that accesses one or more Internet-based media content sources and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device, the second computer device including a touch-screen display, and another processor and storage medium, wherein the first computer device is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including the one or more Internet-based media content sources;

transmitting to the second computer device an information item and an action definition associated with the information item, the action definition including a command, wherein the information item includes a selectable display element corresponding to one of the one or more Internet-based media content sources accessible via the first computer device, and the selectable display element is configured to be displayed by the remote control application on the second computer device;

transmitting to the second computer device a plurality of display instructions in association with the information item and the action definition, wherein each of the plurality of display instructions is tailored for a respective computer device based on one or more of a type, form factors and functionality of the respective computer device, and the second computer device is configured to select and implement one of the plurality of display instructions for displaying the selectable display element of the information item; and

in response to a user selection of the selectable display element at the second computer device, receiving from the second computer device the command previously transmitted to the second computer device in the action definition associated with the information item; and

executing the command in relation to the one of the one or more Internet-based media content sources.