Contextual, two way remote control

• US 10,237,328 B2
• Filed: 03/21/2018
• Issued: 03/19/2019
• Est. Priority Date: 07/03/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Lu, Jeff Ting Yann
• Primary Examiner(s): Aziz, Adnan
• Application Number:
  US15/927,894
• Publication Number:
  US 20180213021A1
• Time in Patent Office: 363 Days
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

This application is directed to enabling interaction between computer devices. A first computer device is configured to access Internet-based media content sources and play media content items provided thereby on a media device. The first computer device transmits an information item and an action definition to a second computer device. The action definition includes commands associated with the information item. The information item includes information describing media content items, and the information corresponds to one of the Internet-based media content sources accessible via the first computer device and is configured to be displayed on the second computer device. In response to a user input at the second computer device, the first computer device receives, from the second computer device, and executes one of the commands in the action definition to perform a specified action with respect to the media content items corresponding to the Internet-based media content sources.

Claims

1. A computer-implemented method for allowing interaction between devices, the method comprising:

at a first computer device including a processor and memory, wherein the first computer device is coupled to a media device and facilitates the media device to output media content provided by a plurality of media content sources including one or more Internet-based media content sources;

executing an application that accesses the one or more Internet-based media content sources and outputs media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device, the second computer device including a touch-screen display, and another processor and memory;

obtaining an information item corresponding to one or more media content items that are provided by one of the one or more Internet-based media content sources accessible via the first computer device, wherein the information item includes information describing the one or more media content items, and the information describing the one or more media content items is configured to be displayed by the remote control application on the second computer device;

obtaining by the first computer device an action definition associated with the information item, wherein the action definition includes one or more commands associated with the information item;

transmitting the information item and the action definition from the first computer device to the second computer device;

in response to a user input at the second computer device, receiving by the first computer device, from the second computer device, a command to perform a specified action with respect to the one or more media content items, wherein the command received in response to the user input is one of the commands provided by the first computer device as part of the action definition and associated with the information item; and

executing the command in relation to the one or more media content items corresponding to the one or more Internet-based media content sources;

wherein the one or more media content items include an audio track, and the one or more Internet-based media content sources include an Internet-based audio channel with which the audio track is associated.

2. The computer-implemented method of claim 1, further comprising:

retrieving, by the second computer device, display rules, wherein the display rules provide instructions for displaying the information item in a user interface of the second computer device; and

displaying the information item in the user interface of the second computer device according to the display rules.

3. The computer-implemented method of claim 1, wherein the media device is a speaker device.

4. The computer implemented method of claim 3, wherein executing the command includes altering playback of the audio track on the media device.

5. The computer-implemented method of claim 4, wherein the one or more commands associated with the information item comprise at least one of:

a Play command;

a Stop command; and

a Pause command.

6. The computer-implemented method of claim 5, wherein the information describing the one or more media content items comprises:

a title of the media content item; and

an image associated with the media content item.

7. The computer-implemented method of claim 6, wherein the information item further includes information describing the audio channel with which the audio track is associated.

8. The computer-implemented method of claim 1, wherein the information describing one or more media content items is selected from a group consisting of a title, a file name, a thumbnail, and description of the one or more media content items.

9. The computer-implemented method of claim 1, wherein each of the one or more media content items is selected from a group consisting of a video clip, a television station, an audio track, an audio/radio station, and a picture.

10. The computer-implemented method of claim 1, further comprising:

sending a display instruction associated with the information item, wherein the display instruction indicates that the one or more media content items are to be displayed in list format, a tree format, a gallery format, or a hierarchical folder format.

11. The computer-implemented method of claim 1, wherein the information item and the action definition are incorporated in a HTML file.

12. The computer-implemented method of claim 1, further comprising displaying the information item in a user interface of the second computer device, wherein the user interface includes a content region and a control region that are distinct from each other, and one or more predefined playback controls are displayed in the control region, independently of the plurality of media content sources, when the information describing the one or more media content items is displayed in the content region.

13. The computer-implemented method of claim 12, wherein the one or more predefined playback controls are represented by a subset of a plurality of icons for rewinding, stopping, playing, pausing, and fast-forwarding media content.

14. The computer-implemented method of claim 1, wherein the information item corresponds to a single media content item provided by the one or more Internet-based media content sources or a folder containing multiple media content items provided by the one or more Internet-based media content sources.

15. The computer-implemented method of claim 1, wherein the second computer device includes a mobile device.

16. A first computer device, wherein the first computer device is coupled to a media device and facilitates the media device to output media content provided by a plurality of media content sources including one or more Internet-based media content sources, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for, at the first computer device;

executing an application that accesses the one or more Internet-based media content sources and outputs media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device, the second computer device including a touch-screen display, and another processor and memory;

obtaining an information item corresponding to one or more media content items that are provided by one of the one or more Internet-based media content sources accessible via the first computer device, wherein the information item includes information describing the one or more media content items, and the information describing the one or more media content items is configured to be displayed by the remote control application on the second computer device;

obtaining by the first computer device an action definition associated with the information item, wherein the action definition includes one or more commands associated with the information item;

transmitting the information item and the action definition from the first computer device to the second computer device;

in response to a user input at the second computer device, receiving by the first computer device, from the second computer device, a command to perform a specified action with respect to the one or more media content items, wherein the command received in response to the user input is one of the commands provided by the first computer device as part of the action definition and associated with the information item; and

executing the command in relation to the one or more media content items corresponding to the one or more Internet-based media content sources;

wherein the one or more media content items include an audio track, and the one or more Internet-based media content sources include an Internet-based audio channel with which the audio track is associated.

17. The first computer device of claim 16, wherein the one or more programs further comprise instructions for:

retrieving, by the second computer device, display rules, wherein the display rules provide instructions for displaying the information item in a user interface of the second computer device; and

displaying the information item in the user interface of the second computer device according to the display rules.

18. The first computer device of claim 16, wherein the media device is a speaker device.

19. The first computer device of claim 18, wherein executing the command includes altering playback of the audio track on the media device.

20. The first computer device of claim 19, wherein the one or more commands associated with the information item comprise at least one of:

a Play command;

a Stop command; and

a Pause command.

21. The first computer device of claim 20, wherein the information describing the one or more media content items comprises:

a title of the media content item; and

an image associated with the media content item.

22. The first computer device of claim 21, wherein the one or more programs further comprise instructions for displaying the information item in a user interface of the second computer device, wherein the user interface includes a content region and a control region that are distinct from each other, and one or more predefined playback controls are displayed in the control region, independently of the plurality of media content sources, when the information describing the one or more media content items is displayed in the content region.

23. The first computer device of claim 16, wherein the information item further includes information describing the audio channel with which the audio track is associated.

24. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a processor of a first computer device, cause the first computer device to perform operations for:

at the first computer device, wherein the first computer device is coupled to a media device and facilitates the media device to output media content provided by a plurality of media content sources including one or more Internet-based media content sources;

executing an application that accesses the one or more Internet-based media content sources and outputs media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device, the second computer device including a touch-screen display, and another processor and memory;

obtaining an information item corresponding to one or more media content items that are provided by one of the one or more Internet-based media content sources accessible via the first computer device, wherein the information item includes information describing the one or more media content items, and the information describing the one or more media content items is configured to be displayed by the remote control application on the second computer device;

obtaining an action definition associated with the information item, wherein the action definition includes one or more commands associated with the information item;

transmitting to the second computer device the information item and the action definition;

in response to a user input at the second computer device, receiving by the first computer device, from the second computer device, a command to perform a specified action with respect to the one or more media content items, wherein the command received in response to the user input is one of the commands provided by the first computer device as part of the action definition and associated with the information item; and

executing the command in relation to the one or more media content items corresponding to the one or more Internet-based media content sources;

wherein the one or more media content items include an audio track, and the one or more Internet-based media content sources include an Internet-based audio channel with which the audio track is associated.

25. The non-transitory computer-readable storage medium of claim 24, wherein the information describing one or more media content items is selected from a group consisting of a title, a file name, a thumbnail, and description of the one or more media content items.

26. The non-transitory computer-readable storage medium of claim 24, wherein each of the one or more media content items is selected from a group consisting of a video clip, a television station, an audio track, an audio/radio station, and a picture.

27. The non-transitory computer-readable storage medium of claim 24, wherein the one or more programs further comprise instructions for:

sending a display instruction associated with the information item, wherein the display instruction indicates that the one or more media content items are to be displayed in list format, a tree format, a gallery format, or a hierarchical folder format.

28. The non-transitory computer-readable storage medium of claim 24, wherein the information item and the action definition are incorporated in a HTML file.

29. The non-transitory computer-readable storage medium of claim 24, wherein the one or more programs further comprise instructions for displaying the information item in a user interface of the second computer device, wherein the user interface includes a content region and a control region that are distinct from each other, and one or more predefined playback controls are displayed in the control region, independently of the plurality of media content sources, when the information describing the one or more media content items is displayed in the content region.

30. The non-transitory computer-readable storage medium of claim 24, wherein the one or more commands associated with the information item comprise at least one of:

a Play command;

a Stop command; and

a Pause command.