Methods and systems for acquiring specifications for remotely controlling electronics

• US 8,633,986 B1
• Filed: 11/05/2010
• Issued: 01/21/2014
• Est. Priority Date: 11/05/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Hughes, Ronald
• Primary Examiner(s): Czekaj, David
• Assistant Examiner(s): MESSMORE, JONATHAN R
• Application Number:
  US12/940,842
• Time in Patent Office: 1,173 Days
• Field of Search: 348/207.99, 3482071-20711, 348/211.99, 3482111-2118, 348725-734
• US Class Current: 348/161
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/42225 characterized by types of remote control, e.g. universal remote control
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence

Abstract

A computer-implemented method of controlling electronics is performed at an apparatus that includes one or more processors, a camera, and a transmitter. In the method, the camera acquires a first image of one or more electronic devices configured for remote control. A database is queried for information regarding the one or more electronic devices, based on the first image. In response to querying the database, the information regarding the one or more electronic devices is received. This information includes specifications for communicating with the one or more electronic devices. User input is received corresponding to a command for a respective electronic device of the one or more electronic devices. In response to the user input, an instruction corresponding to the command is transmitted to the respective electronic device via a signal generated by the transmitter in accordance with the specifications for communicating with the respective electronic device.

Claims

1. A computer-implemented method of controlling electronics, comprising:

at an apparatus comprising one or more processors, a camera, and a transmitter;

using the camera to acquire a first image of one or more electronic devices configured for remote control;

querying a database for information regarding the one or more electronic devices, based on the first image;

in response to the querying, receiving the information, which comprises specifications for communicating with the one or more electronic devices, wherein the information further comprises a specification for a light on a respective electronic device of the one or more electronic devices;

receiving user input corresponding to a command for a respective electronic device of the one or more electronic devices; and

in response to the user input, transmitting an instruction corresponding to the command to the respective electronic device via a signal generated by the transmitter in accordance with the specifications for communicating with the respective electronic device.

2. The computer-implemented method of claim 1, wherein:

the transmitter is an infra-red (IR) transmitter;

the one or more electronic devices are configured for remote control via IR signals; and

the specifications are specifications for communicating with the one or more electronic devices via the IR signals.

3. The computer-implemented method of claim 1, wherein:

the transmitter is a radio frequency (RF) transmitter;

the one or more electronic devices are configured for remote control via RF signals; and

the specifications are specifications for communicating with the one or more electronic devices via the RF signals.

4. The computer-implemented method of claim 1, wherein the specification for the light comprises a description of the location of the light on the respective electronic device.

5. The computer-implemented method of claim 1, wherein the specification for the light comprises an indication of a color of the light.

6. The computer-implemented method of claim 1, wherein the specification for the light specifies that a first color of the light corresponds to a first state of the respective electronic device and a second color of the light corresponds to a second state of the respective electronic device.

7. The computer-implemented method of claim 1, further comprising:

after transmitting the instruction, using the camera to acquire a second image of the one or more electronic devices;

based on the second image, determining that the light indicates that the respective electronic device did not perform the instruction; and

in response to the determining, retransmitting the instruction to the respective electronic device via a signal generated by the transmitter in accordance with the specifications for communicating with the respective electronic device.

8. The computer-implemented method of claim 1, further comprising:

before transmitting the instruction, using the camera to acquire a second image of the one or more electronic devices;

based on the second image, determining that the light indicates that the respective electronic device is not in a state corresponding to the command;

wherein the instruction is transmitted in response to the user input and also in response to the determining.

9. The computer-implemented method of claim 1, wherein the specifications comprise a specification for an instruction for toggling the power of the respective electronic device.

10. The computer-implemented method of claim 1, wherein:

the respective electronic device is a switch comprising a plurality of input ports and an output port; and

the specifications comprise a specification for an instruction to connect a respective input port of the plurality of input ports to the output port.

11. The computer-implemented method of claim 1, wherein querying the database comprises providing the first image to the database.

12. The computer-implemented method of claim 11, wherein:

the database is situated in a server system distinct from the computing device; and

providing the first image to the database comprises transmitting the first image from the computing device to the server system.

13. The computer-implemented method of claim 1, further comprising identifying the one or more electronic devices in the first image, wherein querying the database comprises providing a listing of the one or more electronic devices to the database.

14. A computer-implemented method of controlling electronics, comprising:

at an apparatus comprising one or more processors, a camera, and a transmitter, wherein the camera is situated within line-of-sight of a plurality of electronic devices, the plurality of electronic devices being configured for remote control and comprising a switch and a set of devices coupled to the switch, wherein the switch comprises a plurality of input ports and an output port, and wherein respective devices of the set are coupled to respective input and output ports of the switch, the switch further comprising a plurality of lights associated with respective ports of the input and output ports;

using the camera to acquire a first image of the switch;

transmitting an instruction to a respective device of the set;

after transmitting the instruction to the respective device, acquiring a second image of the switch;

comparing the first and second images to identify a light that changed state between the first and second images;

based on the comparing, determining that the respective device is coupled to the respective port associated with the light that changed state;

receiving a first user input corresponding to a command to select the respective device; and

in response to the first user input, transmitting an instruction to the switch to connect the port to which the respective device was determined to be coupled to another port.

15. The computer-implemented method of claim 14, wherein:

the respective device is determined to be coupled to an input port; and

the instruction to the switch is an instruction to connect the output port to the input port to which the respective device was determined to be coupled.

16. The computer-implemented method of claim 14, the method further comprising:

repeating the transmitting for multiple respective devices of the set;

after each transmitting operation, acquiring another image of the switch; and

comparing images acquired before and after each transmitting operation to identify lights that changed state, to determine the respective ports to which the multiple respective devices are coupled.

17. The computer-implemented method of claim 16, wherein the respective device is a first respective device, the method further comprising:

receiving a second user input corresponding to a command to select a second respective device; and

in response to the second user input, transmitting an instruction to the switch to connect the port to which the second respective device was determined to be coupled to another port.

18. The computer-implemented method of claim 14, wherein the switch is an HDMI switch.

19. The computer-implemented method of claim 14, wherein the set of devices comprises a media player and a set-top box each coupled to a respective input port and a television coupled to the output port.

20. The computer-implemented method of claim 14, wherein the instruction is an instruction to toggle power for the respective device.

21. The computer-implemented method of claim 14, wherein the first and second images are images of the plurality of electronic devices.

22. A system for controlling electronics, comprising:

a camera;

a transmitter;

one or more processors; and

memory storing one or more programs configured for execution by the one or more processors, the one or more programs comprising;

instructions for using the camera to acquire a first image of one or more electronic devices configured for remote control;

instructions for querying a database for information regarding the one or more electronic devices, based on the first image;

instructions for receiving the information in response to the querying, the information comprising specifications for communicating with the one or more electronic devices, wherein the information further comprises a specification for a light on a respective electronic device of the one or more electronic devices;

instructions for receiving user input corresponding to a command for a respective electronic device of the one or more electronic devices; and

instructions for transmitting, in response to the user input, an instruction corresponding to the command to the respective electronic device via a signal generated by the transmitter in accordance with the specifications for communicating with the respective electronic device.

23. A system for controlling electronics, comprising:

a transmitter;

a camera situated within line-of-sight of a plurality of electronic devices, the plurality of electronic devices being configured for remote control and comprising a switch and a set of devices coupled to the switch, wherein the switch comprises a plurality of input ports and an output port, and wherein respective devices of the set are coupled to respective input and output ports of the switch, the switch further comprising a plurality of lights associated with respective ports of the input and output ports;

one or more processors; and

memory storing one or more programs configured for execution by the one or more processors, the one or more programs comprising;

instructions for using the camera to acquire a first image of the switch;

instructions for transmitting an instruction to a respective device of the set;

instructions for acquiring a second image of the switch, after transmitting the instruction to the respective device;

instructions for comparing the first and second images to identify a light that changed state between the first and second images;

instructions for determining that the respective device is coupled to the respective port associated with the light that changed state, based on the comparing;

instructions for receiving a first user input corresponding to a command to select the respective device; and

instructions for transmitting, in response to the first user input, an instruction to the switch to connect the port to which the respective device was determined to be coupled to another port.

24. A non-transitory computer readable storage medium storing one or more programs configured to be executed by a system comprising one or more processors, a camera, and a transmitter, the one or more programs comprising:

instructions for using the camera to acquire a first image of one or more electronic devices configured for remote control;

instructions for querying a database for information regarding the one or more electronic devices, based on the first image;

instructions for receiving the information in response to the querying, the information comprising specifications for communicating with the one or more electronic devices wherein the information further comprises a specification for a light on a respective electronic device of the one or more electronic devices;

instructions for receiving user input corresponding to a command for a respective electronic device of the one or more electronic devices; and

instructions for transmitting, in response to the user input, an instruction corresponding to the command to the respective electronic device via a signal generated by the transmitter in accordance with the specifications for communicating with the respective electronic device.

25. A non-transitory computer readable storage medium storing one or more programs configured to be executed by a system comprising a transmitter, a camera, and one or more processors, wherein the camera is situated within line-of-sight of a plurality of electronic devices, the plurality of electronic devices being configured for remote control and comprising a switch and a set of devices coupled to the switch, the switch comprising a plurality of input ports and an output port, respective devices of the set being coupled to respective input and output ports of the switch, the switch further comprising a plurality of lights associated with respective ports of the input and output ports,

the one or more programs comprising:

instructions for using the camera to acquire a first image of the switch;

instructions for transmitting an instruction to a respective device of the set;

instructions for acquiring a second image of the switch, after transmitting the instruction to the respective device;

instructions for comparing the first and second images to identify a light that changed state between the first and second images;

instructions for determining that the respective device is coupled to the respective port associated with the light that changed state, based on the comparing;

instructions for receiving a first user input corresponding to a command to select the respective device; and

instructions for transmitting, in response to the first user input, an instruction to the switch to connect the port to which the respective device was determined to be coupled to another port.