Two Way Control of a Set Top Box using Optical Character Recognition

• US 20140181853A1
• Filed: 02/28/2014
• Published: 06/26/2014
• Est. Priority Date: 09/19/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Dureau, Vincent, Sandland, Nathan Leslie
• Granted Patent: US 9,866,899 B2
• Time in Patent Office: Days
• US Class Current: 725/19
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/47214 for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 5/50 Tuning indicators; Automatic tuning control

Abstract

Features of various implementations are used to control operation of a second electronic device from a first electronic device using indirect control methods and optical character recognition. In some implementations, communication between a primary set-top box and a supplemental set-top box is configured in order to avoid the need for one or more provider-specific APIs. For example, one aspect of the disclosure is a method of identifying commands that can be used to control one or more features of a primary set-top box (e.g., DVR or VOD features) by a supplemental set-top box issuing commands to the primary set-top box via a wireless (e.g., IR) transmitter, and then using optical character recognition to identify the outcomes of those commands as displayed on a primary TV display or secondary display.

Claims

1. A computer-implemented method of controlling an electronic device, comprising:

at a first electronic device coupled to a display and a first output connection of a second electronic device, the first electronic device including one or more processors and memory;

sending a first command sequence to the second electronic device via a wireless connection different from the first output connection, wherein the first command sequence is not known to be correct;

in response to the sending,

capturing display data provided by the second electronic device via the first output connection;

analyzing the display data to determine whether the first command sequence was performed correctly by the second electronic device; and

when the first command sequence was not performed correctly, sending a second command sequence to the second electronic device via the wireless connection, wherein the second command sequence is not known to be correct.

2. The computer-implemented method of claim 1, further comprising:

analyzing the display data to determine whether the second command sequence was performed correctly by the second electronic device; and

when the second command sequence was performed correctly, updating a first database to identify the second command sequence as a correct command sequence for the second electronic device.

3. The computer-implemented method of claim 1, wherein the first output connection of the second device is a one-way connection from the second electronic device to the first electronic device.

4. The computer-implemented method of claim 1, wherein the first output connection provides video and audio data corresponding to features provided by the second electronic device.

5. The computer-implemented method of claim 1, wherein the second electronic device provides a plurality of features that cannot be controlled by the first electronic device via the first output connection, further comprising:

when the first and second command sequences are intended to control a first feature provided by the second electronic device, selecting the first command sequence and the second command sequence from a database of command sequences based on a device type of the first electronic device and a feature type of the first feature.

6. The computer-implemented method of claim 5, wherein the second electronic device is a set top box and the plurality of features includes:

video on demand services, digital video recorder services, EPG services, and set top box services.

7. The computer-implemented method of claim 6, wherein the video on demand services include:

selecting a video on demand selection for viewing.

8. The computer-implemented method of claim 6, wherein the digital video recorder services include one or more of:

(a) scheduling a recording of a content item provided via the set top box,

(b) selecting for viewing a previously recording content item,

(c) retrieving the list of programmed recording for determining user preferences,

(d) modifying scheduling of a recording, and

(e) deleting a recording of a content item.

9. The computer-implemented method of claim 6, wherein the set-top box services include one or more of:

(a) checking an on/off state of the set top box,

(b) checking a menu state of the set top box,

(c) checking a provider associated with the set top box, and

(d) setting or determining a configuration of the set top box.

10. The computer-implemented method of claim 2, further comprising:

displaying a user interface on the display providing selectable user options for interacting with a plurality of features provided by the second electronic device;

responsive to user selection of an option associated with the first feature, selecting the second command sequence from the first database; and

issuing the second command sequence to the second electronic device.

11. The computer-implemented method of claim 1, wherein analyzing the display data to determine whether the first command sequence was performed correctly by the second electronic device includes:

based on a device type of the second electronic device and a feature type of a first feature intended to be controlled by the first command sequence;

accessing a database of expected display responses, wherein the database of expected display responses indicates two or more of;

(a) position, (b) bounding box locations, and (c) content of display information provided by the second electronic device for respective feature types;

determining from the database of expected display responses a first expected display response associated with the first feature;

comparing the captured display data to the first expected display response; and

determining based on an outcome of the comparison whether the first command sequence was performed correctly by the second electronic device.

12. The computer-implemented method of claim 1, further comprising:

in response to the sending, capturing audio data provided by the second electronic device via the first output connection;

analyzing the audio data in combination with the display data to determine whether the first command sequence was performed correctly by the second electronic device.

13. The computer-implemented method of claim 1, further comprising:

when a particular device type of the second electronic device is unknown;

analyzing the display data to determine whether the second command sequence was performed correctly by the second electronic device; and

when the second command sequence was performed correctly by the second electronic device;

updating a third database to indicate that the second electronic device is the particular device type.

14. The computer-implemented method of claim 1, wherein the analyzing the display data is performed at least in part at a server with which the first electronic device is in communication.

15. A computer-implemented method of controlling an electronic device, comprising:

at a first electronic device coupled to a display and a first output connection of a second electronic device, the first electronic device including one or more processors and memory;

sending a first command sequence to the second electronic device via a wireless connection different from the first output connection, wherein the first command sequence is selected to determine a first state of the second electronic device;

in response to the sending, capturing display data provided by the second electronic device via the first output connection;

analyzing the display data to determine the first state of the second electronic device; and

based on the first state and a device type of the second electronic device, sending a second command sequence to the second electronic device so as to control a feature provided by the second electronic device.

16. The computer-implemented method of claim 15, wherein the second electronic device is a set-top box and the plurality of features includes:

video on demand services, digital video recorder services, EPG services, and set top box services.

17. The computer-implemented method of claim 16, wherein the video on demand services include:

selecting a video on demand selection for viewing.

18. The computer-implemented method of claim 16, wherein the digital video recorder services include one or more of:

(a) scheduling a recording of a content item provided via the set top box, and (b) selecting for viewing a previously recording content item.

19. The computer-implemented method of claim 16, wherein the set top box services include one or more of:

(a) checking an on/off state of the set top box, (b) checking a menu state of the set top box, (c) checking a provider associated with the set top box, and (c) setting a configuration of the set top box.