Determining state signatures for consumer electronic devices coupled to an audio/video switch

• US 10,701,284 B2
• Filed: 02/08/2018
• Issued: 06/30/2020
• Est. Priority Date: 02/10/2017
• Status: Active Grant

• Current Assignee: Caavo Inc
• Original Assignee: Caavo Inc
• Inventors: Marino, Nino V., Aggarwal, Ashish D., Satheesh, Sharath H., Gopinath, Vinod K.
• Primary Examiner(s): Teitelbaum, Michael E
• Application Number:
  US15/892,215
• Publication Number:
  US 20180234637A1
• Time in Patent Office: 873 Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/43635 HDMI
• CPC Class Codes: H04N 21/44227 Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811
• CPC Class Codes: H04N 21/44231 Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device configuring of peripheral devices in general G06F9/4411; reporting information sensed by appliance or service execution status of appliance services in a home automation network H04L12/2823; monitoring the status of connected device in data switched networks H04L43/0817
• CPC Class Codes: H04N 21/4436 Power management, e.g. shutting down unused components of the receiver power management in computer systems G06F1/3203; hibernate or awake process in computer systems G06F9/4418
• CPC Class Codes: H04N 5/268 Signal distribution or switching
• CPC Class Codes: H04N 5/63 Generation or supply of power specially adapted for television receivers

Abstract

Methods, systems, and apparatuses are described for automatically determining a state signature for consumer electronic device(s) coupled to a switching device and/or other devices communicatively coupled to the consumer electronic device(s). The state signature is indicative of functional state(s) in which the consumer electronic device(s) are in. Such states include a power state, a proximity state, a communication state, and/or an operational state of the consumer electronic device(s). Based on the state signature(s), the switching device may infer which of the consumer electronic device(s) the user would like to use (or is using) and cause action(s) to be performed. Such actions include automatically switching to the AV port(s) to which such consumer electronic device(s) are connected, transmitting command(s) to such consumer electronic device(s), transmitting a notification message to such consumer electronic device(s), etc.

Claims

1. A method performed by a high-definition multimedia interface (HDMI)-based switching device comprising a plurality of HDMI ports, comprising:

determining state characteristics of a consumer electronic device that is communicatively coupled to the HDMI-based switching device via a first port of the HDMI ports and at least a first interface and second interface that are different than the HDMI ports, wherein the state characteristics are based on an analysis of;

a video signal received via the first port to determine a playback state of the consumer electronic device,

a voltage received via the first port,

a radio frequency signal received via the first interface, and

network data packets via the second interface;

determining a state signature of the consumer electronic device based on the determined state characteristics;

automatically identifying an action to be performed by the consumer electronic device from a plurality of actions based on the determined state signature and a data structure that comprises a state signature-to-action mapping, the state signature-to-action mapping specifying the action from the plurality of actions to be performed for the determined state signature; and

causing the action to be performed with respect to at least one of the HDMI-based switching device or the consumer electronic device.

2. The method of claim 1, wherein said determining state characteristics of the consumer electronic device comprises:

detecting the voltage on a pin of the first port of the plurality of HDMI ports to which the consumer electronic device is coupled; and

identifying a power state of the consumer electronic device based on the detected voltage.

3. The method of claim 1, wherein said determining state characteristics of the consumer electronic device further comprises:

determining whether the consumer electronic device is playing back at least one of video content or audio content; and

identifying at least one of an operational state or a power state of the consumer electronic device based on the playing back determination.

4. The method of claim 1, wherein said determining state characteristics of the consumer electronic device further comprises:

detecting a voice command intended for the consumer electronic device; and

identifying at least one of an operational state or a power state of the consumer electronic device based on the detected voice command.

5. The method of claim 1, wherein said determining state characteristics of the consumer electronic device further comprises:

monitoring a network, to which the HDMI-based switching device and the consumer electronic device are communicatively coupled, for network data received by the consumer electronic device; and

identifying at least one of an operational state, a power state, or a communication state of the consumer electronic device based on said monitoring.

6. The method of claim 1, wherein said determining state characteristics of the consumer electronic device further comprises:

detecting a command sent to the consumer electronic device from a remote control device; and

identifying at least one of an operational state or a power state of the consumer electronic device based on the detected command.

7. The method of claim 1, wherein said determining state characteristics of the consumer electronic device comprises:

detecting the radio frequency signal from the consumer electronic device; and

identifying at least one of a power state, an operational state or a proximity state of the consumer electronic device based on the detected radio frequency signal.

8. The method of claim 1, wherein said determining state characteristics of the consumer electronic device further comprises:

determining an amount of current associated with or an amount of power consumed by the consumer electronic device; and

identifying a power state based on the determined amount of current or the determined amount of power.

9. The method of claim 1, wherein said determining state characteristics of the consumer electronic device further comprises:

sending a query to the consumer electronic device for a status;

receiving a response from the consumer electronic device that includes the status; and

identifying at least one of a power state or an operational state of the consumer electronic device based on the received response.

10. The method of claim 1, wherein the state signature of the consumer electronic device is based on at least one of:

a power state of the consumer electronic device;

a proximity state of the consumer electronic device to another device;

a communication state of the consumer electronic device;

or

an operational state of the consumer electronic device.

11. The method of claim 1, wherein said causing the action comprises at least one of:

transmitting a toggle command to the consumer electronic device to toggle a power state of the consumer electronic device;

transmitting an operational command to the consumer electronic device that causes the consumer electronic device to perform an operation specified by the operational command;

automatically switching to an HDMI port of the plurality of HDMI ports to which the consumer electronic device is coupled;

or

transmitting a notification message to the consumer electronic device.

12. An HDMI-based switching device, comprising:

a plurality of HDMI ports;

a characteristic identification component configured to determine state characteristics of a consumer electronic device that is communicatively coupled to the HDMI-based switching device via a first port of the HDMI ports and at least a first interface and second interface that are different than the HDMI ports, wherein the state characteristics are based on an analysis of;

a video signal received via the first port to determine a playback state of the consumer electronic device,

a voltage received via the first port,

a radio frequency signal received via the first interface, and

network data packets via the second interface;

a signature determination component configured to determine a state signature of the consumer electronic device based on the determined state characteristics; and

an action determination component configured to;

automatically identify an action to be performed by the consumer electronic device from a plurality of actions based on the determined state signature and a data structure that comprises a state signature-to-action mapping, the state signature-to-action mapping specifying the action from the plurality of actions to be performed for the determined state signature; and

cause the action to be performed with respect to at least one of the HDMI-based switching device or the consumer electronic device.

13. The HDMI-based switching device of claim 12, wherein the characteristic identification component comprises a signal detector configured to determine a state characteristic of the state characteristics, the signal detector configured to:

detect the voltage on a pin of the first port of the plurality of HDMI ports to which the consumer electronic device is coupled; and

identify a power state of the consumer electronic device based on the detected voltage.

14. The HDMI-based switching device of claim 12, wherein the characteristic identification component comprises an audio/video detector configured to determine a state characteristic of the state characteristics, the audio/video detector configured to:

determine whether the consumer electronic device is playing back at least one of video content or audio content;

identify at least one of an operational state or a power state of the consumer electronic device based on the determination.

15. The HDMI-based switching device of claim 12, wherein the characteristic identification component comprises a user input monitor comprising a microphone and is configured to determine a state characteristic of the state characteristics, the user input monitor configured to:

detect, by the microphone, a voice command intended for the consumer electronic device; and

identify at least one of an operational state or a power state of the consumer electronic device based on the detected voice command.

16. The HDMI-based switching device of claim 12, wherein the characteristic identification component comprises a network monitor, wherein the network monitor is configured to determine a state characteristic of the state characteristics, the network monitor configured to:

monitor a network to which the HDMI-based switching device and the consumer electronic device are communicatively coupled for network data received by the consumer electronic device; and

identify at least one of an operational state, a power state, or a communication state of the consumer electronic device based on said monitoring.

17. The HDMI-based switching device of claim 12, wherein the characteristic identification component comprises a remote signal detector, wherein the remote signal detector is configured to determine a state characteristic of the state characteristics, the remote signal detector configured to:

detect a command sent to the consumer electronic device from a remote control device; and

identify at least one of an operational state or a power state of the consumer electronic device based on the detected command.

18. The HDMI-based switching device of claim 12, wherein the characteristic identification component comprises a proximity detector, wherein the proximity detector is configured to determine a state characteristic of the state characteristics, the proximity detector configured to:

detect the radio frequency signal from the consumer electronic device received via the first interface; and

identify at least one of a power state, an operational state or a proximity state of the consumer electronic device based on the detected radio frequency signal.

19. The HDMI-based switching device of claim 12, wherein the characteristic identification component comprises a power monitor, wherein the power monitor is configured to determine a state characteristic of the state characteristics, the power monitor configured to:

determine an amount of current associated with or an amount of power consumed by the consumer electronic device; and

identify a power state based on the determined amount of current or the determined amount of power.

20. A system, comprising:

one or more processors; and

a memory containing computer-readable instructions, which, when executed by the one or more processors, is configured to perform operations in an HDMI-based switching device comprising a plurality of audio/video (AV) ports, the operations comprising;

determining state characteristics of a consumer electronic device that is communicatively coupled to the HDMI switching device via a first port of the AV ports and at least a first interface and a second interface that are different than the HDMI ports, wherein the state characteristics are based on an analysis of;

a video signal received via the first port to determine a playback state of the consumer electronic device,

a voltage received via the first port,

a radio frequency signal received via the first interface, and

network data packets via the second interface;

determining a state signature of the consumer electronic device based on the determined state characteristics;

automatically identifying an action to be performed by the consumer electronic device from a plurality of actions based on the determined state signature and a data structure that comprises a state signature-to-action mapping, the state signature-to-action mapping specifying the action from the plurality of actions to be performed for the determined state signature; and

causing the action to be performed with respect to at least one of the HDMI switching device or the consumer electronic device.