Home automation control using context sensitive menus

• US 9,824,578 B2
• Filed: 09/03/2014
• Issued: 11/21/2017
• Est. Priority Date: 09/03/2014
• Status: Active Grant

• Current Assignee: EchoStar Technologies International Corporation (Echostar Corporation)
• Original Assignee: EchoStar Technologies International Corporation (Echostar Corporation)
• Inventors: Burton, David, Ward, Martyn
• Primary Examiner(s): Wu, Zhen Y
• Application Number:
  US14/476,377
• Publication Number:
  US 20160063854A1
• Time in Patent Office: 1,175 Days
• Field of Search: 340 125
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/20 Binding and programming of remote control devices
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/71 Directional beams
• CPC Class Codes: G08C 2201/91 Remote control based on location and proximity
• CPC Class Codes: G08C 2201/92 Universal remote control
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop

Abstract

Various arrangements for presenting contextual menus are presented. A mobile device may be configured to provide contextual menus for control or monitoring of components. Different menus and interfaces are presented based the position of the mobile device or objects being pointed at using the mobile device. Specific objects may be designated as control markers. The objects may be recognized using a camera of the mobile device. When a control marker is recognized a specific menu or interface that is associated with the control marker may be presented to the user.

Claims

1. A method for automation control using a mobile device, comprising:

receiving, using an input interface, input corresponding to selection of a remote controlled home automation device;

capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device;

capturing, using a position sensor, a position of the mobile device to associate with control marker;

generating a template for the control marker using the position and the image;

determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device;

capturing, using the image sensor, a second image of the house-hold object;

determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template;

providing an indication that the mobile device is pointing at the control marker;

determining a user interface for the remote controlled home automation device; and

providing the user interface on the mobile device for interacting with the remote controlled home automation device;

wherein the user interface includes features specific to the remote controlled home automation device.

2. The method of claim 1, further comprising:

establishing a communication channel with the remote controlled home automation device;

receiving, via the communication channel, data related to a state of the remote controlled home automation device; and

transmitting, via the communication channel, a control command to the remote controlled home automation device.

3. The method of claim 1, further comprising:

determining a change in the relative position of the mobile device;

determining that the mobile device is pointing at a second control marker associated with a second remote controlled home automation device; and

modifying the user interface on the mobile device for interacting with the second remote controlled home automation device associated with the second control marker.

4. The method of claim 1, wherein position includes an orientation and a location of the mobile device.

5. The method of claim 1, further comprising:

receiving input corresponding to selection of a custom interface design including one or more features specific to the remote controlled home automation device to include in the user interface; and

modifying the user interface to include the custom interface design.

6. The method of claim 5, wherein the custom interface design includes a subset of available features specific to the remote controlled home automation device.

7. The method of claim 1, wherein determining the relative position of the mobile device comprises:

receiving data from a sensor attached to the mobile device; and

tracking movement of the mobile device by analyzing changes in data from the sensor.

8. A non-transitory processor-readable medium for automation control using a mobile device, the medium comprising processor-readable instructions that, when executed by one or more processors, cause the one or more processors to perform operations including:

receiving, using an input interface, input corresponding to selection of a remote controlled home automation device;

capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device;

capturing, using a position sensor, a position of the mobile device to associate with control marker;

generating a template for the control marker using the position and the image;

determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device;

capturing, using the image sensor, a second image of the house-hold object;

determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template;

providing an indication that the mobile device is pointing at the control marker;

determining a user interface for the remote controlled home automation device; and

providing the user interface on the mobile device for interacting with the remote controlled home automation device;

wherein the user interface includes features specific to the remote controlled home automation device.

9. The non-transitory processor-readable medium of claim 8, wherein the operations further include:

establishing a communication channel with the remote controlled home automation device;

receiving, via the communication channel, data related to a state of the remote controlled home automation device; and

transmitting, via the communication channel, a control command to the remote controlled home automation device.

10. The non-transitory processor-readable medium of claim 8, wherein the operations further include:

determining a change in the relative position of the mobile device;

determining that the mobile device is pointing at a second control marker associated with a second remote controlled home automation device; and

modifying the user interface on the mobile device for interacting with the second remote controlled home automation device associated with the second control marker.

11. The non-transitory processor-readable medium of claim 8, wherein position includes an orientation and a location of the mobile device.

12. The non-transitory processor-readable medium of claim 8, wherein the operations further include:

receiving input corresponding to selection of a custom interface design including one or more features specific to the remote controlled home automation device to include in the user interface; and

modifying the user interface to include the custom interface design.

13. The non-transitory processor-readable medium of claim 12, wherein the custom interface design includes a subset of available features specific to the remote controlled home automation device.

14. The non-transitory processor-readable medium of claim 8, wherein determining the relative position of the mobile device comprises:

receiving data from a sensor attached to the mobile device; and

tracking movement of the mobile device by analyzing changes in data from the sensor.

15. A mobile device configured for automation control, comprising:

one or more processors;

a memory communicatively coupled with and readable by the one or more processors and having stored therein processor-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including;

receiving, using an input interface, input corresponding to selection of a remote controlled home automation device;

capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device;

capturing, using a position sensor, a position of the mobile device to associate with the control marker;

generating a template for the control marker using the position and the image;

determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device;

capturing, using the image sensor, a second image of the house-hold object;

determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template;

providing an indication that the mobile device is pointing at the control marker; and

determining a user interface for the remote controlled home automation device; and

providing the user interface on the mobile device for interacting with the remote controlled home automation device;

wherein the user interface includes features specific to the remote controlled home automation device.

16. The mobile device of claim 15, wherein the operations further include:

establishing a communication channel with the remote controlled home automation device;

receiving, via the communication channel, data related to a state of the remote controlled home automation device; and

transmitting, via the communication channel, a control command to the remote controlled home automation device.

17. The mobile device of claim 15, wherein the operations further include:

determining a change in the relative position of the mobile device;

determining that the mobile device is pointing at a second control marker associated with a second remote controlled home automation device; and

modifying the user interface on the mobile device for interacting with the second remote controlled home automation device associated with the second control marker.

18. The mobile device of claim 15, wherein position includes an orientation and a location of the mobile device.

19. The mobile device of claim 15, wherein the operations further include:

receiving input corresponding to selection of a custom interface design including one or more features specific to the remote controlled home automation device to include in the user interface; and

modifying the user interface to include the custom interface design.

20. The mobile device of claim 19, wherein the custom interface design includes a subset of available features specific to the remote controlled home automation device.