Home automation control using context sensitive menus
First Claim
Patent Images
1. A method for automation control using a mobile device, comprising:
- receiving, using an input interface, input corresponding to selection of a remote controlled home automation device;
capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device;
capturing, using a position sensor, a position of the mobile device to associate with control marker;
generating a template for the control marker using the position and the image;
determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device;
capturing, using the image sensor, a second image of the house-hold object;
determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template;
providing an indication that the mobile device is pointing at the control marker;
determining a user interface for the remote controlled home automation device; and
providing the user interface on the mobile device for interacting with the remote controlled home automation device;
wherein the user interface includes features specific to the remote controlled home automation device.
3 Assignments
0 Petitions
Accused Products
Abstract
Various arrangements for presenting contextual menus are presented. A mobile device may be configured to provide contextual menus for control or monitoring of components. Different menus and interfaces are presented based the position of the mobile device or objects being pointed at using the mobile device. Specific objects may be designated as control markers. The objects may be recognized using a camera of the mobile device. When a control marker is recognized a specific menu or interface that is associated with the control marker may be presented to the user.
-
Citations
20 Claims
-
1. A method for automation control using a mobile device, comprising:
-
receiving, using an input interface, input corresponding to selection of a remote controlled home automation device; capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device; capturing, using a position sensor, a position of the mobile device to associate with control marker; generating a template for the control marker using the position and the image; determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device; capturing, using the image sensor, a second image of the house-hold object; determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template; providing an indication that the mobile device is pointing at the control marker; determining a user interface for the remote controlled home automation device; and providing the user interface on the mobile device for interacting with the remote controlled home automation device; wherein the user interface includes features specific to the remote controlled home automation device. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A non-transitory processor-readable medium for automation control using a mobile device, the medium comprising processor-readable instructions that, when executed by one or more processors, cause the one or more processors to perform operations including:
-
receiving, using an input interface, input corresponding to selection of a remote controlled home automation device; capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device; capturing, using a position sensor, a position of the mobile device to associate with control marker; generating a template for the control marker using the position and the image; determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device; capturing, using the image sensor, a second image of the house-hold object; determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template; providing an indication that the mobile device is pointing at the control marker; determining a user interface for the remote controlled home automation device; and providing the user interface on the mobile device for interacting with the remote controlled home automation device; wherein the user interface includes features specific to the remote controlled home automation device. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A mobile device configured for automation control, comprising:
-
one or more processors; a memory communicatively coupled with and readable by the one or more processors and having stored therein processor-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including; receiving, using an input interface, input corresponding to selection of a remote controlled home automation device; capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device; capturing, using a position sensor, a position of the mobile device to associate with the control marker; generating a template for the control marker using the position and the image;
determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device;capturing, using the image sensor, a second image of the house-hold object;
determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template;
providing an indication that the mobile device is pointing at the control marker; anddetermining a user interface for the remote controlled home automation device; and
providing the user interface on the mobile device for interacting with the remote controlled home automation device;wherein the user interface includes features specific to the remote controlled home automation device. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification