3D mapping of internet of things devices
First Claim
1. A method for mapping and controlling network-enabled appliances with a control device, the method comprising:
- collecting, by at least one sensor of the control device, spatial information in three dimensions as the at least one sensor of the control device is moved within an environment containing network-enabled appliances, the at least one sensor including at least one camera;
recognizing at least one of the network-enabled appliances within the environment with machine vision techniques including applying text recognition algorithms to read physical tags to identify and recognize network enabled appliances in image data captured by the at least one camera;
receiving registration signals from at least one of the network-enabled appliances in the environment;
associating each network-enabled appliance with a respective three-dimensional (3D) position in the environment based on the spatial information;
registering each network-enabled appliance with the control device to create a registration log;
generating a digital map of the environment from the spatial information;
identifying rooms within the environment;
placing a representation of each network-enabled appliance on the digital map based on the respective 3D position;
generating a spatially aware rule set that applies to one or more of the rooms within the environment based upon the spatial information and the registration log;
detecting a trigger event; and
in response to the trigger event, commanding the network-enabled appliances within the room or rooms according to the spatially aware rule set.
2 Assignments
0 Petitions
Accused Products
Abstract
A method for mapping and controlling network-enabled appliances with a control device may comprise collecting spatial information in three dimensions as at least one sensor of the control device is moved within an environment, receiving registration signals from network-enabled appliances in the environment, and associating each network-enabled appliance with a respective 3D position in the environment based on the spatial information. The method may include generating a digital map of the environment from the spatial information and placing a representation of each network-enabled appliance on the digital map based on the respective 3D position. The method may also include generating a spatially aware rule set that applies to one or more rooms within the environment. The method may also include detecting a trigger event, and in response to the trigger event, commanding the network-enabled appliances according to the spatially aware rule set.
-
Citations
19 Claims
-
1. A method for mapping and controlling network-enabled appliances with a control device, the method comprising:
-
collecting, by at least one sensor of the control device, spatial information in three dimensions as the at least one sensor of the control device is moved within an environment containing network-enabled appliances, the at least one sensor including at least one camera; recognizing at least one of the network-enabled appliances within the environment with machine vision techniques including applying text recognition algorithms to read physical tags to identify and recognize network enabled appliances in image data captured by the at least one camera; receiving registration signals from at least one of the network-enabled appliances in the environment; associating each network-enabled appliance with a respective three-dimensional (3D) position in the environment based on the spatial information; registering each network-enabled appliance with the control device to create a registration log; generating a digital map of the environment from the spatial information; identifying rooms within the environment; placing a representation of each network-enabled appliance on the digital map based on the respective 3D position; generating a spatially aware rule set that applies to one or more of the rooms within the environment based upon the spatial information and the registration log; detecting a trigger event; and in response to the trigger event, commanding the network-enabled appliances within the room or rooms according to the spatially aware rule set. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An automation system comprising a control device for mapping and controlling network-enabled appliances, the control device comprising:
-
at least one sensor configured to collect spatial information in three dimensions as the at least one sensor is moved within an environment containing network-enabled appliances, wherein the at least one sensor includes at least one camera; a communication unit, including at least the one sensor or at least one second sensor, and further including a transmitter, the communication unit being configured to receive registration signals from at least one of the network-enabled appliances in the environment; and a processor configured to execute an automation program to; recognize at least one of the network-enabled appliances within the environment with machine vision techniques, the machine vision techniques including applying text recognition algorithms to read physical tags to identify and recognize network enabled appliances in image data captured by the at least one camera; associate each network-enabled appliance with a respective three-dimensional (3D) position in the environment based on the spatial information; register each network-enabled appliance with the control device to create a registration log; generate a digital map of the environment from the spatial information;
identify rooms within the environment;place a representation of each network-enabled appliance on the digital map based on the respective 3D position; generate a spatially aware rule set that applies to one or more of the rooms within the environment based upon the spatial information and the registration log; and in response to a trigger event, command the network-enabled appliances within the room or rooms via the communication unit according to the spatially aware rule set. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. An automation system comprising a control device for mapping and controlling network-enabled appliances, the control device comprising:
-
at least one sensor configured to collect spatial information in three dimensions as the at least one sensor is moved within an environment containing network-enabled appliances, wherein the at least one sensor includes at least one camera that captures image data; a communication unit, including at least the one sensor or at least one second sensor, and further including a transmitter, the communication unit being configured to receive registration signals from at least one of the network-enabled appliances in the environment; and a processor configured to execute an automation program to; use the image data captured by the at least one camera and/or an additional camera of the control device to recognize at least one of the network-enabled appliances with machine vision techniques, the machine vision techniques including text recognition algorithms to read physical tags to identify and recognize network enabled appliances in the image data captured by the at least one camera; associate each network-enabled appliance with a respective three-dimensional (3D) position in the environment based on the spatial information; register each network-enabled appliance with the control device to create a registration log; generate a digital map of the environment from the spatial information;
identify rooms within the environment;place a representation of each network-enabled appliance on the digital map based on the respective 3D position; generate a spatially aware rule set that applies to one or more of the rooms within the environment based upon the spatial information and the registration log; detect a trigger event; and in response to the trigger event, command the network-enabled appliances within the room or rooms via the communication unit according to the spatially aware rule set.
-
Specification