Trigger regions

• US 10,347,047 B2
• Filed: 07/19/2016
• Issued: 07/09/2019
• Est. Priority Date: 11/25/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Poursohi, Arshan, Aden, Daniel, Amacker, Matthew, Barker, Charles Robert, Byrne, Paul Vincent, Du Bois, Paul, Klein, Greg Joseph, Tompkins, Steve Scott
• Primary Examiner(s): Nguyen, Phu K
• Application Number:
  US15/213,843
• Publication Number:
  US 20170148217A1
• Time in Patent Office: 1,085 Days
• Field of Search: 345419
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

Claims

1. A method comprising:

receiving, by a computing system from a subscriber device as part of a service that the computing system provides to the subscriber device, (i) an indication of a virtual region within a virtual representation of a physical space and (ii) a trigger condition associated with the virtual region, wherein the virtual region corresponds to a physical region within the physical space, wherein the trigger condition corresponds to a particular physical change in the physical region, wherein the subscriber device contains program code that enables (i) transmission of the indication and the trigger condition to the computing system and (ii) subsequent receipt, from the computing system, of a notification that indicates that the trigger condition has been satisfied, wherein the subscriber device does not contain program code that enables use of sensor data as basis for detecting an event in the physical region that satisfies the trigger condition, and wherein the computing system providing the service comprises the computing system providing a programming building block that enables the subscriber device to cause the computing system to (i) receive, on behalf of the subscriber device, the sensor data from the plurality of sensors and (ii) detect, on behalf of the subscriber device, the event in the physical region that satisfies the trigger condition;

receiving, by the computing system, the sensor data from a plurality of sensors positioned in the physical space, wherein the plurality of sensors are external to the subscriber device, and wherein at least a portion of the sensor data is associated with the physical region within the physical space; and

based on the sensor data and as part of the service, the computing system detecting, on behalf of the subscriber device, the event in the physical region that satisfies the trigger condition corresponding to the particular physical change in the physical region, and responsively providing, to the subscriber device from which the indication of the virtual region and the trigger condition were received, the notification that indicates that the trigger condition has been satisfied.

2. The method of claim 1, wherein the virtual region corresponding to the physical region within the physical space comprises the virtual region corresponding to a three-dimensional (3D) sub-volume of the physical space.

3. The method of claim 1, wherein receiving the indication of the virtual region comprises receiving characteristics of the virtual region, and wherein the characteristics comprise one or more of:

(i) size of the virtual region, (ii) shape of the virtual region, (iii) relative location of the virtual region within the virtual representation of the physical space, (iv) relative orientation of the virtual region within the virtual representation of the physical space, and (v) a selection between the virtual region being a static virtual region or a dynamic virtual region.

4. The method of claim 1, wherein the physical region comprises a dynamic physical region that is associated with movement of an actor from at least a first point of the physical space to at least a second point of the physical space, and wherein the virtual region comprises a dynamic virtual region that corresponds to the dynamic physical region.

5. The method of claim 4, wherein the dynamic physical region has (i) a first shape while the actor is at the first point and (ii) a second shape while the actor is at the second point, and wherein the dynamic virtual region respectively takes on the first and second shapes while the actor is at the first and second points.

6. The method of claim 5, wherein the first and second shapes respectively correspond to particular shapes of the actor while the actor is at the first and second points.

7. The method of claim 1, further comprising:

in response to receiving the indication of the virtual region and the trigger condition, determining at least one sensor interpretation rule for detecting the event in the physical region that satisfies the trigger condition, wherein detecting the event comprises detecting the event based at least in part on the at least one sensor interpretation rule.

8. The method of claim 7, wherein determining the at least one sensor interpretation rule comprises determining the at least one sensor interpretation rule based at least in part on characteristics of one or more of the plurality of sensors positioned in the physical space.

9. The method of claim 8, wherein the characteristics comprise one or more of:

(i) sensor types, (ii) sensor models, (iii) sensor locations, (iv) sensor orientations, and (v) sensor association with the physical region.

10. The method of claim 7, wherein determining the at least one sensor interpretation rule comprises selecting one or more particular sensors, from among the plurality of sensors, to use in detecting the event.

11. The method of claim 10, wherein selecting one or more particular sensors comprises selecting at least (i) a first sensor configured to generate first sensor data and (ii) a second sensor configured to generate second sensor data, wherein determining the at least one sensor interpretation rule further comprises making a decision to use at least the first and second sensor data for detecting the event, and wherein detecting the event based at least in part on the at least one sensor interpretation rule comprises detecting the particular physical change in the physical region based on evaluation of at least the first and second sensor data.

12. The method of claim 7, wherein determining at least one sensor interpretation rule comprises determining the portion of the sensor data that is associated with the physical region within the physical space, and wherein detecting the event based at least in part on the at least one sensor interpretation rule comprises detecting the particular physical change in the physical region based on evaluation of the portion of the sensor data.

13. The method of claim 1, wherein the particular physical change comprises one or more of:

(i) entry of at least one actor into the physical region,

(ii) exit of the at least one actor from the physical region,

(iii) presence of the at least one actor in the physical region, and

(iv) occupancy of the physical region, wherein the occupancy corresponds to presence of at least a threshold number of actors in the physical region.

14. The method of claim 1, wherein the particular physical change comprises one or more of:

(i) a particular sound in the physical region, and

(ii) a particular phrase in the physical region.

15. The method of claim 1, wherein the subscriber device also does not contain program code that enables receipt of the sensor data from the plurality of sensors positioned in the physical space.

16. A computing system comprising:

one or more processors;

a non-transitory computer readable medium; and

program instructions stored on the non-transitory computer readable medium and executable by the one or more processors to;

receive, from a subscriber device as part of a service that the computing system provides to the subscriber device, (i) an indication of a virtual region within a virtual representation of a physical space and (ii) a trigger condition associated with the virtual region, wherein the virtual region corresponds to a physical region within the physical space, wherein the trigger condition corresponds to a particular physical change in the physical region, wherein the subscriber device contains program code that enables (i) transmission of the indication and the trigger condition to the computing system and (ii) subsequent receipt, from the computing system, of a notification that indicates that the trigger condition has been satisfied, wherein the subscriber device does not contain program code that enables use of sensor data as basis for detecting an event in the physical region that satisfies the trigger condition, and wherein the computing system providing the service comprises the computing system providing a programming building block that enables the subscriber device to cause the computing system to (i) receive, on behalf of the subscriber device, the sensor data from the plurality of sensors and (ii) detect, on behalf of the subscriber device, the event in the physical region that satisfies the trigger condition;

receive the sensor data from a plurality of sensors positioned in the physical space, wherein the plurality of sensors are external to the subscriber device, and wherein at least a portion of the sensor data is associated with the physical region within the physical space; and

based on the sensor data and as part of the service, detect, on behalf of the subscriber device, the event in the physical region that satisfies the trigger condition corresponding to the particular physical change in the physical region and responsively provide, to the subscriber device from which the indication of the virtual region and the trigger condition were received, the notification that indicates that the trigger condition has been satisfied.

17. The computing system of claim 16, wherein the physical region comprises a dynamic physical region that is associated with movement of an actor from at least a first point of the physical space to at least a second point of the physical space, and wherein the virtual region comprises a dynamic virtual region that corresponds to the dynamic physical region.

18. The computing system of claim 17, wherein the dynamic physical region has (i) a first shape while the actor is at the first point and (ii) a second shape while the actor is at the second point, wherein the dynamic virtual region respectively takes on the first and second shapes while the actor is at the first and second points, and wherein the first and second shapes respectively correspond to particular shapes of the actor while the actor is at the first and second points.

19. A non-transitory computer readable medium having stored therein instructions executable by one or more processors to cause a computing system to perform functions comprising:

receiving, from a subscriber device as part of a service that the computing system provides to the subscriber device, (i) an indication of a virtual region within a virtual representation of a physical space and (ii) a trigger condition associated with the virtual region, wherein the virtual region corresponds to a physical region within the physical space, wherein the trigger condition corresponds to a particular physical change in the physical region, wherein the subscriber device contains program code that enables (i) transmission of the indication and the trigger condition to the computing system and (ii) subsequent receipt, from the computing system, of a notification that indicates that the trigger condition has been satisfied, wherein the subscriber device does not contain program code that enables use of sensor data as basis for detecting an event in the physical region that satisfies the trigger condition, and wherein the computing system providing the service comprises the computing system providing a programming building block that enables the subscriber device to cause the computing system to (i) receive, on behalf of the subscriber device, the sensor data from the plurality of sensors and (ii) detect, on behalf of the subscriber device, the event in the physical region that satisfies the trigger condition;

receiving the sensor data from a plurality of sensors positioned in the physical space, wherein the plurality of sensors are external to the subscriber device, and wherein at least a portion of the sensor data is associated with the at least one physical region within the physical space; and

based on the sensor data and as part of the service, detecting, on behalf of the subscriber device, the event in the physical region that satisfies the trigger condition corresponding to the particular physical change in the physical region and responsively providing, to the subscriber device from which the indication of the virtual region and the trigger condition were received, the notification that indicates that the trigger condition has been satisfied.

20. The non-transitory computer readable medium of claim 19, the functions further comprising:

in response to receiving the indication of the virtual region and the trigger condition, determining at least one sensor interpretation rule for detecting the event in the physical region that satisfies the trigger condition, wherein determining the at least one sensor interpretation rule comprises determining the at least one sensor interpretation rule based at least in part on characteristics of one or more of the plurality of sensors positioned in the physical space, and wherein detecting the event comprises detecting the event based at least in part on the at least one sensor interpretation rule.

21. The non-transitory computer readable medium of claim 20,

wherein determining the at least one sensor interpretation rule comprises (a) selecting at least (i) a first sensor configured to generate first sensor data and (ii) a second sensor configured to generate second sensor data and (b) making a decision to use at least the first and second sensor data for detecting the event, and

wherein detecting the event based at least in part on the at least one sensor interpretation rule comprises detecting the particular physical change in the physical region based on evaluation of at least the first and second sensor data.

22. The non-transitory computer readable medium of claim 20, wherein determining at least one sensor interpretation rule comprises determining the portion of the sensor data that is associated with the physical region within the physical space, and wherein detecting the event based at least in part on the at least one sensor interpretation rule comprises detecting the particular physical change in the physical region based on evaluation of the portion of the sensor data.