Method and device for processing motion events

• US 10,127,783 B2
• Filed: 06/10/2015
• Issued: 11/13/2018
• Est. Priority Date: 07/07/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Laska, Jason N., Nelson, Greg R., Duffy, Greg, Hill, Cameron, Davidsson, Martin
• Primary Examiner(s): Thirugnanam, Gandhi
• Application Number:
  US14/736,162
• Publication Number:
  US 20160005280A1
• Time in Patent Office: 1,252 Days
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/1961 Movement detection not involving frame subtraction, e.g. motion detection on the basis of luminance changes in the image
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19652 Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system

Abstract

The disclosed embodiments include an electronic device with a display, processor(s), and memory. The electronic device displays a user interface on the display, the user interface including video information corresponding to a camera, the video information including a field of view of the camera. The electronic device receives user identification of a spatial zone within the user interface, the spatial zone corresponding to at least a portion of the field of view of the camera; and forgoes user notification of subsequent motion events involving the spatial zone.

Claims

1. A method comprising:

at a client device comprising memory, one or more processors, and a display;

activating a smart home application linked to a particular user account;

displaying within the application a user interface including an image representing a field of view of a remote camera linked to the particular user account;

receiving a first user identification within the user interface of a first spatial zone corresponding to a first portion of the field of view of the remote camera;

sending to a remote server system information identifying the first spatial zone, wherein the remote server system is configured to manage a plurality of distinct user accounts, including the particular user account;

displaying a first user-customizable outline for the first spatial zone overlaid on the visual image, wherein the first user-customizable outline is displayed in a first color;

receiving a second user identification within the user interface of a second spatial zone corresponding to a second portion of the field of view of the remote camera, different than the first portion of the field of view of the remote camera;

sending to the remote server system information identifying the second spatial zone;

displaying a second user-customizable outline for the second spatial zone overlaid on the visual image, wherein the second user-customizable outline is displayed in a second color distinct from the first color;

receiving a user adjustment to the first user-customizable outline, the user adjustment including user manipulation of a displayed feature of the first user-customizable outline such that, after the adjustment, the first spatial zone corresponds to a third portion of the field of view of the remote camera distinct from the first portion of the field of view of the remote camera;

sending to the remote server system information identifying the adjusted first spatial zone;

receiving from the remote server system information regarding motion detected in at least one of the first spatial and the second spatial zone from video captured at the remote camera; and

in response to receiving a user input, displaying a visual indicator indicating that the motion was detected in at least one of the first spatial zone and the second spatial zone based on the received information from the remote server system, the visual indicator having the same color as the user-customizable outline corresponding to the at least one spatial zone in which the motion was detected.

2. The method of claim 1, wherein receiving the first user identification of the first spatial zone within the user interface comprises:

receiving user selection of the first portion of the image; and

defining the first spatial zone in accordance with the user selection.

3. The method of claim 2, wherein the user selection of the first portion is received via one or more touch inputs on a touch-sensitive surface of the client device, the one or more touch inputs detected on a portion of the touch-sensitive surface corresponding to the image.

4. The method of claim 1, further comprising adding to the user interface user notification for a past motion event involving the first spatial zone.

5. The method of claim 1, wherein displaying the user interface includes displaying an event timeline, the event timeline including an indication of a past motion event involving the first spatial zone.

6. The method of claim 1, wherein displaying the user interface includes displaying a video feed of the remote camera.

7. The method of claim 1, further comprising receiving user input setting one or more zone monitoring triggers associated with the first spatial zone.

8. The method of claim 1, further comprising:

in accordance with a determination that a subsequent motion event does not involve the first spatial zone or the second spatial zone, forgoing user notification of the subsequent motion event; and

in accordance with a determination that the subsequent motion event involves either the first spatial zone or the second spatial zone, generating a user notification for the subsequent motion event.

9. The method of claim 8, wherein generating the user notification comprises including notification of the motion event on an event timeline within the user interface.

10. The method of claim 8, wherein generating the user notification comprises presenting a user alert at the client device.

11. The method of claim 10, wherein the user alert includes an audio alert.

12. The method of claim 1, further comprising, in accordance with a determination that at least part of a subsequent motion event occurs inside the first spatial zone, generating a user notification.

18. The method of claim 5, wherein the event timeline includes a plurality of event indicators, each event indicator representing a detected motion event, wherein a first subset of the plurality of event indicators correspond to motion events involving the first spatial zone and a second subset of the plurality of event indicators correspond to motion events involving the second spatial zone;

and

wherein at least one display characteristic of the first subset differs from display characteristics of the second subset.

19. The method of claim 5, wherein the event timeline includes a plurality of event indicators, each event indicator representing a detected motion event;

and

the method further comprises;

receiving a user selection of a first event indicator representing a first motion event; and

in response to receiving the user selection of the first event indicator, displaying a recorded video feed of the first motion event.

20. The method of claim 1, further comprising displaying a listing of motion events captured by the remote camera, the listing of motion events including one or more motion events involving the first spatial zone;

wherein the one or more motion events are displayed with at least one display characteristic indicating that the one or more motion events involve the first spatial zone.

13. An electronic device, comprising:

a display;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for;

activating a smart home application linked to a particular user account;

displaying within the application a user interface including an image representing a field of view of a remote camera linked to the particular user account;

receiving a first user identification within the user interface of a first spatial zone corresponding to a first portion of the field of view of the remote camera;

sending to a remote server system information identifying the first spatial zone, wherein the remote server system is configured to manage a plurality of distinct user accounts, including the particular user account;

displaying a first user-customizable outline for the first spatial zone overlaid on the visual image, wherein the first user-customizable outline is displayed in a first color;

receiving a second user identification within the user interface of a second spatial zone corresponding to a second portion of the field of view of the remote camera, different than the first portion of the field of view of the remote camera;

sending to the remote server system information identifying the second spatial zone;

displaying a second user-customizable outline for the second spatial zone overlaid on the visual image, wherein the second user-customizable outline is displayed in a second color distinct from the first color;

receiving a user adjustment to the first user-customizable outline, the user adjustment including user manipulation of a displayed feature of the first user-customizable outline such that, after the adjustment, the first spatial zone corresponds to a third portion of the field of view of the remote camera distinct from the first portion of the field of view of the remote camera;

sending to the remote server system information identifying the adjusted first spatial zone;

receiving from the remote server system information regarding motion detected in at least one of the first spatial and the second spatial zone from video captured at the remote camera; and

in response to receiving a user input, displaying a visual indicator indicating that the motion was detected in at least one of the first spatial zone and the second spatial zone based on the received information from the remote server system, the visual indicator having the same color as the user-customizable outline corresponding to the at least one spatial zone in which the motion was detected.

14. The device of claim 13, wherein receiving the first user identification of the first spatial zone within the user interface comprises:

receiving user selection of the first portion of the image; and

defining the first spatial zone in accordance with the user selection.

15. The device of claim 13, wherein the one or more programs further comprise instructions for, in accordance with a determination that at least part of a subsequent motion event occurs inside the first spatial zone, generating a user notification.

16. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display and one or more processors, cause the electronic device to perform operations comprising:

activating a smart home application linked to a particular user account;

displaying within the application a user interface including an image representing a field of view of a remote camera linked to the particular user account;

receiving a first user identification within the user interface of a first spatial zone corresponding to a first portion of the field of view of the remote camera;

sending to a remote server system information identifying the first spatial zone, wherein the remote server system is configured to manage a plurality of distinct user accounts, including the particular user account;

displaying a first user-customizable outline for the first spatial zone overlaid on the visual image, wherein the first user-customizable outline is displayed in a first color;

receiving a second user identification within the user interface of a second spatial zone corresponding to a second portion of the field of view of the remote camera, different than the first portion of the field of view of the remote camera;

sending to the remote server system information identifying the second spatial zone;

displaying a second user-customizable outline for the second spatial zone overlaid on the visual image, wherein the second user-customizable outline is displayed in a second color distinct from the first color;

receiving a user adjustment to the first user-customizable outline, the user adjustment including user manipulation of a displayed feature of the first user-customizable outline such that, after the adjustment, the first spatial zone corresponds to a third portion of the field of view of the remote camera distinct from the first portion of the field of view of the remote camera;

sending to the remote server system information identifying the adjusted first spatial zone;

receiving from the remote server system information regarding motion detected in at least one of the first spatial and the second spatial zone from video captured at the remote camera; and

in response to receiving a user input, displaying a visual indicator indicating that the motion was detected in at least one of the first spatial zone and the second spatial zone based on the received information from the remote server system, the visual indicator having the same color as the user-customizable outline corresponding to the at least one spatial zone in which the motion was detected.

17. The non-transitory computer-readable storage medium of claim 16, wherein receiving the first user identification of the first spatial zone within the user interface comprises:

receiving user selection of the first portion of the image; and

defining the first spatial zone in accordance with the user selection.

21. The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further comprise instructions for:

receiving a first custom name for the first spatial zone;

receiving a second custom name for the second spatial zone; and

in response to detection of motion in at least one of the first and second spatial zones, providing to the user the custom name of the at least one spatial zone in which the motion was detected.

22. The non-transitory computer-readable storage medium of claim 16, wherein the user input comprises a user selection of a notification indicator.

23. The non-transitory computer-readable storage medium of claim 16, wherein the remote server system is configured to relay camera information between the remote camera and client devices linked to the particular user account, including the electronic device.

24. The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further comprise instructions for displaying within the application a second image representing a second field of view of a second remote camera linked to the particular user account.

25. The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further comprise instructions for, in response to the sending to the remote server system the information identifying the adjusted first spatial zone, receiving from the remote server system information regarding whether one or more past motion events involved the adjusted first spatial zone.