Methods and systems for presenting alert event indicators

• US 10,296,194 B2
• Filed: 06/27/2016
• Issued: 05/21/2019
• Est. Priority Date: 06/14/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: McLean, Melissa, Mizono, Michael, Von Dehsen, Lauren, Venters, Joe Delone, Kuwatani, Tracy, Kennedy, Zachery Webster
• Primary Examiner(s): Vo, Tung T
• Application Number:
  US15/194,528
• Publication Number:
  US 20160364129A1
• Time in Patent Office: 1,058 Days
• Field of Search: 348169
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 : Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/196 : using television cameras
• CPC Class Codes: G08B 13/19645 : Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19656 : Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/1966 : Wireless systems, other than telephone systems, used to communicate with a camera
• CPC Class Codes: G08B 13/19682 : Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19695 : Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G11B 27/105 : of operating discs
• CPC Class Codes: G11B 27/28 : by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 : Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/2628 : Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 : Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A method at an electronic device includes: displaying a camera history timeline, including: displaying a chronologically ordered sequence of event identifiers, each event identifier corresponding to a respective camera event, each respective camera event associated with one or more respective alert events; and displaying, for a respective event identifier, one or more alert event indicators, each of the alert event indicators corresponding to an alert event associated with the camera event corresponding to the respective event identifier, each of the alert event indicators displayed with a visually distinctive display characteristic associated with a corresponding alert event.

Claims

1. A method, comprising:

at a client device having a display screen, one or more processors, and memory storing one or more programs for execution by the one or more processors;

obtaining alert events from one or more smart devices at a physical location, the one or more smart devices including a camera located at or in proximity to the physical location, wherein each obtained alert event is associated with at least one of a plurality of predefined activity alert types that include motion, sound, smoke and hazard alert types;

displaying in a scrollable list a chronological sequence of camera event items in a first view, each of the camera event items being associated in time with a corresponding one of the obtained alert events, the chronological sequence of camera event items including

a first camera event item associated with a first alert event, the first camera event item including;

a thumbnail image captured by the camera corresponding to the first alert event;

a time of the first alert event; and

one or more activity alert indicators, each of the activity alert indicators corresponding to one of the activity alert types associated with the first alert event;

receiving a user selection of the first camera event item; and

responsive to the user selection;

expanding inline within the scrollable list the first camera event item into a video player interface; and

enabling playback in the video player interface a video of the first alert event to which the thumbnail image corresponds;

wherein the video player interface consumes a portion of the scrollable list and occupies more vertical space on the display screen than the first view, and the expanding inline includes displaying a second camera event item in the first view above the video player interface and displaying a third camera event item in the first view below the video player interface.

2. The method of claim 1, wherein the activity alert types include one or more of the group consisting of:

a hazard alert event, an audio alert event, a vibration alert event, a motion alert event in a zone of interest in a field of view of the camera, and a motion event outside of a zone of interest in the field of view of the camera.

3. The method of claim 2, wherein the zone of interest comprises a defined spatial zone in the field of view.

4. The method of claim 3, wherein the spatial zone is defined by a user.

5. The method of claim 1, wherein each of the activity alert indicators has a visually distinctive display characteristic based on color.

6. The method of claim 1, wherein each of the activity alert indicators has a visually distinctive display characteristic based on shape.

21. The method of claim 1, wherein each of the camera event items has a displayed width that occupies a majority of a width of a display of the client device.

7. An electronic device, comprising:

a display screen;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for;

obtaining alert events from one or more smart devices at a physical location, the one or more smart devices including a camera located at or in proximity to the physical location, wherein each obtained alert event is associated with at least one of a plurality of predefined activity alert types that include motion, sound, smoke and hazard alert types;

displaying in a scrollable list a chronological sequence of camera event items in a first view, each of the camera event items being associated in time with a corresponding one of the obtained alert events, the chronological sequence of camera event items including

a first camera event item associated with a first alert event, the first camera event item including;

a thumbnail image captured by the camera corresponding to the first alert event;

a time of the first alert event; and

one or more activity alert indicators, each of the activity alert indicators corresponding to one of the activity alert types associated with the first alert event;

receiving a user selection of the first camera event item; and

responsive to the user selection;

expanding inline within the scrollable list the first camera event item into a video player interface; and

enabling playback in the video player interface a video of the first alert event to which the thumbnail image corresponds;

wherein the video player interface consumes a portion of the scrollable list and occupies more vertical space on the display screen than the first view, and the expanding inline includes displaying a second camera event item in the first view above the video player interface and displaying a third camera event item in the first view below the video player interface.

8. The device of claim 7, wherein the display screen is a touch screen display, and the one or more programs further comprise instructions for:

detecting an upward swipe gesture on the touch screen display;

in response to the swipe gesture;

causing the first camera event item in the scrollable list to be moved upward and out of view on the display; and

causing a second camera event item in the chronological sequence that is initially not in the view to be scrolled into view on the display.

9. The device of claim 8, further comprising instructions for:

for each of the camera event items in the scrollable list, displaying within the camera event item;

the thumbnail image of a video associated with the camera event item; and

the activity alert indicators;

wherein the video is configured to be displayed in response to selection of the camera event item in the scrollable list.

10. The device of claim 7, further comprising instructions for:

displaying a video monitoring user interface, the video monitoring user interface including a first region for displaying a live video and/or a record video from the camera and a second region for displaying an event timeline, the event timeline including a plurality of equally spaced time indicators each indicating a specific time and a current video indicator indicating a temporal position of the video displayed in the first region, the temporal position including a past time corresponding to the recorded video from the camera and a current time corresponding to the live video from the camera, wherein the current video indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video displayed in the first region;

wherein displaying the sequence of camera event items comprises displaying the sequence of camera event items as user interface elements on the timeline.

11. The device of claim 10, wherein:

displaying, within the camera event item in the sequence, one or more activity alert indicators comprises;

displaying the activity alert indicators within the user interface element corresponding to the camera event item.

12. The device of claim 10, wherein:

displaying, within the camera event item in the sequence, one or more activity alert indicators comprises;

displaying the activity alert indicators in proximity to the user interface element corresponding to the camera event item.

13. The device of claim 7, wherein each camera event item corresponds to a video captured by the camera, and alert events associated with a camera event item at least overlaps in time with the video captured by the camera.

14. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display screen, one or more processors, and memory storing the one or more programs cause the electronic device to perform operations comprising:

obtaining alert events from one or more smart devices at a physical location, the one or more smart devices including a camera located at or in proximity to the physical location, wherein each obtained alert event is associated with at least one of a plurality of predefined activity alert types that include motion, sound, smoke and hazard alert types;

displaying in a scrollable list a chronological sequence of camera event items in a first view, each of the camera event items being associated in time with a corresponding one of the obtained alert events, the chronological sequence of camera event items including

a first camera event item associated with a first alert event, the first camera event item including;

a thumbnail image captured by the camera corresponding to the first alert event;

a time of the first alert event; and

one or more activity alert indicators, each of the activity alert indicators corresponding to one of the activity alert types associated with the first alert event;

receiving a user selection of the first camera event item; and

responsive to the user selection;

expanding inline within the scrollable list the first camera event item into a video player interface; and

enabling playback in the video player interface a video of the first alert event to which the thumbnail image corresponds;

wherein the video player interface consumes a portion of the scrollable list and occupies more vertical space on the display screen than the first view, and the expanding inline includes displaying a second camera event item in the first view above the video player interface and displaying a third camera event item in the first view below the video player interface.

15. The non-transitory computer readable storage medium of claim 14, wherein the thumbnail image is the thumbnail image of video captured by the camera.

16. The non-transitory computer readable storage medium of claim 14, further comprising instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

for each of the camera event items in the scrollable list, displaying within the camera event item;

the thumbnail image of a video associated with the camera event item; and

the activity alert indicators;

wherein the video is configured to be displayed in response to selection of the camera event item in the scrollable list.

17. The non-transitory computer readable storage medium of claim 14, further comprising instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

displaying a video monitoring user interface, the video monitoring user interface including a first region for displaying a live video and/or a record video from the camera and a second region for displaying an event timeline, the event timeline including a plurality of equally spaced time indicators each indicating a specific time and a current video indicator indicating a temporal position of the video displayed in the first region, the temporal position including a past time corresponding to the recorded video from the camera and a current time corresponding to the live video from the camera, wherein the current video indicator is movable relative to the equally spaced time indicators to facilitate a change in the temporal position of the video displayed in the first region;

wherein displaying the sequence of camera event items comprises displaying the sequence of camera event items as user interface elements on the timeline.

18. The non-transitory computer readable storage medium of claim 17, wherein:

displaying, within the camera event item in the sequence, one or more activity alert indicators comprises;

displaying the activity alert indicators within the user interface element corresponding to the camera event item.

19. The non-transitory computer readable storage medium of claim 17, wherein:

displaying, within the camera event item in the sequence, one or more activity alert indicators comprises;

displaying the activity alert indicators in proximity to the user interface element corresponding to the camera event item.

20. The non-transitory computer readable storage medium of claim 14, wherein each camera event item corresponds to a video captured by the camera, and alert events associated with a camera event item at least overlaps in time with the video captured by the camera.