Triggering actions based on shared video footage from audio/video recording and communication devices

• US 10,979,636 B2
• Filed: 04/05/2017
• Issued: 04/13/2021
• Est. Priority Date: 02/26/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Siminoff, James, Troughton, Mark, Zavala, Jeff
• Primary Examiner(s): Grijalva Lobos, Boris D
• Application Number:
  US15/480,214
• Publication Number:
  US 20170251182A1
• Time in Patent Office: 1,469 Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19636 pertaining to the camera
• CPC Class Codes: G08B 13/19645 : Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19656 : Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19671 : Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19682 : Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19684 : Portable terminal, e.g. mobile phone, used for viewing video remotely
• CPC Class Codes: G08B 13/19695 : Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 15/001 : Concealed systems, e.g. disguised alarm systems to make covert systems
• CPC Class Codes: G08B 15/004 : using portable personal devices hand-held or body-worn self-defence devices using repellent gases or chemicals F41H9/10
• CPC Class Codes: G08B 25/08 : using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: G08B 27/001 : Signalling to an emergency team, e.g. firemen
• CPC Class Codes: G08B 27/003 : Signalling to neighbouring houses
• CPC Class Codes: G08B 27/005 : with transmission via computer network
• CPC Class Codes: G08B 3/10 : using electric transmission; using electromagnetic transmission
• CPC Class Codes: G10L 17/00 : Speaker identification or verification techniques
• CPC Class Codes: G10L 25/57 : for processing of video signals
• CPC Class Codes: H04L 65/1069 : Session establishment or de-establishment
• CPC Class Codes: H04L 65/611 : for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 : for unicast
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/65 : Control of camera operation in relation to power supply
• CPC Class Codes: H04N 23/651 : for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/91 : Television signal processing therefor
• CPC Class Codes: H04N 7/147 : Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/186 : Video door telephones
• CPC Class Codes: H04W 4/021 : Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/08 : User group management

Abstract

Systems and methods for communicating in a network using share signals in accordance with various embodiments of the present disclosure are provided. In one embodiment, a method for communicating in a network may include receiving, from a first client device, a share signal including first image data captured by a camera of a first audio/video (A/V) recording and communication device and a command to share the first image data with a network of users; processing the share signal by comparing the first image data to second image data captured by a camera of a second A/V recording and communication device; and generating and transmitting an alert to a second client device associated with the second A/V recording and communication device when comparison of the first image data with the second image data indicates a person of interest is depicted in both the first image data and the second image data.

Claims

1. A method comprising:

receiving first video data generated by a first audio/video recording and communication device (A/V device);

receiving, from a first user device associated with the first A/V device, first command data associated with sharing the first video data;

receiving, from the first user device, first text data representing a first description of a first person represented by the first video data;

receiving second video data generated by a second A/V device;

receiving, from a second user device associated with the second A/V device, second command data associated with sharing the second video data;

receiving, from the second user device, second text data representing a second description of a second person represented by the second video data;

based at least in part on receiving the second command data, determining, using at least the first text data and the second text data, that the first person represented by the first video data and the second person represented by the second video data are a same person; and

sending a notification to the first user device, the notification associated with the same person.

2. The method of claim 1, further comprising:

receiving first audio data generated by the first A/V device; and

receiving second audio data generated by the second A/V device.

3. The method of claim 2, further comprising:

analyzing the first audio data with respect to the second audio data,

wherein determining that the first person represented by the first video data and the second person represented by the second video data are the same person is further based at least in part on analyzing the first audio data with respect to the second audio data.

4. The method of claim 3, wherein analyzing the first audio data with respect to the second audio data comprises comparing a first spectrogram of first audio represented by the first audio data with a second spectrogram of second audio represented by the second audio data.

5. The method of claim 1, wherein determining that the first person represented by the first video data and the second person represented by the second video data are the same person comprises:

performing natural language processing on the first text data to determine the first description;

performing natural language processing on the second text data to determine the second description; and

determining that the first description is similar to the second description.

6. The method of claim 1, further comprising:

determining that the first video data represents the first person;

determining that the second video data represents the second person; and

analyzing the first person represented by the first video data with respect to the second person represented by the second video data using computer vision,

wherein determining that the first person represented by the first video data are the second person represented by the second video data are the same person is further based at least in part on analyzing the first person represented by the first video data with respect to the second person represented by the second video data.

7. The method of claim 1, further comprising sending, to the second user device, an additional notification associated with the same person.

8. The method of claim 1, further comprising generating the notification, the notification indicating an approximate location associated with the second A/V device.

9. The method of claim 1, further comprising:

sending, to one or more devices associated with a law enforcement agency, the first video data; and

sending, to the one or more devices, the second video data.

10. The method of claim 9, further comprising sending, to the one or more devices, an additional notification that includes a first approximate location associated with the first A/V device and a second approximate location associated with the second A/V device.

11. The method of claim 1, further comprising:

determining that a third A/V device is located within a threshold distance to a location associated with the first A/V device; and

sending, to the third A/V device, a command to generate at least one of third video data or audio data.

12. The method of claim 1, further comprising:

determining that the first description is similar to the second description,

wherein determining that the first person represented by the first video data and the second person represented by the second video data are the same person is based at least the first description being similar to the second description.

13. The method of claim 1, further comprising:

storing the first text data in one or more databases; and

based at least in part on receiving the second text data, analyzing the first text data with respect to the second text data.

14. The method of claim 1, further comprising:

determining that the first A/V device is located within an area;

determining that the second A/V device is also located within the area; and

analyzing the first text data with respect to the second text data based at least in part on the second A/V device also being located within the area.

15. The method of claim 1, further comprising:

determining that the second A/V device is located within a distance to the first A/V device; and

analyzing the first text data with respect to the second text data based at least in part on the second A/V device being located within the distance to the first A/V device.

16. The method of claim 1, further comprising:

determining that a third A/V device is located within a distance to the first A/V device; and

sending, to a third user device associated with the third A/V device, an additional notification associated with the same person.

17. The method of claim 1, further comprising:

comparing the first description represented by the first text data to the second description represented by the second text data,

and wherein determining that the first person represented by the first video data and the second person represented by the second video data are the same person is based at least in part on comparing the first description to the second description.

18. The method of claim 1, further comprising:

sending the first video data to the first user device,

and wherein receiving the first text data from the first user device is based at least in part on sending the first video data.

19. The method of claim 1, further comprising:

sending the first video data to the first user device,

and wherein receiving the first command data from the first user device is based at least in part on sending the first video data.

20. One or more computing devices, comprising:

one or more processors; and

one or more computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more computing devices to perform operations comprising;

receiving first video data generated by a first electronic device;

receiving, from a first user device, first command data associated with sharing the first video data;

receiving, from the first user device, first text data associated with the first video data;

receiving second video data generated by a second electronic device;

receiving, from a second user device, second command data associated with sharing the second video data;

receiving, from the second user device, second text data associated with the second video data;

based at least in part on the second command data, analyzing the first text data with respect to the second text data;

determining, based at least in part on analyzing the first text data with respect to the second text data, that a first person represented by the first video data and a second person represented by the second video data are a same person; and

sending a notification to the first user device, the notification associated with the same person.

21. The one or more computing devices as recited in claim 20, the one or more computing readable media storing further instructions that, when executed by the one or more processors, cause the one or more computing devices to perform further operations comprising sending, to the second user device, an additional notification associated with the same person.

22. The one or more devices of claim 20, the one or more computing readable media storing further instructions that, when executed by the one or more processors, cause the one or more computing devices to perform further operations comprising:

determining that the first description is similar to the second description,

wherein determining that the first person represented by the first video data and the second person represented by the second video data are the same person is based at least the first description being similar to the second description.

23. The one or more devices of claim 20, the one or more computing readable media storing further instructions that, when executed by the one or more processors, cause the one or more computing devices to perform further operations comprising:

storing the first text data in one or more databases,

wherein analyzing the first text data with respect to the second text data is further based at least in part on receiving the second text data.

24. The one or more devices of claim 20, the one or more computing readable media storing further instructions that, when executed by the one or more processors, cause the one or more computing devices to perform further operations comprising:

determining that the first video data represents the first person;

determining that the second video data represents the second person; and

analyzing the first video data with respect to the second video data,

and wherein determining that the first person represented by the first video data and the second person represented by the second video data are the same person is further based at least in part on analyzing the first video data with respect to the second video data.

25. The one or more devices of claim 20, the one or more computing readable media storing further instructions that, when executed by the one or more processors, cause the one or more computing devices to perform further operations comprising wherein analyzing the first text data with respect to the second text data comprises comparing the first description represented by the first text data to the second description represented by the second text data.

26. The one or more devices of claim 20, the one or more computing readable media storing further instructions that, when executed by the one or more processors, cause the one or more computing devices to perform further operations comprising:

sending the first video data to the first user device,

and wherein receiving the first text data from the first user device is based at least in part on sending the first video data.