Triggering Actions Based on Shared Video Footage from Audio/Video Recording and Communication Devices

• US 20170251182A1
• Filed: 04/05/2017
• Published: 08/31/2017
• Est. Priority Date: 02/26/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Bot Home Automation Inc. (Amazon.com, Inc.)
• Inventors: Siminoff, James, Troughton, Mark, Zavala, Jeff
• Granted Patent: US 10,979,636 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19636 pertaining to the camera
• CPC Class Codes: G08B 13/19645 : Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/19656 : Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19671 : Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19682 : Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19684 : Portable terminal, e.g. mobile phone, used for viewing video remotely
• CPC Class Codes: G08B 13/19695 : Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 15/001 : Concealed systems, e.g. disguised alarm systems to make covert systems
• CPC Class Codes: G08B 15/004 : using portable personal devices hand-held or body-worn self-defence devices using repellent gases or chemicals F41H9/10
• CPC Class Codes: G08B 25/08 : using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: G08B 27/001 : Signalling to an emergency team, e.g. firemen
• CPC Class Codes: G08B 27/003 : Signalling to neighbouring houses
• CPC Class Codes: G08B 27/005 : with transmission via computer network
• CPC Class Codes: G08B 3/10 : using electric transmission; using electromagnetic transmission
• CPC Class Codes: G10L 17/00 : Speaker identification or verification techniques
• CPC Class Codes: G10L 25/57 : for processing of video signals
• CPC Class Codes: H04L 65/1069 : Session establishment or de-establishment
• CPC Class Codes: H04L 65/611 : for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 : for unicast
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/65 : Control of camera operation in relation to power supply
• CPC Class Codes: H04N 23/651 : for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/91 : Television signal processing therefor
• CPC Class Codes: H04N 7/147 : Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/186 : Video door telephones
• CPC Class Codes: H04W 4/021 : Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/08 : User group management

Abstract

Systems and methods for communicating in a network using share signals in accordance with various embodiments of the present disclosure are provided. In one embodiment, a method for communicating in a network may include receiving, from a first client device, a share signal including first image data captured by a camera of a first audio/video (A/V) recording and communication device and a command to share the first image data with a network of users; processing the share signal by comparing the first image data to second image data captured by a camera of a second A/V recording and communication device; and generating and transmitting an alert to a second client device associated with the second A/V recording and communication device when comparison of the first image data with the second image data indicates a person of interest is depicted in both the first image data and the second image data.

Claims

1. A method for communicating in a network, the method comprising:

receiving, from a first client device, a share signal that includes a first description of a perpetrator and a command to share the share signal with a network of users;

processing the share signal, wherein the processing of the share signal includes determining whether a match is found between the first description of the perpetrator in the share signal and a second description of a perpetrator received from at least one second device in network communication with a backend device; and

determining and executing at least one further action when the match is found between the first description of the perpetrator in the share signal and the second description of the perpetrator.

2. The method of claim 1, wherein the share signal is received at the backend device in network communication with the first client device.

3. The method of claim 2, wherein the share signal is processed by a processing module of the backend device.

4. The method of claim 3, wherein the second description of the perpetrator is stored in a database in network communication with the backend device.

5. The method of claim 1, wherein the share signal includes first audio data that provides the first description of the perpetrator.

6. The method of claim 5, wherein the first audio data is captured by a microphone of a first audio/video (A/V) recording and communication device associated with the first client device.

7. The method of claim 6, wherein the second description of the perpetrator includes second audio data captured by a microphone of the at least one second device in network communication with the backend device.

8. The method of claim 7, wherein processing of the share signal further includes determining whether the match is found between the first description of the perpetrator in the share signal and the second description of the perpetrator by comparing the first audio data to the second audio data.

9. The method of claim 8, wherein the share signal is processed by a processing module of the backend device.

10. The method of claim 8, wherein the comparing of the first audio data with the second audio data is performed by comparing a spectrogram of the first audio data with a spectrogram of the second audio data.

11. The method of claim 1, wherein the share signal includes first text data that provides the first description of the perpetrator.

12. The method of claim 11, wherein the first text data is textual information provided by a first user associated with the first client device.

13. The method of claim 12, wherein the second description of the perpetrator includes second text data that is textual information generated by the backend device.

14. The method of claim 12, wherein the second description of the perpetrator includes second text data that is textual information provided by a second user associated with the at least one second device.

15. The method of claim 14, wherein the processing of the share signal further includes determining whether the match is found between the first description of the perpetrator in the share signal and the second description of the perpetrator by comparing the first text data to the second text data.

16. The method of claim 15, wherein the share signal is processed by a processing module of the backend device.

17. The method of claim 14, wherein the processing of the share signal further includes determining whether the match is found between the first description of the perpetrator in the share signal and the second description of the perpetrator by performing natural language processing on the first text data to extract the first description of the perpetrator and comparing the extracted first description of the perpetrator to the second text data.

18. The method of claim 17, wherein the share signal is processed by a processing module of the backend device.

19. The method of claim 1, wherein the share signal includes first text data and first audio data, wherein the first text data and the first audio data provide the first description of the perpetrator.

20. The method of claim 19, wherein the first text data is textual information provided by a first user associated with the first client device and the first audio data is captured by a microphone of a first audio/video (A/V) recording and communication device associated with the first client device.

21. The method of claim 20, wherein the second description of the perpetrator includes second text data and second audio data.

22. The method of claim 21, wherein the second text data is textual information provided by a second user associated with the at least one second device and the second audio data is captured by a microphone of the at least one second device in network communication with the backend device.

23. The method of claim 22, wherein the processing of the share signal further includes determining whether the match is found between the first description of the perpetrator in the share signal and the second description of the perpetrator by comparing the first text data to the second text data and the first audio data to the second audio data.

24. The method of claim 23, wherein the share signal is processed by a processing module of the backend device.

25. The method of claim 1, wherein the share signal includes first image data that provides the first description of the perpetrator.

26. The method of claim 25, wherein the first image data is captured by a camera of the first client device.

27. The method of claim 25, wherein the first image data is captured by a camera of an audio/video (A/V) recording and communication device associated with the first device.

28. The method of claim 25, wherein the second description of the perpetrator includes second image data.

29. The method of claim 28, wherein the second image data is captured by a camera of the at least one second device in network communication with the backend device.

30. The method of claim 29, wherein the processing of the share signal further includes determining whether the match is found between the first description of the perpetrator in the share signal and the second description of the perpetrator by comparing the first image data with the second image data.

31. The method of claim 30, wherein the comparing the first image data with the second image data is performed using computer vision.

32. The method of claim 30, wherein the comparing the first image data with the second image data is performed using facial recognition.

33. The method of claim 1, wherein the at least one further action includes notifying a first user associated with the first client device of the match between the first description of the perpetrator in the share signal and the second description of the perpetrator.

34. The method of claim 33, wherein the at least one further action includes notifying the first user associated with the first client device of an approximate location where the second description of the perpetrator was captured.

35. The method of claim 1, wherein the at least one further action includes notifying a second user associated with the at least one second device of the match between the first description of the perpetrator in the share signal and the second description of the perpetrator.

36. The method of claim 35, wherein the at least one further action includes notifying the second user associated with the at least one second device of an approximate location where the first description of the perpetrator was captured.

37. The method of claim 1, wherein the at least one further action includes notifying a law enforcement agency by forwarding the first description of the perpetrator in the share signal and the second description of the perpetrator.

38. The method of claim 37, wherein the notification to the law enforcement agency includes approximate locations where the first description of the perpetrator in the share signal and the second description of the perpetrator, respectively, were captured.

39. The method of claim 1, wherein the at least one further action includes transmitting at least one alert to at least one additional A/V recording and communication device located within a pre-determined radius of a location where the first description of the perpetrator was captured.

40. The method of claim 39, wherein the at least one alert includes sounds or messages that may be broadcast from at least one speaker of the at least one additional A/V recording and communication device.

41. The method of claim 1, wherein the further action includes identifying at least one additional A/V recording and communication device in proximity to the location where the first description of the perpetrator was captured and triggering the at least one identified A/V recording and communication device to record additional image data and/or audio data.

42. The method of claim 1, wherein the share signal includes image data and/or audio data that is received from the first client device in real-time or near real-time.