Self-learning spatial recognition system

• US 10,157,476 B1
• Filed: 05/17/2018
• Issued: 12/18/2018
• Est. Priority Date: 06/15/2017
• Status: Expired due to Fees

• Current Assignee: Satori Worldwide, LLC (AppLovin Corporation)
• Original Assignee: Satori Worldwide, LLC (AppLovin Corporation)
• Inventors: Idrisov, Renat
• Primary Examiner(s): Nakhjavan, Shervin
• Application Number:
  US15/982,877
• Publication Number:
  US 20180365851A1
• Time in Patent Office: 215 Days
• Field of Search: None
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: H04L 51/222 using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
• CPC Class Codes: H04L 67/1061 using node-based peer discovery mechanisms static access to replicated servers H04L67/1006; service discovery H04L67/51
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

A method includes receiving a plurality of video frames from a video source, wherein each video frame of the plurality of video frames comprises a view of a geolocation. The method further includes detecting a first object entering a first side of a first video frame of the plurality of video frames. The method further includes determining, from the plurality of video frames, that the first object has stopped in an area of the geolocation for at least a threshold amount of time. The method further includes detecting the first object leaving a second side of a second video frame of the plurality of video frames. The method further includes identifying, by a computer processing device, the area of the geolocation as a region of interest based on the detecting the first object leaving.

Claims

1. A method, comprising:

receiving a plurality of video frames from a video source, wherein each video frame of the plurality of video frames comprises a view of a geolocation;

detecting a first object entering a first side of a first video frame of the plurality of video frames;

determining, from the plurality of video frames, that the first object has stopped in an area of the geolocation for at least a threshold amount of time;

detecting the first object leaving a second side of a second video frame of the plurality of video frames; and

identifying, by a computer processing device, the area of the geolocation as a region of interest based on the detecting the first object leaving.

2. The method of claim 1, wherein the plurality of video frames from the video source is a plurality of live video frames from a live video source.

3. The method of claim 1, further comprising determining that a size of the first object changes less than a defined threshold between the first video frame and the second video frame.

4. The method of claim 1, further comprising generating, based on the region of interest, a map comprising the geolocation.

5. The method of claim 4, further comprising:

determining that a second object occupies the region of interest; and

marking the region of interest on the map as occupied.

6. The method of claim 4, further comprising:

determining that the region of interest has not been occupied for a defined threshold of time; and

removing the region of interest from the map.

7. The method of claim 1, wherein the region of interest corresponds to a parking spot.

8. The method of claim 7, wherein the first object corresponds to a vehicle.

9. The method of claim 1, wherein the region of interest corresponds to at least one of a chair, a bench, or a position in a queue, and wherein the geolocation corresponds to at least one of an arena, a stadium, a theater, a field, or a shopping center.

10. The method of claim 9, wherein the first object corresponds to at least one of a vehicle or a pedestrian.

11. A system, comprising a computer processing device programmed to perform operations to:

receive a plurality of video frames from a video source, wherein each video frame of the plurality of video frames comprises a view of a geolocation;

detect a first object entering a first side of a first video frame of the plurality of video frames;

determine, from the plurality of video frames, that the first object has stopped in an area of the geolocation for at least a threshold amount of time;

detect the first object leaving a second side of a second video frame of the plurality of video frames; and

identify the area of the geolocation as a region of interest based on the detecting the first object leaving.

12. The system of claim 11, wherein the plurality of video frames from the video source is a plurality of live video frames from a live video source.

13. The system of claim 11, the computer processing device further to determine that a size of the first object changes less than a defined threshold between the first video frame and the second video frame.

14. The system of claim 11, the computer processing device further to generate, based on the region of interest, a map comprising the geolocation.

15. The system of claim 14, the computer processing device further to:

determine that a second object occupies the region of interest; and

mark the region of interest on the map as occupied.

16. The system of claim 14, the computer processing device further to:

determine that the region of interest has not been occupied for a defined threshold of time; and

remove the region of interest from the map.

17. The system of claim 11, wherein the region of interest corresponds to a parking spot, and wherein the first object corresponds to a vehicle.

18. The system of claim 11, wherein the region of interest corresponds to at least one of a chair, a bench, or a position in a queue, and wherein the geolocation corresponds to at least one of an arena, a stadium, a theater, a field, or a shopping center, and wherein the first object corresponds to at least one of a vehicle or a pedestrian.

19. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a computer processing device, cause the computer processing device to:

receive a plurality of video frames from a video source, wherein each video frame of the plurality of video frames comprises a view of a geolocation;

detect a first object entering a first side of a first video frame of the plurality of video frames;

determine, from the plurality of video frames, that the first object has stopped in an area of the geolocation for at least a threshold amount of time;

detect the first object leaving a second side of a second video frame of the plurality of video frames; and

identify, by the computer processing device, the area of the geolocation as a region of interest based on the detecting the first object leaving.

20. The non-transitory computer-readable medium of claim 19, wherein the plurality of video frames from the video source is a plurality of live video frames from a live video source.