CONTEXT PROCESSOR FOR VIDEO ANALYSIS SYSTEM
First Claim
1. A method for mapping a scene depicted in a sequence of video frames, the method comprising:
- generating, from the sequence of video frames, a background image representing static elements in the scene;
receiving a current video frame;
identifying a plurality of regions of the current frame depicting the background image;
analyzing the plurality of regions of the current frame to identify at least a first region that occludes at least a portion of a second region; and
updating an annotated map of the scene to indicate that the first region is in front of the second region, relative to a position of a camera capturing the sequence of video frames.
6 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the present invention provide a method and a system for mapping a scene depicted in an acquired stream of video frames that may be used by a machine-learning behavior-recognition system. A background image of the scene is segmented into plurality of regions representing various objects of the background image. Statistically similar regions may be merged and associated. The regions are analyzed to determine their z-depth order in relation to a video capturing device providing the stream of the video frames and other regions, using occlusions between the regions and data about foreground objects in the scene. An annotated map describing the identified regions and their properties is created and updated.
111 Citations
24 Claims
-
1. A method for mapping a scene depicted in a sequence of video frames, the method comprising:
-
generating, from the sequence of video frames, a background image representing static elements in the scene; receiving a current video frame; identifying a plurality of regions of the current frame depicting the background image; analyzing the plurality of regions of the current frame to identify at least a first region that occludes at least a portion of a second region; and updating an annotated map of the scene to indicate that the first region is in front of the second region, relative to a position of a camera capturing the sequence of video frames. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-readable storage medium containing a program, which, when executed on a processor is configured to perform an operation for mapping a scene depicted in a sequence of video frames, the operation comprising:
-
generating, from the sequence of video frames, a background image representing static elements in the scene; receiving a current video frame; identifying a plurality of regions of the current frame depicting the background image; analyzing the plurality of regions of the current frame to identify at least a first region that occludes at least a portion of a second region; and updating an annotated map of the scene to indicate that the first region is in front of the second region, relative to a position of a camera capturing the sequence of video frames. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A system comprising,
a processor; - and
a memory containing a context processor application, which when executed by the processor is configured to; generate, from the sequence of video frames, a background image representing static elements in the scene, receive a current video frame, identify a plurality of regions of the current frame depicting the background image, analyze the plurality of regions of the current frame to identify at least a first region that occludes at least a portion of a second region, and update an annotated map of the scene to indicate that the first region is in front of the second region, relative to a position of a camera capturing the sequence of video frames. - View Dependent Claims (19, 20, 21, 22, 23, 24)
- and
Specification