Context processor for video analysis system
First Claim
1. A method for mapping a scene depicted in a sequence of video frames, the method comprising:
- segmenting a background image representing static elements of the scene into one or more spatially ordered regions, wherein each spatially ordered region has a corresponding a set of pixels in the background image;
receiving a current video frame, of the sequence;
identifying one or more foreground objects depicted in the current video, wherein each foreground object occludes the pixels in one or more of the spatially ordered regions of the background image;
analyzing the one or more spatially ordered regions of the background image to identify at least a spatial ordering for one or more of the foreground objects, relative to the spatial ordering of the one or more spatially ordered regions of the background image; and
generating, based on the spatially ordered regions of the scene and the spatial ordering for the one or more foreground objects, an annotated map of the scene specifying scene geometry for one or more of the spatially ordered regions of the scene.
6 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the present invention provide a method and a system for mapping a scene depicted in an acquired stream of video frames that may be used by a machine-learning behavior-recognition system. A background image of the scene is segmented into plurality of regions representing various objects of the background image. Statistically similar regions may be merged and associated. The regions are analyzed to determine their z-depth order in relation to a video capturing device providing the stream of the video frames and other regions, using occlusions between the regions and data about foreground objects in the scene. An annotated map describing the identified regions and their properties is created and updated.
-
Citations
15 Claims
-
1. A method for mapping a scene depicted in a sequence of video frames, the method comprising:
-
segmenting a background image representing static elements of the scene into one or more spatially ordered regions, wherein each spatially ordered region has a corresponding a set of pixels in the background image; receiving a current video frame, of the sequence; identifying one or more foreground objects depicted in the current video, wherein each foreground object occludes the pixels in one or more of the spatially ordered regions of the background image; analyzing the one or more spatially ordered regions of the background image to identify at least a spatial ordering for one or more of the foreground objects, relative to the spatial ordering of the one or more spatially ordered regions of the background image; and generating, based on the spatially ordered regions of the scene and the spatial ordering for the one or more foreground objects, an annotated map of the scene specifying scene geometry for one or more of the spatially ordered regions of the scene. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer-readable storage medium containing a program, which, when executed on a processor is configured to perform an operation for mapping a scene depicted in a sequence of video frames, the operation comprising:
-
segmenting a background image representing static elements of the scene into one or more spatially ordered regions, wherein each spatially ordered region has a corresponding a set of pixels in the background image; receiving a current video frame, of the sequence; identifying one or more foreground objects depicted in the current video, wherein each foreground object occludes the pixels in one or more of the spatially ordered regions of the background image; analyzing the one or more spatially ordered regions of the background image to identify at least a spatial ordering for one or more of the foreground objects, relative to the spatial ordering of the one or more spatially ordered regions of the background image; and generating, based on the spatially ordered regions of the background image and the spatial ordering for the one or more foreground objects, an annotated map of the scene specifying scene geometry for one or more of the plurality of regions in the background image. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A system comprising,
a processor; - and
a memory containing a context processor application, which when executed by the processor is configured to perform an operation for mapping a scene depicted in a sequence of video frames, the operation comprising; segmenting a background image representing static elements of the scene into one or more spatially ordered regions, wherein each spatially ordered region has a corresponding a set of pixels in the background image, receiving a current video frame, of the sequence, identifying one or more foreground objects depicted in the current video, wherein each foreground object occludes the pixels in one or more of the spatially ordered regions of the background image, analyzing the one or more spatially ordered regions of the background image to identify at least a spatial ordering for one or more of the foreground objects, relative to the spatial ordering of the one or more spatially ordered regions of the background image, and generating, based on the spatially ordered regions of the background image and the spatial ordering for the one or more foreground objects, an annotated map of the scene specifying scene geometry for one or more of the plurality of regions in the background image. - View Dependent Claims (12, 13, 14, 15)
- and
Specification