Structure and method for dynamic scene analysis
First Claim
1. Circuit architecture for dynamic scene analysis, comprising:
- difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene,connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture,edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, anda plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels;
wherein each of said motion detection processors has a feature extractor stage which determines the motion parameters of the region;
wherein said feature extractor has means for comparing each pixel in the region with the predetermined set of neighborhood pixels to determine the adjacency of the pixel to the neighborhood pixels;
wherein said feature extractor has means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points depending on the adjacency of the pixel to the neighborhood pixels;
wherein said means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points includes counter means and flip-flop means;
wherein said plurality of motion detectors are arranged in a systolic array; and
wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises;
(a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel;
(b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with;
(i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and(ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; and
(c) feature extraction logic in circuit communication with said plurality of adjacency logic units.
1 Assignment
0 Petitions
Accused Products
Abstract
Circuit architecture for dynamic scene analysis uses a difference picture based technique wherein pixel values corresponding to the same position from previous and current frames are inputted to the system during each clock cycle. The difference picture is input to a connected component labeling algorithm in order to obtain the various connected components in the difference picture. A Sobel edge detector is applied to previous and current frame pixel values, and the resulting data stored in a buffer so that for each pixel, the connected component label of the difference picture, the Sobel edge value in the current frame, and the Sobel edge value in the previous frame are stored. The buffer supplies the data to a series of motion detection processors which are arranged in a systolic array. An alternative arrangement is to arrange the motion detection processors in parallel in a pipeline fashion with no feedback logic. In any case, each processor analyzes a different region of the difference picture in order to detect and classify the type of motion occurring in that region. The difference picture generator, Sobel operators, connected components hardware and buffer, and motion detection processors can be implemented into a CMOS VLSI chip to obtain high speed and real time response.
-
Citations
38 Claims
-
1. Circuit architecture for dynamic scene analysis, comprising:
-
difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels; wherein each of said motion detection processors has a feature extractor stage which determines the motion parameters of the region; wherein said feature extractor has means for comparing each pixel in the region with the predetermined set of neighborhood pixels to determine the adjacency of the pixel to the neighborhood pixels; wherein said feature extractor has means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points depending on the adjacency of the pixel to the neighborhood pixels; wherein said means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points includes counter means and flip-flop means; wherein said plurality of motion detectors are arranged in a systolic array; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; and (c) feature extraction logic in circuit communication with said plurality of adjacency logic units. - View Dependent Claims (10, 11, 12, 13, 17, 22, 25, 30, 32, 34, 36, 38)
-
-
2. Circuit architecture for dynamic scene analysis, comprising:
-
difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels; wherein each of said motion detection processors has a feature extractor stage which determines the motion parameters of the region; wherein said feature extractor has means for comparing each pixel in the region with the predetermined set of neighborhood pixels to determine the adjacency of the pixel to the neighborhood pixels; wherein said feature extractor has means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points depending on the adjacency of the pixel to the neighborhood pixels; wherein said means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points includes counter means and flip-flop means; wherein said plurality of motion detectors are arranged in a systolic array; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; (c) feature extraction logic in circuit communication with said plurality of adjacency logic units; (d) a first bistable circuit in circuit communication with said feature extraction logic, said first bistable circuit storing a value corresponding to the closedness of the current frame edge fragment; (e) a second bistable circuit in circuit communication with said feature extraction logic, said second bistable circuit storing a value corresponding to the closedness of the previous frame edge fragment; (f) a first counter in circuit communication with said feature extraction logic, said first counter storing a value corresponding to the number of current frame edge fragments; (g) a second counter in circuit communication with said feature extraction logic, said second counter storing a value corresponding to the number of previous frame edge fragments; (h) a third counter in circuit communication with said feature extraction logic, said third counter storing a value corresponding to the number of current frame edge pixels; (i) a fourth counter in circuit communication with said feature extraction logic, said fourth counter storing a value corresponding to the number of previous frame edge pixels; (j) a region classifier in circuit communication with said first and second bistable circuits and said first, second, third, and fourth counters, said region classifier classifying the motion in the region as being at least one of a predetermined set of classifications. - View Dependent Claims (31, 35)
-
-
3. Circuit architecture for dynamic scene analysis, comprising:
-
difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels; wherein said plurality of motion detection processors are arranged in a systolic array; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; and (c) feature extraction logic in circuit communication with said plurality of adjacency logic units.
-
-
4. Circuit architecture for dynamic scene analysis, comprising:
-
difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels; wherein said plurality of motion detection processors are arranged in a systolic array; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; (c) feature extraction logic in circuit communication with said plurality of adjacency logic units; (d) a first bistable circuit in circuit communication with said feature extraction logic, said first bistable circuit storing a value corresponding to the closedness of the current frame edge fragment; (e) a second bistable circuit in circuit communication with said feature extraction logic, said second bistable circuit storing a value corresponding to the closedness of the previous frame edge fragment; (f) a first counter in circuit communication with said feature extraction logic, said first counter storing a value corresponding to the number of current frame edge fragments; (g) a second counter in circuit communication with said feature extraction logic, said second counter storing a value corresponding to the number of previous frame edge fragments; (h) a third counter in circuit communication with said feature extraction logic, said third counter storing a value corresponding to the number of current frame edge pixels; (i) a fourth counter in circuit communication with said feature extraction logic, said fourth counter storing a value corresponding to the number of previous frame edge pixels; (j) a region classifier in circuit communication with said first and second bistable circuits and said first, second, third, and fourth counters, said region classifier classifying the motion in the region as being at least one of a predetermined set of classifications.
-
-
5. Architecture for dynamic scene analysis, comprising:
-
difference picture generator means which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected component hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector means which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having means which takes as input a connected component label of the difference picture in one of said separate regions, the edge value in the current frame, and the edge value in the previous frame, means for determining the motion relationship between each pixel and a predetermined set of neighborhood pixels, and means for providing as output a value representing the type of motion occurring in that region depending upon the motion relationship between the pixel and the neighborhood pixels; wherein each of said motion detection processors includes a feature extractor stage having means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points; wherein said plurality of motion detection processors are arranged in a systolic array; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; and (c) feature extraction logic in circuit communication with said plurality of adjacency logic units.
-
-
6. Architecture for dynamic scene analysis, comprising:
-
difference picture generator means which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected component hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector means which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having means which takes as input a connected component label of the difference picture in one of said separate regions, the edge value in the current frame, and the edge value in the previous frame, means for determining the motion relationship between each pixel and a predetermined set of neighborhood pixels, and means for providing as output a value representing the type of motion occurring in that region depending upon the motion relationship between the pixel and the neighborhood pixels; wherein each of said motion detection processors includes a feature extractor stage having means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points; wherein said plurality of motion detection processors are arranged in a systolic array; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; (c) feature extraction logic in circuit communication with said plurality of adjacency logic units; (d) a first bistable circuit in circuit communication with said feature extraction logic, said first bistable circuit storing a value corresponding to the closedness of the current frame edge fragment; (e) a second bistable circuit in circuit communication with said feature extraction logic, said second bistable circuit storing a value corresponding to the closedness of the previous frame edge fragment; (f) a first counter in circuit communication with said feature extraction logic, said first counter storing a value corresponding to the number of current frame edge fragments; (g) a second counter in circuit communication with said feature extraction logic, said second counter storing a value corresponding to the number of previous frame edge fragments; (h) a third counter in circuit communication with said feature extraction logic, said third counter storing a value corresponding to the number of current frame edge pixels; (i) a fourth counter in circuit communication with said feature extraction logic, said fourth counter storing a value corresponding to the number of previous frame edge pixels; (j) a region classifier in circuit communication with said first and second bistable circuits and said first, second, third, and fourth counters, said region classifier classifying the motion in the region as being at least one of a predetermined set of classifications.
-
-
7. Circuit architecture for dynamic scene analysis, comprising:
-
difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels; wherein each of said motion detection processors has a feature extractor stage which determines the motion parameters of the region; wherein said feature extractor has means for comparing each pixel in the region with the predetermined set of neighborhood pixels to determine the adjacency of the pixel to the neighborhood pixels; wherein said feature extractor has means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points depending on the adjacency of the pixel to the neighborhood pixels; wherein said means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points includes counter means and flip-flop means; wherein said plurality of motion detectors are arranged in a systolic array; wherein said difference picture generator hardware and said motion detection processors are characterized by operating on a cycle by cycle basis for a given frame, such that each cycle a pixel from the scene from previous and current time frames is input into said difference picture generator and each cycle a pixel is analyzed by said motion detection processors; wherein each cycle said feature extractor of each of said motion detection processors compares at least one pixel in the region with the predetermined set of neighborhood pixels to determine the adjacency of the pixel to the neighborhood pixels; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; and (c) feature extraction logic in circuit communication with said plurality of adjacency logic units.
-
-
8. Circuit architecture for dynamic scene analysis, comprising:
-
difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels; wherein each of said motion detection processors has a feature extractor stage which determines the motion parameters of the region; wherein said feature extractor has means for comparing each pixel in the region with the predetermined set of neighborhood pixels to determine the adjacency of the pixel to the neighborhood pixels; wherein said feature extractor has means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points depending on the adjacency of the pixel to the neighborhood pixels; wherein said means for determining the number of current frame edge fragments, the number of previous frame edge fragments, a boolean value representing the closedness of the current frame edge fragment, a boolean value representing the closedness of the previous frame edge fragment, and the number of current and previous frame edge points includes counter means and flip-flop means; wherein said plurality of motion detectors are arranged in a systolic array; wherein said difference picture generator hardware and said motion detection processors are characterized by operating on a cycle by cycle basis for a given frame, such that each cycle a pixel from the scene from previous and current time frames is input into said difference picture generator and each cycle a pixel is analyzed by said motion detection processors; wherein each cycle said feature extractor of each of said motion detection processors compares at least one pixel in the region with the predetermined set of neighborhood pixels to determine the adjacency of the pixel to the neighborhood pixels; and wherein each of said motion detection processors has a labeled picture generator in circuit communication with said feature extractor, said labeled picture generator associating with each pixel a k-bit label, and wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; (c) feature extraction logic in circuit communication with said plurality of adjacency logic units; (d) a first bistable circuit in circuit communication with said feature extraction logic, said first bistable circuit storing a value corresponding to the closedness of the current frame edge fragment; (e) a second bistable circuit in circuit communication with said feature extraction logic, said second bistable circuit storing a value corresponding to the closedness of the previous frame edge fragment; (f) a first counter in circuit communication with said feature extraction logic, said first counter storing a value corresponding to the number of current frame edge fragments; (g) a second counter in circuit communication with said feature extraction logic, said second counter storing a value corresponding to the number of previous frame edge fragments; (h) a third counter in circuit communication with said feature extraction logic, said third counter storing a value corresponding to the number of current frame edge pixels; (i) a fourth counter in circuit communication with said feature extraction logic, said fourth counter storing a value corresponding to the number of previous frame edge pixels; (j) a region classifier in circuit communication with said first and second bistable circuits and said first, second, third, and fourth counters, said region classifier classifying the motion in the region as being at least one of a predetermined set of classifications.
-
-
9. Circuit architecture for dynamic scene analysis, comprising:
-
difference picture generator hardware which takes as inputs pixel values corresponding to the same location in the scene from previous and current time frames and provides as output a representation of the difference picture of the scene, connected components hardware which takes as input the output of the difference picture generator and provides as output connected component labels of the difference picture, edge detector hardware which take as input pixel values corresponding to the same location in the scene from previous and current time frames and provide as outputs the edge values of the current and previous frames, and a plurality of motion detection processors which analyze separate regions of the difference picture, each of said motion detection processors having hardware which takes as input a connected component label of the difference picture in one region of the difference picture, the edge value in the current frame and the edge value in the previous frame, determines the motion relationship between each pixel and a predetermined set of neighborhood pixels, and provides as output a value representing the type of motion occurring in that region depending upon the motion relationship between each pixel and the neighborhood pixels; wherein each of said motion detection processors has a labeled picture generator in circuit communication with a feature extractor, said labeled picture generator associating with each pixel a k-bit label; wherein said feature extractor comprises; (a) a line delay having a plurality of k-bit registers connected in circuit communication, at least one of said k-bit registers corresponding to a predetermined pixel location and at least two other of said k-bit registers corresponding to a predetermined neighbor pixel location of said predetermined pixel location, said predetermined pixel location having associated therewith a predetermined pixel and each of said predetermined neighbor pixel locations having associated therewith a predetermined neighborhood pixel; (b) a plurality of adjacency logic units, each of said adjacency logic units being in circuit communication with; (i) the at least one k-bit register of said line delay corresponding to said predetermined pixel location and (ii) at least one other k-bit register of said line delay, said other k-bit register corresponding to one of said predetermined neighbor pixel locations; (c) feature extraction logic in circuit communication with said plurality of adjacency logic units; (d) a first bistable circuit in circuit communication with said feature extraction logic, said first bistable circuit storing a value corresponding to the closedness of the current frame edge fragment; (e) a second bistable circuit in circuit communication with said feature extraction logic, said second bistable circuit storing a value corresponding to the closedness of the previous frame edge fragment; (f) a first counter in circuit communication with said feature extraction logic, said first counter storing a value corresponding to the number of current frame edge fragments; (g) a second counter in circuit communication with said feature extraction logic, said second counter storing a value corresponding to the number of previous frame edge fragments; (h) a third counter in circuit communication with said feature extraction logic, said third counter storing a value corresponding to the number of current frame edge pixels; (i) a fourth counter in circuit communication with said feature extraction logic, said fourth counter storing a value corresponding to the number of previous frame edge pixels; (j) a region classifier in circuit communication with said first and second bistable circuits and said first, second, third, and fourth counters, said region classifier classifying the motion in the region as being at least one of a predetermined set of classifications; (1) said feature extraction logic incrementing said second counter and said fourth counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), and (ii) none of the k-bit labels corresponding to the predetermined neighborhood pixels indicating that any of predetermined neighborhood pixels are either; a. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or b. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (2) said feature extraction logic incrementing said first counter and said third counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and (ii) none of the k-bit labels corresponding to the predetermined neighborhood pixels indicating that any of predetermined neighborhood pixels are either; a. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or b. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (3) said feature extraction logic incrementing said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) none of the k-bit labels corresponding to the predetermined neighborhood pixels indicating that any of predetermined neighborhood pixels are either; a. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or b. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (4) said feature extraction logic incrementing said first counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) none of the k-bit labels corresponding to the predetermined neighborhood pixels indicating that any of predetermined neighborhood pixels are either; a. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or b. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); and (5) said feature extraction logic incrementing said first counter and said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) none of the k-bit labels corresponding to the predetermined neighborhood pixels indicating that any of predetermined neighborhood pixels are either; a. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or b. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or c. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame).
-
-
14. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is either: -
1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (2) said feature extraction logic decrementing said first counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is either; 1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (3) said feature extraction logic decrementing said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame); (3'"'"') said feature extraction logic decrementing said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), and b. the second predetermined neighborhood pixel is either;
-
-
15. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame);
(4) said feature extraction logic decrementing said first counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; - View Dependent Claims (33, 37)
-
16. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame); -
(4'"'"') said feature extraction logic decrementing said first counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is either; 1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (5) said feature extraction logic decrementing said first counter and said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; (a. the first predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), or b. either the first or third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame)), and c. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame).
-
-
18. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is either: -
1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (2) said feature extraction logic causing said first counter to count in a second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or
-
-
19. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is either: -
1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (3) said feature extraction logic causing said second counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame); (3'"'"') said feature extraction logic causing said second counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), and b. the second predetermined neighborhood pixel is either; 1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (4) said feature extraction logic causing said first counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either;
-
-
20. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame); (4'"'"') said feature extraction logic causing said first counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is either; 1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or
-
21. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame);
(5) said feature extraction logic causing said first counter and said second counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; (a. the first predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), or b. either the first or third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame)), and c. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame).
-
23. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is either: -
1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (3) said feature extraction logic decrementing said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame); (3'"'"') said feature extraction logic decrementing said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), and b. the second predetermined neighborhood pixel is either; 1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (4) said feature extraction logic decrementing said first counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame); (4'"'"') said feature extraction logic decrementing said first counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is either;
-
-
24. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame);
(5) said feature extraction logic decrementing said first counter and said second counter responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; (a. the first predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), or b. either the first or third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame)), and c. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame).
-
26. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is either: -
1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (2) said feature extraction logic causing said first counter to count in a second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either;
-
-
27. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is either: -
1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (3) said feature extraction logic causing said second counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or
-
-
28. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and
b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame); -
(3'"'"') said feature extraction logic causing said second counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the previous frame) and (an edge point in the current frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), and b. the second predetermined neighborhood pixel is either; 1. (an edge point in the difference picture) and (an edge point in the previous frame) but not (an edge point in the current frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame); (4) said feature extraction logic causing said first counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is either; 1. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or 2. (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame); (4'"'"') said feature extraction logic causing said first counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; a. at least one of the first and third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), and b. the second predetermined neighborhood pixel is either;
-
-
29. (an edge point in the difference picture) and (an edge point in the current frame) but not (an edge point in the previous frame), or(an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame);
(5) said feature extraction logic causing said first counter and said second counter to count in the second direction responsive to; (i) the k-bit label corresponding to the predetermined pixel indicating that the predetermined pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), and (ii) the k-bit labels corresponding to the predetermined neighborhood pixels indicating that; (a. the first predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame), or b. either the first or third predetermined neighborhood pixels is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame)), and c. the second predetermined neighborhood pixel is (an edge point in the difference picture) and (an edge point in the current frame) and (an edge point in the previous frame).
Specification