Digital processing of video images
First Claim
Patent Images
1. A system, comprising:
- an array of video cameras to capture warped panoramic video images of a scene and to produce a video stream; and
a digital processor to receive and process said video stream, said digital processor comprising;
a first processing module to unwarp said warped panoramic video images to produce rectilinear video images of the scene, wherein said first processing module provides at least one of pan, tilt, and zoom adjustments to allow for customized viewing of the scene in the produced rectilinear video images in a first perspective view,a second processing module to detect and track a person'"'"'s head in the rectilinear video images and to extract video images in the tracked person'"'"'s direction of view from the rectilinear video images so as to produce rectilinear video images in a second perspective view different from the first perspective view, anda third processing module to process images of a face from streaming video images for face recognition, wherein said third processing module performs a single-frame subspace feature analysis on multiple segments of the streaming video images to produce a sequence of classification results and a sequence of feature vectors, each classification result and feature vector corresponding to a length L segment of streaming video images, where L is an integer greater than 1, and then processes said sequences separately to produce video-based face recognition outputs;
wherein the array of video cameras comprises an omni-direction video camera to capture the warped panoramic video images in a full 360-degree view, andwhere the customized viewing of the scene in the produced rectilinear video images comprises at least one view from the full 360-degree view.
2 Assignments
0 Petitions
Accused Products
Abstract
Digital video imaging systems and techniques for efficiently transforming warped video images into rectilinear video images, real-time tracking of persons and objects, face recognition of persons, monitoring and tracking head pose of a person and associated perspective view of the person.
95 Citations
31 Claims
-
1. A system, comprising:
-
an array of video cameras to capture warped panoramic video images of a scene and to produce a video stream; and a digital processor to receive and process said video stream, said digital processor comprising; a first processing module to unwarp said warped panoramic video images to produce rectilinear video images of the scene, wherein said first processing module provides at least one of pan, tilt, and zoom adjustments to allow for customized viewing of the scene in the produced rectilinear video images in a first perspective view, a second processing module to detect and track a person'"'"'s head in the rectilinear video images and to extract video images in the tracked person'"'"'s direction of view from the rectilinear video images so as to produce rectilinear video images in a second perspective view different from the first perspective view, and a third processing module to process images of a face from streaming video images for face recognition, wherein said third processing module performs a single-frame subspace feature analysis on multiple segments of the streaming video images to produce a sequence of classification results and a sequence of feature vectors, each classification result and feature vector corresponding to a length L segment of streaming video images, where L is an integer greater than 1, and then processes said sequences separately to produce video-based face recognition outputs; wherein the array of video cameras comprises an omni-direction video camera to capture the warped panoramic video images in a full 360-degree view, and where the customized viewing of the scene in the produced rectilinear video images comprises at least one view from the full 360-degree view. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system, comprising:
-
an array of video cameras to capture warped panoramic video images of a scene and to produce a video stream; a video transmission mechanism to deliver said video stream to a plurality of video receivers, said video transmission mechanism comprising a video server which filters information in said video stream according to security levels assigned to video receivers to produce different filtered video streams to different video receivers; and a digital processor in each video receiver to independently process said video stream to unwarp said warped panoramic video images to produce rectilinear video images of the scene, said digital processor at each video receiving having a user graphic interface with at least one of pan, tilt, and zoom adjustments to allow for customized viewing at each video receiver that are independent from each another and represent different perspective views, wherein the digital processor further processes images of a face from said video stream for face recognition, by performing a single-frame subspace feature analysis on multiple segments of the video stream images to produce a sequence of classification results and a sequence of feature vectors, each classification result and feature vector corresponding to a length L segment of streaming video images, where L is an integer greater than 1, and then processes said sequences separately to produce video-based face recognition outputs; wherein the array of video cameras comprises an omni-direction video camera to capture the warped panoramic video images in a full 360-degree view, and where the customized viewing of the scene in the produced rectilinear video images comprises at least one view from the full 360-degree view. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
-
-
29. A system, comprising:
-
an array of video cameras to capture warped panoramic video images of a scene and to produce a video stream; and a digital processor to receive and process said video stream, said digital processor comprising; a first processing module to unwarp said warped panoramic video images to produce rectilinear video images of the scene, wherein said first processing module provides at least one of pan, tilt, and zoom adjustments to allow for customized viewing of the scene in a first perspective view, and a second processing module to extract a face from the streaming rectilinear video images, to perform face recognition on the extracted face, and to generate images viewed by the recognized face in a second perspective view independent of the first perspective view based on estimating an orientation of the face in the rectilinear video images, and a third processing module to perform face recognition by performing a single-frame subspace feature analysis on multiple segments of the streaming rectilinear video images to produce a sequence of classification results and a sequence of feature vectors, each classification result and feature vector corresponding to a length L segment of streaming video images, where L is an integer greater than 1, and then processes said sequences separately to produce face recognition outputs; wherein the array of video cameras comprises an omni-direction video camera to capture the warped panoramic video images in a full 360-degree view, and where the customized viewing of the scene in the produced rectilinear video images comprises at least one view from the full 360-degree view.
-
-
30. A system, comprising:
-
an array of video cameras to capture warped panoramic video images of a scene and to produce a video stream; a video transmission mechanism to deliver said video stream to a first video receiver and a second video receiver a digital processor in said first video receiver to process said video stream to unwarp said warped panoramic video images to produce rectilinear video images of the scene, wherein said digital processor in said first video receiver includes a user graphic interface with at least one of pan, tilt, and zoom adjustments to allow for customized viewing of the scene in a first perspective view, and said digital processor is operable to superimpose a customized video of the scene over a digital image; and another digital processor in said second video receiver to process said video stream to unwarp said warped panoramic video images to produce rectilinear video images of the scene, wherein the other digital processor in said second video receiver includes another user graphic interface with at least one of pan, tilt, and zoom adjustments to allow for customized viewing of the scene in a second perspective view independent of the digital processor in the first video receiver so that the second perspective view is capable of being different from the first perspective view, wherein the digital processor further processes images of a face from said video stream for face recognition, by performing a single-frame subspace feature analysis on multiple segments of video stream images to produce a sequence of classification results and a sequence of feature vectors, each classification result and feature vector corresponding to a length L segment of streaming video images, where L is an integer greater than 1, and then processes said sequences separately to produce video-based face recognition outputs, wherein the array of video cameras comprises an omni-direction video camera to capture the warped panoramic video images in a full 360-degree view, and where the customized viewing of the scene in the produced rectilinear video images comprises at least one view from the full 360-degree view. - View Dependent Claims (31)
-
Specification