Method and apparatus for control and processing video images

• US 20040239763A1
• Filed: 07/12/2004
• Published: 12/02/2004
• Est. Priority Date: 06/28/2001
• Status: Abandoned Application

• Current Assignee: Omnivee, Inc.
• Original Assignee: Omnivee, Inc.
• Inventors: Notea, Amir, Carasso, Isaac, Kirdon, Ben
• Application Number:
  US10/481,719
• Publication Number:
  US 20040239763A1
• Time in Patent Office: Days
• US Class Current: 348/169
• CPC Class Codes: H04N 2007/17372 the upstream transmission being initiated or timed by a signal from upstream of the user terminal
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

An apparatus and method for controlling and processing of video images. The apparatus comprising a frame grabber for processing image frames received from the image-acquiring device, an Entire-View synthesis device for creating an Entire-View image from the images received, a Specified-View synthesis device for preparing and displaying a selected view from the Entire-View image, and a selection of view-point-and-angle device for receiving user input and identifying a Specified-View selected by the user. The apparatus also comprising a user interface comprising a first sub-window displaying an Entire-View image, a second sub-window displaying an Specified-View image representing an image selected by the user from the total visual information available about the action scene to be displayed as the Specified-View image.

Claims

1. Within a computerized system having at least one display, at least one central processing unit, at least one memory device and at least one input device, a plurality of images received from an image-acquiring device an apparatus for controlling and processing of video images, the apparatus comprising:

A frame grabber for processing image frames received from the image-acquiring device;

An Entire-View synthesis device for creating an Entire-View image from the images received;

A Specified-View synthesis device for preparing and displaying a selected view from the Entire-View image;

A selection of view-point-and-angle device for receiving user input and identifying a specified view selected by the user.

2. The apparatus of claim 1 further comprising a frame modification module for image color and geometrical correction.

3. The apparatus of claim 1 further comprising a frame modification module for mathematical model generation.

4. The apparatus of claim 1 further comprising a frame modification module for image data modification.

5. The apparatus of claim 1 further comprising a storage device for storing images processed by the frame grabber and the frame modification devices.

6. Within a computerized system having at least one display, at least one central processing unit, at least one memory device and at least one input device an apparatus for controlling and processing of video images the apparatus comprising a coding and combining device for transforming information sent by an image capturing device and combining the information sent into a single frame dynamically displayed on the display;

and a selection and processing device for selecting and processing the viewpoint and angle selected by a user of the apparatus.

7. Within a computerized system having at least one display, at least one central processing unit and at least one memory device a user interface for controlling and processing of video images the user interface displayed within a graphical window and operating in conjunction with a video display and at least one input device, the user interface comprising:

A first sub-window displaying an Entire-View image;

A second sub-window displaying a Specified-View image representing an image selected by the user from the Entire-View image to be displayed as the Specified-View image.

8. The apparatus of claim 7 further comprising a third sub-window displaying a time counter indicating a predetermined time;

9. The apparatus of claim 7 wherein the Entire-View comprises a plurality of images received from a plurality of sources and displayed to the video display.

10. The apparatus of claim 7 further comprising a view-point-and-angle selection device for selecting the image part selected on the Entire-View and displayed as the Specified-View image.

11. The apparatus of claim 7 further comprising a view-point-and-angle Selection-Indicator device for identifying the image part selected on the Entire-View and displayed as the Specified-View image.

12. The apparatus of claim 7 wherein the view-point-and-angle selection device is moveable within the Entire-View image in response to user input.

13. The apparatus of claim 7 wherein the Specified-View displays at least two images at a time, the right hand image is directed towards the right eye and the left hand image is directed towards the left eye.

14. The apparatus of claim 7 further comprising operation mode indicators for indicating the operation mode of the apparatus.

15. The apparatus of claim 7 further comprising a topology frame for displaying the physical location of at least one image-acquiring device.

16. The apparatus of claim 7 further comprising at least two view-point-and-angle selection indicators.

17. The apparatus of claim 7 further comprising a topology frame for displaying the physical location of at least one image-acquiring device associated with the image-acquiring device information displayed in the second sub-window displaying an specified-view image.

18. The apparatus of claim 17 further comprising a virtual camera indicator representsing the current viewpoint and angle offered for transmission.

19. Within a computerized system having at least one display, at least one central processing unit and at least one memory device a method for controlling and processing of video images within a user interface, the method comprising determining a time code interval;

and processing the image corresponding to the time code interval.

20. The method of claim 19 further comprising the step of setting a time code from which image is displayed.

21. The method of claim 19 wherein the step of processing further comprises:

retrieve frame for all image sources from an image source for the time code interval associates image selected;

select participating image sources associated with the view point and angle selector selected by the user;

determine warping and stitching parameters;

prepare image to be displayed in selection indicator view;

display image in the selection indicator.

22. The method of claim 19 further comprising the step of storing the image.

23. The method of claim 19 wherein the step of processing further comprises:

constructing Entire-View movie from at least two images;

display Entire-View image;

determine Entire-View and angle selector position;

display Entire-View and angle selector on display.

24. The method of claim 23 wherein the step of constructing further comprises obtaining the at least two images from a frame modification module, and warping and stitching the at least two images to create an entire view image.

25. The method of claim 23 further comprising storing of Entire-View image.

26. The method of claim 19 wherein the step of processing further comprises constructing entire Entire-View movie images from at least two images and storing said images for later display.

27. The method of claim 19 wherein the step of processing further comprises constructing Entire-View movie from at least two images and storing said image for later transmission.

28. The method of claim 19 further comprising displaying a view point and angle selector on an Entire-View frame, and determining the Specified-View corresponding to a user movement of the view point and angle selector on an Entire-View frame.