Content generation, extraction and distribution of image region segments from video images

• US 20020159637A1
• Filed: 03/08/2002
• Published: 10/31/2002
• Est. Priority Date: 03/16/2001
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Masumitsu, Ken, Echigo, Tomio, Murao, Takaaki, Teraguchi, Masayoshi
• Granted Patent: US 7,313,278 B2
• Time in Patent Office: Days
• US Class Current: 382/190
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44

Abstract

The present invention provides methods for extracting an image region segment from a video image, a system for extracting an image region segment, a program for extracting an image region segment, a method for distributing an extracted video image, and a method for generating content. Motion compensation data is calculated using sequential video images captured by a video camera, and the sequential video images are employed to prepare an estimation of the video camera operation. Based on the estimated camera operation, the center position (xc, yc) of an area that is aimed at in a video image is estimated under predetermined conditions (rules), an image feature is designated in the vicinity of the center position of the target area, and an image segment is specified that includes this image feature.

Claims

1. An image region segment extraction method for extracting an image segment from a video image comprising the steps of:

calculating motion data for a video image based on sequential video images obtained by a video camera;

using said sequential video images to estimate the camera operations required of said video camera;

referring to said camera operations performed under predetermined conditions to estimate the location of the center of a target area in a video image that has been obtained;

designating image features in the vicinity of said center position of said target area; and

designating an image segment in which said image features are included.

2. The image region segment extraction method according to claim 1, wherein said video image is selected from a format taken from a group of formats including:

an MPEG format, a CGM format, an EPS format, a GIF format, a JPEG format, a PICT format, a PNG format, a PS format, a TIF format or a BMP format.

3. The image region segment extraction method according to claim 1, wherein said step of calculating said camera operations includes the step of:

making an estimation of the robustness of a predetermined parameter of said camera operations.

4. The image region segment extraction method according to claim 3, further comprising a step of:

obtaining an average movement for said predetermined parameter for two sequential frames.

5. The image region segment extraction method according to claim 1, wherein, at said step of estimating said center position of said target area, a rule is employed concerning front-space video in said camera operations.

6. The image region segment extraction method according to claim 1, further comprising the step of:

trimming said image segment and generating a trimmed image;

or

performing scalable coding to obtain a high resolution for said image segment.

19. A video image distribution method for distributing a video image via a network comprising the steps of:

providing a server connected to said network, for distributing video images to terminal means connected to said network;

transmitting requests from said terminal means to said server for the distribution of said video image; and

transmitting to said terminal means, in response to said request, a video image stored in said server,

wherein said video image includes a trimmed image generated by the method according to one of claim 1 or an image obtained by scalable coding.

21. A method for generating content, including trimmed images or scalable coded images, comprising the steps of:

employing the method according to claim 6 to generate trimmed images or scalable coded images;

arranging said trimmed images or scalable coded images in the order occupied by video images before trimming to constitute a continuous content time series; and

storing said content in a storage media.

22. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing extraction of an image segment from a video image, the computer readable program code means in said article of manufacture comprising computer readable program code means for causing a computer to effect the steps of claim 1.

24. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing generation of content, the computer readable program code means in said article of manufacture comprising computer readable program code means for causing a computer to effect the steps of claim 21.

25. A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for extraction of an image segment from a video image, said method steps comprising the steps of claim 1.

7. An image region segment extraction system, for extracting an image segment from a video image comprising:

means for calculating motion data for a video image based on sequential video images obtained by a video camera;

means for using said sequential video images to estimate the camera operations required of said video camera;

means for referring to said camera operations performed under predetermined conditions to estimate the location of the center of a target area in a video image that has been obtained;

means for designating image features in the vicinity of said center position of said target area; and

means for designating an image segment in which said image features are included.

8. The image region segment extraction system according to claim 7, wherein said video image is selected from a format taken from a group of formats including:

an MPEG format, a CGM format, an EPS format, a GIF format, a JPEG format, a PICT format, a PNG format, a PS format, a TIF format, and a BMP format.

9. The image region segment extraction system according to claim 7, wherein said means for calculating said camera operations includes means for making an estimation of the robustness of a predetermined parameter of said camera operations.

10. The image region segment extraction system according to claim 9, further comprising means for obtaining an average movement for said predetermined parameter for two sequential frames.

11. The image region segment extraction system according to claim 7, wherein said means for estimating said center position of said target area employs a rule concerning front-space video in said camera operations to estimate the center position.

12. The image region segment extraction system according to claim 7, further comprising at least one means taken from a group of means including:

means for trimming said image segment and generating a trimmed image; and

means for performing scalable coding to obtain a high resolution for said image segment.

14. The image region segment extraction program according to claim 13, wherein said video image is selected from a format taken from a group of formats including:

an MPEG format, a CGM format, an EPS format, a GIF format, a JPEG format, a PICT format, a PNG format, a PS format, a TIF format or a BMP format.

15. The image region segment extraction program according to claim 13, wherein said step of calculating said camera operations includes the step of:

making an estimation of the robustness of a predetermined parameter of said camera operations.

16. The image region segment extraction program according to claim 15, further comprising a step of:

obtaining an average movement for said predetermined parameter for two sequential frames.

17. The image region segment extraction program according to claim 13, wherein at said step of estimating said center position of said target area, a rule is employed concerning front-space video in said camera operations.

18. The image region segment extraction program according to claim 13, further comprising the step of:

trimming said image segment and generating a trimmed image;

or

performing scalable coding to obtain a high resolution for said image segment.

20. The video image distribution method according to claim 19, wherein said terminal means is computer means connected to said network, or a cellular phone connected to said network.

23. An article of manufacture comprising a computer usable medium having computer readable program code means embodied therein for causing distribution of a video image via a network, the computer readable program code means in said article of manufacture comprising computer readable program code means for causing a computer to effect the steps of claim 19.

26. A computer program product comprising a computer usable medium having computer readable program code means embodied therein for causing image region segment extraction, the computer readable program code means in said computer program product comprising computer readable program code means for causing a computer to effect the functions of claim 7.

13. An image region segment extraction program, for permitting a computer system to extract an image segment from a video image, comprising the steps of:

calculating motion data for a video image based on sequential video images obtained by a video camera;

using said sequential video images to estimate the camera operations required of said video camera;

referring to said camera operations performed under predetermined conditions to estimate the location of the center of a target area in a video image that has been obtained;

designating image features in the vicinity of said center position of said target area; and

designating an image segment in which said image features are included.