Composite still-image creating device capable of creating a still image from moving images

• US 7,733,379 B2
• Filed: 06/07/2004
• Issued: 06/08/2010
• Est. Priority Date: 06/13/2003
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Hosoda, Jun
• Primary Examiner(s): Tran; Sinh
• Assistant Examiner(s): Peterson; Christopher K
• Application Number:
  US10/863,859
• Publication Number:
  US 20040252765A1
• Time in Patent Office: 2,192 Days
• Field of Search: 348/220.1, 348/218.1, 375/240.16, 375/240.12, 345/629
• US Class Current: 348/222.1
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 5/4448 for frame-grabbing

Abstract

Each of the frames forming moving images is decoded in sequence and while a candidate frame is decoded, a decision is made as to whether or not the motion vector variable-length decoded for each macroblock is greater than a threshold, so that if the motion vector is greater than the threshold, the decoded image of the corresponding block is decided as a partial image forming a subject portion that had motion in the candidate frame and then combined with a base image stored in a still memory in a combining unit, whereby, by repeating this process, a composite still image which allows the motion of the subject to be grasped visually is created in the still memory.

Claims

1. A composite still image creation device comprising:

an acquisition unit which acquires moving image data coded using an interframe predictive coding process, wherein the moving image data includes motion vector data and comprises a plurality of frame images each of which is divided into a plurality of macroblocks, and wherein the motion vector data is included in each of the macroblocks;

an extraction unit which extracts the motion vector data in one macroblock in one frame image of the moving image data acquired by the acquisition unit;

a selection unit which determines whether the one macroblock is to be selected as a partial image based only on the motion vector data in the one macroblock extracted by the extraction unit and without referring to data in another macroblock, wherein the selection unit further selects, as an additional partial image, at least one macroblock adjacent to the macroblock selected as the partial image irrespective of a value of the motion vector data of the at least one adjacent macroblock; and

a combining unit which combines the partial images selected by the selection unit with a still image.

2. The composite still image creation device according to claim 1, wherein when the motion vector data is greater than a predetermined threshold, the selection unit selects the macroblock having the motion vector data as the partial image.

3. The composite still image creation device according to claim 1, wherein the selection unit further comprises a selection condition decision section which determines whether each of the at least one adjacent macroblock satisfies a predetermined selection condition so as to only select an adjacent macroblock that satisfies the predetermined selection condition.

4. The composite still image creation device according to claim 3, wherein the selection condition decision section determines whether prediction error data used to decode the frame data together with the motion vector data is greater than a predetermined threshold.

5. The composite still image creation device according to claim 3, further comprising a contour extraction unit which extracts contours of the respective macroblocks in each of the plurality of frame images, and

wherein the selection condition decision section determines whether a degree of continuity between the contour of the adjacent macroblock extracted by the contour extraction unit and the contour of the macroblock already extracted is greater than a predetermined threshold.

6. A composite still image creation device comprising:

an acquisition unit which acquires moving image data coded using an interframe predictive coding process, the moving image data already including motion vector data;

a specification unit arranged to specify arbitrarily, in accordance with a user operation, any one of a plurality of frame images which comprise the moving image data acquired by the acquisition unit;

an extraction unit which extracts the motion vector data from the moving image data acquired by the acquisition unit;

a selection unit which selects a partial image from a frame image included in the moving image data based on the motion vector data extracted by the extraction unit; and

a combining unit which combines the partial image selected by the selection unit with a frame image specified by the specification unit.

7. The composite still image creation device according to claim 6,

wherein the specification unit is adapted to be able to specify three frame images;

wherein the selection unit selects a plurality of partial images from the plurality of the frame images based on motion vector data used for decoding a plurality of frame images constituting any two frame images of the three frame images specified by the specification unit; and

wherein the combining unit combines the partial images selected by the selection unit with the remaining frame image of the three frame images specified by the specification unit.

8. A composite still image creation device comprising:

means for acquiring moving image data coded using an interframe predictive coding process, the moving image data including motion vector data, wherein the moving image data comprises a plurality of frame images each of which is divided into a plurality of macroblocks, and the motion vector data is included in each of the macroblocks;

means for extracting the motion vector data in one macroblock in one frame of the moving image data acquired by the acquiring means;

means for determining whether the one macroblock is to be selected as a partial image based only on the motion vector data in the one macroblock extracted by the extracting means and without referring to data in another macroblock, wherein the determining means further selects, as an additional partial image, at least one macroblock adjacent to the macroblock selected as the partial image irrespective of a value of the motion vector data of the at least one adjacent macroblock; and

means for combining the partial images selected by the determining means with a still image.

9. A method comprising:

operating a still image creation device to acquire moving image data coded using an interframe predictive coding process, the moving image data including motion vector data, wherein the moving image data comprises a plurality of frame images each of which is divided into a plurality of macroblocks, and the motion vector data is included in each of the macroblocks;

extracting the motion vector data in one macroblock in one frame of the acquired moving image data;

determining whether the one macroblock is to be selected as a partial image based only on the extracted motion vector data in the one macroblock and without referring to data in another macroblock, and further selecting, as an additional partial image, at least one macroblock adjacent to the macroblock selected as the partial image irrespective of a value of the motion vector data of the at least one adjacent macroblock; and

combining the selected partial images with a still image.

10. A recording medium storing a computer program which is executable by a computer of a composite still image creation device to cause the composite still image creation device to execute functions comprising:

acquiring moving image data coded using an interframe predictive coding process, the moving image data including motion vector data, wherein the moving image data comprises a plurality of frame images each of which is divided into a plurality of macroblocks, and the motion vector data is included in each of the macroblocks;

extracting the motion vector data in one macroblock in one frame of the acquired moving image data;

determining whether the one macroblock is to be selected as a partial image based only on the extracted motion vector data in the one macroblock and without referring to data in another macroblock, and further selecting, as an additional partial image, at least one macroblock adjacent to the macroblock selected as the partial image irrespective of a value of the motion vector data of the at least one adjacent macroblock; and

combining the selected partial images with a still image.

11. A composite still image creation device comprising:

means for acquiring moving image data coded using an interframe predictive coding process, the moving image data already including motion vector data;

means for specifying arbitrarily, in accordance with a user operation, any one of a plurality of frame images which comprise the moving image data acquired by the acquiring means;

means for extracting the motion vector data from the moving image data acquired by the acquiring means;

means for selecting a partial image from a frame image included in the moving image data based on the motion vector data extracted by the extracting means; and

means for combining the partial image selected by the selecting means with a frame image specified by the specifying means.

12. A method comprising:

operating a still image creation device to acquire moving image data coded using an interframe predictive coding process, the moving image data already including motion vector data;

specifying arbitrarily, in accordance with a user operation, any one of a plurality of frame images which comprise the acquired moving image data;

extracting the motion vector data from the acquired moving image data;

selecting a partial image from a frame image included in the moving image data based on the extracted motion vector data; and

combining the selected partial image with the specified frame image.

13. A recording medium storing a computer program which is executable by a computer of a composite still image creation device to cause the composite still image creation device to execute functions comprising:

acquiring moving image data coded using an interframe predictive coding process, the moving image data already including motion vector data;

specifying arbitrarily, in accordance with a user operation, any one of a plurality of frame images which comprise the acquired moving image data;

extracting the motion vector data from the acquired moving image data;

selecting a partial image from a frame image included in the moving image data based on the extracted motion vector data; and

combining the selected partial image with the specified frame image.