Image processing apparatus, image processing method, and program

• US 8,488,904 B2
• Filed: 09/08/2009
• Issued: 07/16/2013
• Est. Priority Date: 10/27/2008
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsurumi, Shingo
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US12/555,382
• Publication Number:
  US 20100103290A1
• Time in Patent Office: 1,407 Days
• Field of Search: 382/276, 382/284, 382/294, 382/295, 382/100, 382/106, 382/107, 348/239
• US Class Current: 382/276
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

An image processing apparatus includes: a transformation information calculating unit configured to calculate, based on the motion information of an imaged image making up an imaged moving picture, transformation information relating to a plurality of compositing target images serving as compositing targets of an imaged image making up the imaged moving picture; and a decoration image determining unit configured to calculate a shift quantity between a first compositing target image that is the compositing target image, and a second compositing target image that is the compositing target image after transformation according to the transformation information to determine a decoration image to be added to the periphery of the second compositing target image based on the shift quantity.

Claims

1. An image processing apparatus comprising:

a transformation information calculating unit configured to calculate, based on the motion information of an imaged image making up an imaged moving picture, transformation information relating to a plurality of compositing target images serving as compositing targets of an imaged image making up said imaged moving picture; and

a decoration image determining unit configured to calculate a shift quantity between a first compositing target image that is said compositing target image, and a second compositing target image that is said compositing target image after transformation according to said transformation information to determine a decoration image to be added to the periphery of said second compositing target image based on said shift quantity.

2. The image processing apparatus according to claim 1, wherein said transformation information calculating unit calculates said transformation information used for transforming, with one compositing target image of said compositing target images as a reference image, the other of said compositing target images for each of said compositing target images;

and wherein said decoration image determining unit calculates a shift quantity between a composited image transformed with said transformation information and composited from at least one compositing target image of said compositing target images, and said second compositing target image, and determines said decoration image based on said shift quantity.

3. The image processing apparatus according to claim 1, wherein said decoration image determining unit determines the heaviness of said decoration image based on the size of said calculated shift quantity.

4. The image processing apparatus according to claim 1, wherein said decoration image determining unit calculates said shift quantities relating to all the compositing target images of said compositing target images to determine the same decoration image to be added to the peripheries of all of said compositing target images based on said shift quantities.

5. The image processing apparatus according to claim 1, further comprising:

an image transforming unit configured to transform said compositing target images based on said transformation information to generate said second compositing target image; and

an image compositing unit configured to add said determined decoration image to said second compositing target image, and composite said second compositing target image to which said decoration image has been added, and said first compositing target image to generate a composited image.

6. The image processing apparatus according to claim 1, further comprising:

an object detecting unit configured to detect an object included in said compositing target images;

wherein said decoration image determining unit determine said decoration image so as not to overlay an object region including said object with a region of said decoration image, in the case that said object is included in said second compositing target image.

7. An image processing apparatus comprising:

a transformation information calculating unit configured to calculate, based on the motion information of an imaged image making up an imaged moving picture, transformation information relating to a compositing target image serving as a compositing target of an imaged image making up said imaged moving picture; and

a decoration image determining unit configured to determine, based on relative positional relationship between a first compositing target image that is said compositing target image, and a second compositing target image that is said compositing target image after transformation according to said transformation information, a decoration image to be added to the periphery of said second compositing target image.

8. The image processing apparatus according to claim 7, wherein said decoration image determining unit determines the position of said decoration image based on the transition of each peak between said first compositing target image and said second compositing target image.

9. The image processing apparatus according to claim 7, wherein said decoration image determining unit determines the position of said decoration image based on the size and position of the edge portion of said second compositing target image overlaid with said first compositing target image.

10. The image processing apparatus according to claim 9, wherein said decoration image determining unit calculates the size and position of said overlaid edge portion regarding all the compositing target images of said compositing target images, and determines the same decoration image to be added to all of the peripheries of said compositing target images based on the calculated size and position.

11. An image processing method performed by an image processing apparatus, the method comprising:

calculating, by circuitry of the image processing apparatus based on the motion information of an imaged image making up an imaged moving picture, transformation information relating to a plurality of compositing target images serving as compositing targets of an imaged image making up said imaged moving picture; and

calculating, by the circuitry, a shift quantity between a first compositing target image that is said compositing target image, and a second compositing target image that is said compositing target image after transformation according to said transformation information to determine a decoration image to be added to the periphery of said second compositing target image based on said shift quantity.

12. A non-transitory computer-readable medium including a program causing a computer to execute:

calculating of, based on the motion information of an imaged image making up an imaged moving picture, transformation information relating to a plurality of compositing target images serving as compositing targets of an imaged image making up said imaged moving picture; and

calculating of a shift quantity between a first compositing target image that is said compositing target image, and a second compositing target image that is said compositing target image after transformation according to said transformation information to determine a decoration image to be added to the periphery of said second compositing target image based on said shift quantity.

13. An information processing apparatus comprising:

circuitry configured to;

calculate a shift quantity between a first compositing target image, which is an image of a moving picture, and a second compositing target image, which is another image of the moving picture after transformation according to transformation information, to determine a decoration image to be added to a periphery of the second compositing target image based on the shift quantity;

add the decoration image to the second compositing target image; and

generate a composited image based on the second compositing target image to which the decoration image has been added and the first compositing target image.

14. An information processing method performed by an information processing apparatus, the method comprising:

calculating, by circuitry of the information processing apparatus, a shift quantity between a first compositing target image, which is an image of a moving picture, and a second compositing target image, which is another image of the moving picture after transformation according to transformation information, to determine a decoration image to be added to a periphery of the second compositing target image based on the shift quantity;

adding, by the circuitry, the decoration image to the second compositing target image; and

generating, by the circuitry, a composited image based on the second compositing target image to which the decoration image has been added and the first compositing target image.

15. A non-transitory computer-readable medium including computer program instructions, which when executed by an information processing apparatus, cause the information processing apparatus to perform a process including:

calculating a shift quantity between a first compositing target image, which is an image of a moving picture, and a second compositing target image, which is another image of the moving picture after transformation according to transformation information, to determine a decoration image to be added to a periphery of the second compositing target image based on the shift quantity;

adding the decoration image to the second compositing target image; and

generating a composited image based on the second compositing target image to which the decoration image has been added and the first compositing target image.

16. An information processing apparatus comprising:

circuitry configured to;

determine, based on relative positional relationship between a first compositing target image, which is an image of a moving picture, and a second compositing target image, which is another image of the moving picture after transformation according to transformation information, a decoration image to be added to a periphery of the second compositing target image based on a relative positional relationship between the first compositing target image and the second compositing target image;

add the decoration image to the second compositing target image; and

generate a composited image based on the second compositing target image to which the decoration image has been added and the first compositing target image.

17. An information processing method performed by an information processing apparatus, the method comprising:

determining, by circuitry of the information processing apparatus based on relative positional relationship between a first compositing target image, which is an image of a moving picture, and a second compositing target image, which is another image of the moving picture after transformation according to transformation information, a decoration image to be added to a periphery of the second compositing target image based on a relative positional relationship between the first composting target image and the second compositing target image;

adding, by the circuitry, the decoration image to the second compositing target image; and

generating, by the circuitry, a composited image based on the second compositing target image to which the decoration image has been added and the first compositing target image.

18. A non-transitory computer-readable medium including computer program instructions, which when executed by an information processing apparatus, cause the information processing apparatus to perform a process including:

determining, based on relative positional relationship between a first compositing target image, which is an image of a moving picture, and a second compositing target image, which is another image of the moving picture after transformation according to transformation information, a decoration image to be added to a periphery of the second compositing target image based on a relative positional relationship between the first composting target image and the second compositing target image;

adding the decoration image to the second compositing target image; and

generating a composited image based on the second compositing target image to which the decoration image has been added and the first compositing target image.