IMAGE PROCESSING DEVICE AND METHOD, AND PROGRAM

• US 20160277677A1
• Filed: 05/31/2016
• Published: 09/22/2016
• Est. Priority Date: 03/18/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: YAMADA, HIDESHI, OHKI, MITSUHARU
• Granted Patent: US 10,277,812 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio

Abstract

The present technology relates to an image processing device and method, and program, whereby a high-quality loop moving image can be obtained more easily. Upon continuous shot images of multiple frames serving as material of a loop moving image being input, the continuous shot images are divided into multiple segments including motion segments including a moving subject and a still segment including a subject with no motion. An image of the motion segment region of the continuous shot images is formed into a loop moving image, and a segment loop moving image is generated. Also, an image of a still segment region of the continuous shot images is clipped out, and a segment image which is a still image is generated. Further, these segment loop moving image and segment image are integrated, to form one loop moving image. The present invention can be applied to an image processing device.

Claims

1. An image processing device, comprising:

a loop moving image generator configured to;

clip out a subject with motion from a plurality of shot images shot at different points in time to generate a motion segment; and

generate, from the plurality of shot images, images playable as a loop moving image, based on the motion segment in which the subject with motion is included and one or more still segments,

wherein the motion segment and the one or more still segments are divided from the plurality of shot images in a spatial direction.

2. The image processing device according to claim 1, wherein, of a plurality of continuous motion segments, the loop moving image is a moving image of images between two images with a high degree of similarity being repeatedly displayed in order.

3. The image processing device according to claim 2, wherein the loop moving image generator is configured to generate a segment map for identifying position of each of the plurality of motion segments or the one or more still segments formed on the surface of the plurality of shot images.

4. The image processing device according to claim 1, wherein the loop moving image generator is configured to generate a segment image which is one still image based on the one or more still segments.

5. The image processing device according to claim 4, wherein the loop moving image generator is configured to integrate images playable as the loop moving image and the segment image, thereby generating one loop moving image.

6. The image processing device according to claim 1, wherein the loop moving image generator is configured to generate each of the one or more still segments, by taking an average image of a plurality of images of still segments in the plurality of shot images.

7. The image processing device according to claim 1, wherein the loop moving image generator is configured to perform positioning processing on the plurality of shot images to rectify shaking in the plurality of shot images due to motion of an image capturing device during the capturing of the plurality of shot images.

8. The image processing device according to claim 1, wherein, in an event that two images exist with a high degree of similarity out of a plurality of continuous images of the motion segments, the loop moving image generator is configured to generate the loop moving image, based on the plurality of continuous images of the motion segments including the two images with the high degree of similarity.

9. The image processing device according to claim 8, wherein, in an event that no two images exist with a high degree of similarity out of the plurality of continuous images of the motion segments, the loop moving image generator is configured to generate a segment image based on one image of the plurality of continuous images of the motion segments.

10. The image processing device according to claim 1, further comprising:

a selector configured to switch shooting modes;

wherein in an event that a determined mode is selected as a shooting mode by operating the selector, the plurality of shot images and a high-resolution image are shot.

11. The image processing device according to claim 10, wherein the plurality of shot images are shot before shooting of the high-resolution image, further comprising:

a notifier configured to determine whether or not two images exist with a high degree of similarity in images of a plurality of motion segments in the plurality of shot images, and output the determination results thereof.

12. The image processing device according to claim 11, wherein in an event of determining that the two images exist with a high degree of similarity, the high-resolution image is shot, and the loop moving image is generated.

13. An image processing method of an image processing device, the method comprising:

clipping out a subject with motion from a plurality of shot images shot at different points in time to generate a motion segment; and

generating, from the plurality of shot images, images playable as a loop moving image, based on the motion segment in which the subject with motion is included and one or more still segments,

wherein the motion segment and the one or more still segments are divided from the plurality of shot images in a spatial direction.

14. A non-transitory computer readable medium having stored thereon, a set of computer-executable instructions for causing a computer to perform the steps comprising:

clipping out a subject with motion from a plurality of shot images shot at different points in time to generate a motion segment; and

generating, from the plurality of shot images, images playable as a loop moving image, based on the motion segment in which the subject with motion is included and one or more still segments,

wherein the motion segment and the one or more still segments are divided from the plurality of shot images in a spatial direction.