Methods and systems for determining frames and photo composition within multiple frames

• US 9,898,828 B2
• Filed: 05/20/2016
• Issued: 02/20/2018
• Est. Priority Date: 03/20/2014
• Status: Expired due to Fees

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: Lin, Bing-Sheng, Lin, Yi-Chi, Lu, Tai-Ling
• Primary Examiner(s): Haskins, Twyler
• Assistant Examiner(s): CHIU, WESLEY JASON
• Application Number:
  US15/159,825
• Publication Number:
  US 20160267680A1
• Time in Patent Office: 641 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 7/174 involving the use of two or more images
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/2625 for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

Methods and systems for determining frames and photo composition within multiple frames are provided. First, a plurality of frames, which are respectively captured with a predefined time interval are obtained. At least one object within at least two of the frames is detected. In some embodiments, a moving speed of the object is calculated according to the positions of the object in the respective frames and the predefined time interval, and candidate frames are selected from the frames according to the moving speed of the object. In some embodiments, an overlapped area corresponding to the object within a first frame and a second frame is calculated, and at least one candidate frame is selected according to the overlapped area corresponding to the object. The at least one candidate frame is composed to generate a composed photo.

Claims

1. A method for determining frames within multiple frames for use in an electronic device, comprising:

obtaining a plurality of frames, wherein the respective frames are captured with a time interval;

detecting at least one object within at least two of the frames;

calculating an overlapped area corresponding to the object within a first frame and a second frame; and

selecting at least one candidate frame according to the overlapped area corresponding to the object, comprising the steps of;

determining whether the overlapped area corresponding to the object equals to zero;

if the overlapped area corresponding to the object equals to zero, calculating a moving speed of the object according to the positions of the object in the respective frames and the predefined time interval; and

selecting candidate frames within the frames according to the moving speed of the object.

2. The method of claim 1, wherein the step of selecting at least one candidate frame according to the overlapped area corresponding to the object comprises the steps of:

determining whether the overlapped area corresponding to the object is less than a specific percentage of a contour area of the object; and

if the overlapped area corresponding to the object is less than a specific percentage of the contour area of the object, selecting the second frame as the candidate frame.

3. The method of claim 1, wherein the step of detecting at least one object within at least two of the frames comprises the steps of:

transforming the at least two frames into grayscale frames; and

subtracting the grayscale frames with each other to obtain a contour of the object.

4. The method of claim 1, wherein the step of selecting candidate frames within the frames according to the moving speed of the object comprises the steps of:

looking up a table according to the moving speed of the object to obtain a frame gap number; and

selecting the candidates frames within the frames at intervals of the frame gap number.

5. The method of claim 4, wherein the faster the moving speed is, the smaller the frame gap number is.

6. The method of claim 1, further comprising recording a video, and the frames are obtained from the video.

7. A system for determining frames within multiple frames for use in an electronic device, comprising:

a storage unit configured to comprise a plurality of frames, wherein the respective frames are captured with a predefined time interval; and

a processor configured to detect at least one object within at least two of the frames, calculate an overlapped area corresponding to the object within a first frame and a second frame, and select at least one candidate frame according to the overlapped area corresponding to the object;

wherein the processor configured to select at least one candidate frame according to the overlapped area corresponding to the object comprises;

the processor configured to determine whether the overlapped area corresponding to the object equals to zero;

if the overlapped area corresponding to the object equals to zero, the processor configured to calculate a moving speed of the object according to the positions of the object in the respective frames and the predefined time interval; and

the processor configured to select candidate frames within the frames according to the moving speed of the object.