Adjusting length of living images

• US 10,154,196 B2
• Filed: 05/26/2015
• Issued: 12/11/2018
• Est. Priority Date: 05/26/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Traff, Gustav, Tran, To, Andrae, Tor
• Primary Examiner(s): Misleh, Justin P.
• Application Number:
  US14/721,183
• Publication Number:
  US 20160353052A1
• Time in Patent Office: 1,295 Days
• Field of Search: None
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 1/212 Motion video recording combined with still video recording television signal recording H04N5/76
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

A method may comprise: obtaining a preliminary frame sequence and at least one still image frame, captured by a digital camera during shooting a scene; obtaining at least one of indication of fulfillment of a predetermined starting scene condition in at least one frame of the preliminary frame sequence and indication of fulfillment of a predetermined first camera condition prevailing during capturing the preliminary frame sequence; automatically selecting a starting frame from the preliminary frame sequence on the basis of at least one of fulfillment of the starting scene condition and fulfillment of the first camera condition; and automatically forming, from the preliminary frame sequence and the at least one still image frame, a displayable frame sequence for displaying a living image of the scene, the living image comprising a still image and a preceding image sequence, the frame sequence starting by the starting frame and having a still image frame as a stopping frame for displaying the still image.

Claims

1. A method comprising:

capturing a preliminary image frame sequence by a digital camera;

receiving a request to capture a still image frame by the digital camera during a shooting of a scene;

based on the received request, capturing the still image frame;

upon capturing the still image frame, stopping the capturing of the preliminary image frame sequence;

obtaining at least one of an indication of a fulfillment of a predetermined starting scene condition in at least one image frame of the captured preliminary image frame sequence;

obtaining an indication of a fulfillment of a predetermined first camera condition prevailing during the capturing of the preliminary image frame sequence;

automatically selecting, from the captured preliminary image frame sequence, a starting image frame for a displayable image frame sequence based on at least one of the fulfillment of the predetermined starting scene condition and the fulfillment of the predetermined first camera condition, wherein the predetermined starting scene condition is movement occurring in the scene; and

automatically forming, from the captured preliminary image frame sequence and the still image frame, a living image of the scene based on the displayable image frame sequence, the living image of the scene starting with the starting image frame and having the captured still image frame as a last image frame in the living image of the scene.

2. A method as defined in claim 1, further comprising analyzing a plurality of image frames of the captured preliminary image frame sequence to detect a fulfillment of a starting scene condition in at least one image frame of the captured preliminary image frame sequence.

3. A method as defined in claim 2, wherein the plurality of image frames comprises at least three image frames.

4. A method as defined in claim 1, wherein the starting scene condition requires movement of a human occurring in the scene.

5. A method as defined in claim 1, wherein the starting scene condition requires a predetermined relevant change occurring in the scene.

6. A method as defined in claim 1, wherein the first camera condition requires the camera having at least one of a predetermined tilting position and a predetermined stability.

7. A method as defined in claim 1, wherein a plurality of still image frames are obtained, the method further comprising:

obtaining at least one of indication of a fulfillment of a predetermined stopping scene condition in at least one of the plurality of still image frames and an indication of a fulfillment of a predetermined second camera condition prevailing during the capturing of the plurality of still image frames; and

automatically selecting a stopping image frame from the plurality of still image frames based on at least one of a fulfillment of the predetermined stopping scene condition and a fulfillment of the predetermined second camera condition.

8. A method as defined in claim 1, wherein the still image frame differs from image frames of the captured preliminary image frame sequence by at least one of its higher resolution, lower noise, or higher dynamic range.

9. A method as defined in claim 1, wherein the displayable image frame sequence has a length corresponding to a duration of a preceding image frame sequence of less than or equal to 3 seconds.

10. A method comprising:

sequentially capturing preliminary image frames by a digital camera;

receiving an image capturing request;

capturing an image frame in response to the image capturing request;

upon capturing the image frame, stopping a capture of the sequentially capturing preliminary image frames;

upon stopping the capture of the sequentially capturing preliminary image frames, storing the sequentially captured preliminary image frames into a buffer sequence having a predetermined number of image frames;

automatically detecting fulfillment of a starting scene condition in at least one preliminary image frame of the buffer sequence, wherein the starting scene condition is movement occurring in a scene;

automatically selecting a starting image frame for a displayable image frame sequence from the buffer sequence based at least on a fulfillment of the starting scene condition; and

automatically forming a living image of the scene based on the displayable image frame sequence, the living image of the scene starting with the starting image frame and ending with the captured image frame.

11. A method as defined in claim 10, wherein the starting scene condition requires movement of at least part of the scene relative to the digital camera.

12. A method as defined in claim 10, wherein the starting scene condition requires a predetermined relevant change occurring in the scene.

13. A method as defined in claim 12, wherein the predetermined relevant change comprises at least one of a human face appearing in the scene, a predetermined human face feature appearing in the scene, and a gaze appearing in the scene.

14. A method as defined in claim 12, wherein the predetermined relevant change comprises a change in lighting conditions at least at one location in the scene.

15. A method as defined in claim 10, further comprising obtaining an indication of a fulfillment of a predetermined first camera condition during the storing of the sequentially captured preliminary image frames in the buffer sequence, wherein automatically selecting the starting image frame from the buffer sequence is carried out based at least on a fulfillment of the starting scene condition and the predetermined first camera condition.

16. A method as defined in claim 15, wherein the predetermined first camera condition requires the camera having a predetermined tilting.

17. A method as defined in claim 16, wherein the predetermined first camera condition further requires the camera having a predetermined stability.

18. An apparatus comprising an image processing unit programmed to perform operations comprising:

capturing a preliminary image frame sequence by a digital camera;

receive a request to capture a still image frame by the digital camera during a shooting of a scene;

based on the received request, capture the still image frame;

based on the capturing of the still image frame, stop the capturing of the preliminary image frame sequence;

obtain at least one of an indication of a fulfillment of a predetermined starting scene condition in at least one image frame of the captured preliminary image frame sequence and an indication of a fulfillment of a predetermined first camera condition prevailing during the capturing of the preliminary image frame sequence;

select, from the captured preliminary image frame sequence, a starting image frame for a displayable image frame sequence based on at least one of the fulfillment of the predetermined starting scene condition and the fulfillment of the predetermined first camera condition, wherein the starting scene condition is movement occurring in the scene; and

form, from the captured preliminary image frame sequence and the still image frame, a living image of the scene based on the displayable image frame sequence, the living image of the scene starting with the starting image frame and having the still image frame as a last image frame in the living image of the scene.

19. An apparatus as defined in claim 18, further comprising a digital camera unit configured to capture image frames, the image processing unit being connected to the digital camera unit to obtain the captured image frames.

20. An apparatus as defined in claim 19, implemented as a mobile electronic device.