METHOD AND APPARATUS FOR PROCESSING VIDEO FRAMES IMAGE WITH IMAGE REGISTRATION INFORMATION INVOLVED THEREIN

• US 20130089301A1
• Filed: 05/31/2012
• Published: 04/11/2013
• Est. Priority Date: 10/06/2011
• Status: Abandoned Application

• Current Assignee: MediaTek, Inc.
• Original Assignee: Chi-Cheng Ju
• Inventors: Ju, Chi-Cheng, Chen, Ding-Yun, Ho, Cheng-Tsai
• Application Number:
  US13/484,276
• Publication Number:
  US 20130089301A1
• Time in Patent Office: Days
• US Class Current: 386/241
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/91 Television signal processing therefor
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A method of processing a plurality of video frames includes: obtaining image registration information of the video frames, wherein the image registration information is used to transform different video frames into one coordinate system; and searching for a plurality of target video frames corresponding to a selected scene among the video frames by using the image registration information. A playback method of a video stream includes: receiving a playback request for a selected scene; searching the video stream for target video frames corresponding to image registration information of the selected scene, wherein the image registration information is used to transform different video frames into one coordinate system; and performing a playback operation according to the target video frames found in the video stream.

Claims

1. A method of processing a plurality of video frames, comprising:

obtaining image registration information of the video frames, wherein the image registration information is used to transform different video frames into one coordinate system; and

searching for a plurality of target video frames corresponding to a selected scene among the video frames by using the image registration information.

2. The method of claim 1, further comprising:

receiving a video stream having the video frames and the image registration information included therein;

wherein the step of obtaining the image registration information of the video frames comprises;

obtaining the image registration information of the video frames from the received video stream.

3. The method of claim 1, wherein the step of obtaining the image registration information comprises:

obtaining a scene number assigned to at least one video frame.

4. The method of claim 1, wherein the step of obtaining the image registration information comprises:

obtaining a coordinate assigned to at least one video frame.

5. The method of claim 4, wherein a coordinate assigned to a beginning video frame among the video frames is at an origin.

6. The method of claim 1, wherein the step of obtaining the image registration information comprises:

obtaining global motion information.

7. The method of claim 1, wherein the step of obtaining the image registration information comprises:

obtaining sensor information of at least one sensor disposed on an image capturing apparatus that generates the video frames.

8. The method of claim 1, wherein the step of obtaining the image registration information comprises:

obtaining at least one of translate information, rotation information, and scale information of at least one video frame.

9. The method of claim 1, wherein the step of obtaining the image registration information comprises:

obtaining camera capture condition information of at least one video frame.

10. The method of claim 9, wherein the camera capture condition information comprises at least one of focus information, white balance information, and expose information.

11. The method of claim 1, wherein the video frames form a plurality of video clips each having designated image registration information, and processing of the video frames uses one video clip as a unit.

12. A playback method of a video stream, comprising:

receiving a playback request for a selected scene;

searching the video stream for target video frames corresponding to image registration information of the selected scene, wherein the image registration information is used to transform different video frames into one coordinate system; and

performing a playback operation according to the target video frames found in the video stream.

13. The playback method of claim 12, wherein the step of performing the playback operation comprises:

performing an alignment operation upon video frames derived from the target video frames, and accordingly generating aligned video frames.

14. The playback method of claim 13, wherein the step of performing the playback operation further comprises:

performing the playback operation according to the aligned video frames.

15. The playback method of claim 13, wherein the step of performing the alignment operation upon the video frames derived from the target video frames comprises:

performing video capturing condition normalization upon the video frames according to camera capturing condition information of the target video frames.

16. The playback method of claim 15, wherein the camera capture condition information comprises at least one of focus information, white balance information, and expose information.

17. The playback method of claim 13, wherein the step of performing the alignment operation upon the video frames derived from the target video frames comprises:

performing viewing frame size normalization upon the video frames according to at least one of translate information, rotation information, and scale information of the target video frames.

18. The playback method of claim 17, wherein the viewing frame size normalization comprises:

cropping a video frame derived from a target video frame to generate a cropped video frame, wherein the video frame has a first resolution, and the cropped video frame has a second resolution lower than the first resolution.

19. The playback method of claim 12, wherein the playback request is generated in response to a desktop scrolling command, and the step of performing the playback operation comprises:

displaying a live wallpaper according to the target video frames.

20. The playback method of claim 12, wherein the step of performing the playback operation comprises:

generating mixed video frames by overlaying graphic data with video frames derived from the target video frames; and

performing the playback operation according to the mixed video frames.

21. The playback method of claim 19, wherein the graphic data is user interface (UI) data.

22. The playback method of claim 12, wherein the video stream transmits a plurality of video frames that form a plurality of video clips each having designated image registration information, and playback of the video stream uses one video clip as a unit.

23. An apparatus for recording a plurality of video frames, comprising:

a video processing circuit, arranged for generating a video stream according to the video frames; and

an information acquisition circuit, arranged for obtaining image registration information of the video frames, and recording the image registration information in the video stream, wherein the image registration information is used to transform different video frames into one coordinate system.

24. The apparatus of claim 23, wherein the information acquisition circuit assigns a scene number to at least one video frame to obtain the image registration information.

25. The apparatus of claim 23, wherein the information acquisition circuit assigns a coordinate to at least one video frame to obtain the image registration information.

26. The apparatus of claim 25, wherein a coordinate assigned to a beginning video frame among the video frames is at an origin.

27. The apparatus of claim 23, wherein the information acquisition circuit applies a global motion estimation upon adjacent video frames and accordingly generates global motion information to obtain the image registration information.

28. The apparatus of claim 23, wherein the information acquisition circuit obtains sensor information provided by at least one sensor disposed on an image capturing apparatus that generates the video frames to obtain the image registration information.

29. The apparatus of claim 23, wherein the information acquisition circuit obtains at least one of translate information, rotation information, and scale information of at least one video frame to obtain the image registration information.

30. The apparatus of claim 23, wherein the information acquisition circuit obtains camera capture condition information of at least one video frame to obtain the image registration information.

31. The apparatus of claim 30, wherein the camera capture condition information comprises at least one of focus information, white balance information, and expose information.