Method and Device for Video Stitching

• US 20090257680A1
• Filed: 06/19/2007
• Published: 10/15/2009
• Est. Priority Date: 06/30/2006
• Status: Abandoned Application

• Current Assignee: NXP B.V. (NXP Semiconductors NV)
• Original Assignee: NXP B.V. (NXP Semiconductors NV)
• Inventors: Sukumaran, Srihari, Dhand, Harsh
• Application Number:
  US12/306,913
• Publication Number:
  US 20090257680A1
• Time in Patent Office: Days
• US Class Current: 382/284
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/32 using correlation-based methods

Abstract

A method and device for video stitching is presented. The invention determines one or more motion vectors indicative of changes in two consecutive images of a (video) sequence of images. It further determines a spatial correlation function by examining two images from two different videos obtained from adjacently placed cameras having an overlapping field of view and that are to be combined. The invention achieves a faster stitching of images by applying the correlation function for combining subsequent set/s of images, subject to a match value being in a predetermined range. The match-value is a value indicative of a change in the correlation function for the subsequent set of images that are to be combined. Said match value is determined according to sets of coordinate values which are indicative of an overlapping portion in the subsequent set of images that are to be combined and the correlation function. The sets of coordinate values are determined according to the motion vectors.

Claims

1. A method for generating a series of mosaic images from at least a first and a second series of images comprising the steps of:

a) obtaining a first motion vector from the first series of images and a second motion vector from the second series of images;

b) extracting a first set of coordinate values from a first image of the first series of images and a second set of coordinate values from a first image of the second series of images, wherein said first and second sets correspond to an overlapping portion of the first images;

c) obtaining a correlation function from said sets, said correlation function being indicative of a relation between coordinate values of the first images;

d) combining the first image of the first series of images and the first image of the second series of images using the correlation function;

e) updating the motion vectors using a second image of the first series and a second image of the second series, which second images follow the first images;

f) extracting the sets of coordinate values for the second images if at least one motion vector has a magnitude greater than a threshold value, else updating the sets of coordinate values using the motion vectors and the sets of coordinate values for the second images;

g) computing a match value using the sets of coordinate values and the correlation function;

h) if the match value is within a predetermined range of values,

combining the second image of the first series of images and the second image of the second series of images using the correlation function and,

repeating the method from step e onwards, wherein a consecutively following image of the second image of the first series takes the place of the second image of the first series and a consecutively following image of the second image of the second series takes the place of the second image of the second series and;

i) repeating the method from step b onwards, wherein the second image of the first series takes the place of the first image of the first series, and the second image of the second series takes the place of the first image of the second series.

2. The method as claimed in claim 1 wherein said predetermined value and said threshold value depend on a required quality of a mosaic image.

3. The method as claimed in claim 1 wherein the step of obtaining a motion vector includes the step of obtaining a first number of images from a series of images and determining an average change of coordinate values of a feature per image and/or determining an optical flow.

4. The method as claimed in claim 1 wherein the step of obtaining a correlation function includes the step of carrying out a random sample consensus algorithm.

5. A device comprising:

a processing unit having an input and an output, said device being arranged for receiving a two or more series of input images and provide one or more mosaic series of output images according to the method of claim 1.

6. The device according to claim 5, further comprising a communication facility for communicating input and/or output series of images.

7. A computer program product to be loaded by a computer arrangement, the computer arrangement comprising a processing unit and a memory, the computer program product comprising instructions for generating a series of mosaic images, and after being loaded, providing said processing unit with the capability to carry out the steps of claim 1.