ALIGNING AND ANNOTATING DIFFERENT PHOTO STREAMS

• US 20120114307A1
• Filed: 11/09/2010
• Published: 05/10/2012
• Est. Priority Date: 11/09/2010
• Status: Abandoned Application

• Current Assignee: Kodak Alaris Inc (KPP (no. 2) Trustees Ltd.)
• Original Assignee: Kodak Alaris Inc (KPP (no. 2) Trustees Ltd.)
• Inventors: Yang, Jianchao, Luo, Jiebo
• Application Number:
  US12/942,422
• Publication Number:
  US 20120114307A1
• Time in Patent Office: Days
• US Class Current: 386/278
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/70 of video data

Abstract

A method for organizing and annotating individual collections of images or videos captured for the same event by different cameras into a master collection, wherein each individual collection forms a media stream in chronological order, includes using a processor to provide the following steps: extracting image features for each image or video of the media stream of each individual collection; analyzing the extracted features to align the media streams in chronological order of the event over a common timeline; transferring annotation from one individual collection to another individual collection based on alignment of the media streams; and storing, displaying or transmitting the transferred annotation.

Claims

1. A method for organizing and annotating individual collections of images or videos captured for the same event by different cameras into a master collection, wherein each individual collection forms a media stream in chronological order, comprising:

(a) extracting image features for each image or video of the media stream of each individual collection;

(b) analyzing the extracted features to align the media streams in chronological order of the event over a common timeline;

(c) transferring annotation from one individual collection to another individual collection based on alignment of the media streams; and

(d) storing, displaying or transmitting the transferred annotation.

2. A method of claim 1, wherein step a) further includes extracting geo-location tags or other textual tags associated to each image or video as additional features.

3. A method of claim 1, wherein the graph is a bi-partite graph.

4. A method of claim 1, wherein the image features included color histogram, gist, or locality-constrained linear coding features.

5. A method of claim 1, wherein step (d) includes using max linkage selection to prune edges on the graph if a node has multiple edges linked to other nodes.

6. A method of claim 1, wherein the transferred annotation includes user provided tags.

7. A method of claim 1, wherein the transferred annotation includes machine computed tags.

8. A method of claim 1, wherein the transferred annotation includes geotags.