MULTI-SCALE TIMELING PHOTOGRAPH ALBUM MANAGEMENT WITH INCREMENTAL SPECTRAL PHOTOGRAPH CLUSTERING

• US 20160125062A1
• Filed: 10/30/2014
• Published: 05/05/2016
• Est. Priority Date: 10/30/2014
• Status: Abandoned Application

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: JIANG, Wei, ZHANG, Dongqing, KARLSSON, Kolbeinn
• Application Number:
  US14/528,829
• Publication Number:
  US 20160125062A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

Described embodiments utilize a multi-scale timeline approach in which photographs in a photograph album are organized into photograph clusters associated with multiple timeline scales. Each photograph cluster can be represented on a display screen as a thumbnail indicator in a photograph album window for efficient browsing. The thumbnail indicator can comprise one or more images automatically selected to represent a large number of photographs from the photograph cluster. Activation of one of the thumbnail indicators can trigger a change to another timeline scale. A multi-scale timeline one-step incremental spectral photograph clustering algorithm can also be utilized to quickly add or delete photographs from the cluster photographs at multiple timeline scales with a complexity approaching O(n). Near-duplicate photographs can also be automatically detected based on both time and visual features, and collapsed to a single representation to save space on the relatively small display screens typically included in mobile devices.

Claims

1. An apparatus comprising:

a processor that automatically builds a plurality of photograph clusters that are associated with a plurality of timeline scales which are adjustable, wherein inclusion of a photograph in one of the plurality of photograph clusters is determined at least in part by a time an image is captured in the photograph and the plurality of timeline scales, the photograph is included in a photograph album and the processor initiates presentation of information associated with the photograph album in accordance with at least one of the plurality of photograph clusters;

a memory that stores information and instructions associated with a photograph album; and

a display that presents the information associated with the photograph album including a photograph album browse window, wherein the photograph album browse window includes at least one thumbnail indicator that is operable to trigger a switch from a first one of the plurality of photograph clusters associated with a first one of the plurality of timeline scales to at least a second one of the photograph clusters associated with a second one of plurality of timeline scales.

2. The apparatus of claim 1 wherein the apparatus is a mobile device.

3. The apparatus of claim 1 wherein the inclusion of the photograph in one of the plurality of photograph clusters is determined by a full photograph cluster process that includes spectral photograph clustering operations.

4. The apparatus of claim 3 wherein an additional photograph is included in the photograph album and inclusion of the additional photograph in the plurality of photograph clusters is determined by incremental photograph clustering operations.

5. The apparatus of claim 1 wherein the inclusion of the photograph in one of the plurality of photograph clusters is also determined at least in part by a proximity in time that an image is captured in another photograph included in the one of the plurality of photograph clusters.

6. The apparatus of claim 1 wherein the inclusion of the photograph in the one of the plurality of photograph clusters is also determined at least in part by visual content features of the photograph.

7. The apparatus of claim 1 wherein a photograph album browsing window is associated with the photograph album and the photograph browsing window includes at least one thumbnail indicator that is operable to trigger a switch from a first one of the plurality of photograph clusters configured in accordance with a first one of the plurality of timeline scales to at least a second one of the plurality of photograph clusters configured in accordance with a second one of the plurality of timeline scale.

8. The apparatus of claim 1 wherein at least one representative photograph is automatically selected from those included in the at least one of the plurality of photographs, and the at least one representative photograph is associated with the at least one thumbnail indicator.

9. The apparatus of claim 8 wherein the at least one representative photograph is associated with a photograph cluster.

10. The apparatus of claim 1 wherein a span of time is associated with one of the plurality of photograph clusters is adjustable.

11. A photograph clustering method in a mobile device, the method comprising:

receiving an indication to initiate a photograph cluster configuration in a processing device;

configuring photographs automatically into photograph clusters in response to receiving the indication to initiate photograph clustering, the configuring performed by the processing device in accordance with a first photograph clustering process, wherein the photograph clusters are associated with a plurality of timeline scales and which of the timeline scales is active is adjustable; and

reconfiguring automatically at least a first portion of the photograph clusters that is impacted by insertion of an additional photograph, wherein the reconfiguring is performed in accordance with a second photograph clustering process that is incrementally directed to the first portion of the photograph clusters without performing reconfiguration operations on a second portion of the plurality of photograph clusters that is not impacted by the insertion of the additional photograph.

12. The photograph clustering method of claim 11 enabling an alternative in which the first configuration process is a full photograph clustering process and the second configuration process is an incremental photograph clustering process.

13. The photograph clustering method of claim 11 enabling an alternative in which the first configuration process is a full spectral photograph clustering process and the second configuration process is an incremental spectral photograph clustering process.

14. The photograph clustering method of claim 11 enabling an alternative in which the second photograph clustering process is a one step incremental photograph clustering process in which an eigenvector is updated.

15. A mobile device comprising:

a processor that organizes a photograph album within a multi-scale timeline framework that includes a plurality of timeline scales, in which photographs of the photograph album are configured in a plurality of photograph clusters and granularity of a resulting configuration of the plurality of photograph clusters corresponds to the granularity of the plurality of timeline scales;

a memory configured to store information and instructions associated with a photograph album; and

a display configured to present a user interface in accordance with directions from the processor, wherein the user interface includes a thumbnail indicator configured to enable a user to initiate a switch between one of the plurality of timeline scales to another one of the plurality of timeline scales and correspondingly change association of the thumbnail indicator from one of the plurality of photograph clusters to another one of the plurality of photograph clusters.

16. The mobile device of claim 15 wherein the thumbnail indicator includes a photograph representative of at least some of the photographs included in a photograph cluster.

17. The mobile device of claim 16 wherein the photograph representative of at least some of the photographs included in one of the plurality of photographs photograph clusters is automatically selected based at least in part on time and content similarity to at least some of the photographs in the one of the plurality of photographs.

18. The mobile device of claim 15 wherein user interaction with the thumbnail indicator triggers a change of content presented on the display, including a change of the representative photograph included in the thumbnail indicator.

19. The mobile device of claim 15 wherein the display is configured to present a collapsed version of photographs included in at least one of the plurality of photograph cluster.

20. The mobile device of claim 15 wherein configuration of the plurality of photograph clusters includes an initial full photograph clustering process and an incremental photograph clustering process if a new photograph is added to or deleted from the photograph album.