User interface for viewing clusters of images

• US 10,120,883 B2
• Filed: 06/15/2016
• Issued: 11/06/2018
• Est. Priority Date: 01/23/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Jing, Feng, Zhang, Lei, Li, Ming Jing, Ma, Wei-Ying, Deng, Kefeng
• Primary Examiner(s): Duong, Hien L
• Application Number:
  US15/183,712
• Publication Number:
  US 20160357741A1
• Time in Patent Office: 874 Days
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/54 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

Method and system for providing a user interface for presenting images of clusters of an image search result is provided. The user interface system displays the search result in a cluster/view form using a cluster panel and a view panel. The cluster panel contains a cluster area for each cluster. The view panel may contain thumbnails of images of the search result in a list view or a mix view. When a user selects a cluster area from the cluster panel, the user interface system displays a list view of thumbnails for that cluster in the view panel. The user interface system may display a thumbnail list near a cluster area of the cluster panel. The thumbnail list contains mini-thumbnails of the images of the selected cluster. The user interface system may also display a detail view of an image in the view panel when a user selects an image.

Claims

1. A computing device for presenting an image search result having clusters of images, the computing device comprising:

a memory storing computer-executable instructions that when executed;

receive an image search query;

identify an image search result of images that are relevant to the image search query, each image having a relevance score indicating relevance of the image to the image search query;

the images being organized into clusters;

display in a cluster panel a cluster indication of each cluster, the cluster indication for a cluster including thumbnails of multiple images from the cluster, the cluster indications being ordered based on relevance of the images in the cluster to the image search query; and

display in a view panel thumbnails of images from multiple clusters of the image search result, the thumbnails of images displayed in the view panel being ordered based on relevance of the images to the image search query, wherein the respective thumbnails include functionality to display an image corresponding to a respective thumbnail in a detail view in the view panel upon user selection of the respective thumbnail;

wherein the cluster panel and the view panel are displayed simultaneously, and

a processor that executes the computer-executable instructions stored in the memory.

2. The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed:

when in list view, when a user selects a cluster indication, display in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication.

3. The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed:

when in list view, when a user selects a cluster indication, display adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication.

4. The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed:

when in list view,

when a user selects a cluster indication using a first selection, display in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication; and

when a user selects a cluster indication using a second selection, display adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication.

5. The computing device of claim 4 wherein the computer-executable instructions further include instructions that when executed:

display along with the detail view a thumbnail scroll list of the thumbnails of the view panel when the user selected the thumbnail.

6. The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed:

when in a mix view, display in the view panel thumbnails of the images of the clusters in which the images of all the clusters are ordered into a combined ordering such that the most relevant image taken from each cluster are listed first in the combined ordering followed by a listing of the second most relevant image taken from each cluster in the combined ordering, wherein the other images of all the clusters are further listed in the combined ordering in an order based on relevance of each image within its cluster.

7. A method performed by a computing device to present an image search result having clusters of images, the method comprising:

receiving an image search query;

identifying an image search result of images that are relevant to the image search query, each image having a relevance score indicating relevance of the image to the image search query, the images being organized into clusters;

displaying in a cluster panel a cluster indication of each cluster, the cluster indication for each cluster including thumbnails of multiple images from that cluster, the cluster indications being ordered based on relevance of the images in the cluster to the image search query; and

displaying in a view panel thumbnails of images of one or more clusters wherein the cluster panel and the view panel are displayed simultaneously, wherein the respective thumbnails include functionality to display an image corresponding to a respective thumbnail in a detail view in the view panel upon user selection of the respective thumbnail.

8. The method of claim 7 wherein when in list view and, when a user selects a cluster indication, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication.

9. The method of claim 7 wherein when in a mix view, displaying in the view panel thumbnails of the images of the clusters in which the images of all the clusters are ordered into a combined ordering such that the most relevant image taken from each cluster are listed first in the combined ordering followed by a listing of the second most relevant image taken from each cluster in the combined ordering, wherein the other images of all the clusters are further listed in the combined ordering in an order based on relevance of each image within its cluster.

10. The method of claim 7 wherein when in list view,

when a user selects a cluster indication using a first selection, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication;

and

when a user selects a cluster indication using a second selection, displaying adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication.

11. The method of claim 10 wherein including displaying along with the detail view a thumbnail scroll list of the thumbnails of the view panel when the user selected the thumbnail.

12. The method of claim 7 wherein when in list view and;

when a user selects a cluster indication, displaying adjacent to the selected duster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication.

13. The method of claim 11 wherein the thumbnails of the view panel are ordered based on relevance of the images to the image search query.

14. A method performed by a computing device for presenting an image search result having clusters of images, the method comprising:

storing in a store an image search result of images that are relevant to an image search query, each image having a relevance score indicating relevance of the image to the image search query, the images being organized into clusters;

displaying in a cluster panel a cluster indication of each cluster, the cluster indication of a cluster including thumbnails of multiple images from the cluster, the cluster indications are ordered based on relevance of the images in the cluster to the image search query; and

when in a mix view, displaying in the view panel thumbnails of the images of the clusters in which the images of all the clusters are ordered in a combined ordering such that the most relevant image of each cluster is listed first in the combined ordering followed by a listing of the second most relevant image of each cluster.

15. The method of claim 14 including when in list view and when a user selects a cluster indication, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication.

16. The method of claim 14 including when in list view and when a user selects a cluster indication, displaying adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication.

17. The method of claim 14 including when in list view,

when a user selects a cluster indication using a first selection, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication;

and

when a user selects a cluster indication using a second selection, displaying adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication.

18. The method of claim 14 including when in list view, when a user selects a thumbnail of an image, displaying in the view panel a detailed view of that image.

19. The method of claim 18 including displaying along with the detail view a thumbnail scroll list of the thumbnails of the view panel when the user selected the thumbnail.

20. The method of claim 14 wherein the cluster indications are ordered based on relevance of the images in the cluster to the image search query and the thumbnails of the view panel are ordered based on relevance of the images to the image search query.