Systems and methods to present web image search results for effective image browsing

• US 7,548,936 B2
• Filed: 01/12/2005
• Issued: 06/16/2009
• Est. Priority Date: 01/12/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Liu, Hao, Ma, Wei-Ying, Xie, Xing, Li, Zhiwei
• Primary Examiner(s): Ly; Cheyne D
• Application Number:
  US11/034,443
• Publication Number:
  US 20060155684A1
• Time in Patent Office: 1,616 Days
• Field of Search: 707/104.1
• US Class Current: 1/1
• CPC Class Codes: G06F 16/54 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

Systems and methods to present web image search results for effective image browsing are described. In one aspect, task-based attention objects for each of multiple images associated with image search results are generated. Thumbnail images from respective ones of the images are created as a function of at least the task-based attention objects. The thumbnail images emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword associated with the search results.

Claims

1. A computer implemented method executed by a processor for presenting web image search results, the method comprising:

generating task-based attention objects for each of multiple images associated with image search results returned by a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or an expanded keyword associated with the search results;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein the mapping comprises positioning thumbnail images with similar task-based attention objects in close proximity to one another and positioning thumbnail images with a higher search engine rank in front of thumbnail images with a lower search engine rank; and

wherein the similarity is measured by;

VM_ij=α

RM_ij+(1−

α

)IM_ij, wherein IM is an image similarity matrix between an ith image (I_i) and a jth image (I_j), RM is a region similarity matrix between an attention region of I_i and I_j, and α

is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.

2. A method as recited in claim 1, wherein the mapping is configurable as a function of image overlap ratio.

3. A method as recited in claim 1, wherein the mapping is configurable as a function of a user specified image overlap ratio.

4. A method as recited in claim 1, further comprising:

receiving an indication that a user has selected a particular thumbnail image of the thumbnail images to view with respect to local detail and global context; and

responsive to receiving the indication;

identifying an original image of the images corresponding to the particular thumbnail image; and

mapping the original image and remaining ones of the image thumbnails to the 2-D space using a distorted polar coordinate system in view of a configurable distortion rate.

5. A tangible computer-readable data storage medium comprising computer-program instructions for presenting web image search results, wherein the computer-program instructions, are executed by a processor for:

generating task-based attention objects for each of multiple images associated with image search results returned by a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or an expanded keyword associated with the search results;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein the similarity is measured by;

VM_ij=α

RM_ij+(1−

α

)IM_ij, wherein IM is an image similarity matrix between an ith image (I_i) and a jth image (I_j), RM is a region similarity matrix between an attention region of I_i and I_j,and α

is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.

6. The tangible computer-readable data storage medium of claim 5, further comprising computer-program instructions executable by the processor for presenting the thumbnail images to the user for browsing.

7. The tangible computer-readable data storage medium of claim 5, wherein results of the computer-program instructions for mapping are configurable as a function of image overlap ratio.

8. The tangible computer-readable data storage medium of claim 5, wherein results of the computer-program instructions for mapping are configurable as a function of a user specified image overlap ratio.

9. The tangible computer-readable data storage medium of claim 5, further comprising computer-program instructions executable by the processor for:

receiving an indication that a user has selected a particular thumbnail image of the thumbnail images to view with respect to local detail and global context; and

responsive to receiving the indication;

identifying an original image of the images corresponding to the particular thumbnail image; and

mapping the original image and remaining ones of the image thumbnails to the 2-D space using a distorted polar coordinate system in view of a configurable distortion rate.

10. A computing device for presenting web image search results, the computing device comprising:

a processor; and

a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor for;

generating task-based attention objects for each of multiple images associated with image search results returned by a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword associated with the search results;

mapping the thumbnail images to a 2-D layout space for presentation to the user,

wherein the mapping comprises positioning thumbnail images with similar task-based attention objects in close proximity to one another and positioning thumbnail images with a higher search engine rank in front of thumbnail images with a lower search engine rank;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein the is similarity measured by;

VM_ij=α

RM_ij+(1−

α

)IM_ij, wherein IM is an image similarity matrix between an ith image (I_i) and a jth image (I_j), RM is a region similarity matrix between an attention region of I_i and I_j, and α

is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.

11. A computing device as recited in claim 10, wherein results of the computer-program instructions for mapping are configurable as a function of image overlap ratio.

12. A computing device as recited in claim 10, wherein results of the computer-program instructions for mapping are configurable as a function of a user specified image overlap ratio.

13. A computing device as recited in claim 10, further comprising computer-program instructions executable by the processor for:

receiving an indication that a user has selected a particular thumbnail image of the thumbnail images to view with respect to local detail and global context; and

responsive to receiving the indication;

identifying an original image of the images corresponding to the particular thumbnail image; and

mapping the original image and remaining ones of the image thumbnails to the 2-D space using a distorted polar coordinate system in view of a configurable distortion rate.

14. A computer implemented method executed by a processor for presenting web image search results, the method comprising:

generating task-based attention objects for each of multiple images associated with image search results from a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or an expanded keyword associated with the search results;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein each of the thumbnail images are fit into a grid while substantially maximizing original similarity relationships, and

wherein the similarity is measured by;

VM_ij=α

RM_ij+(1−

α

)IM_ij, wherein IM is an image similarity matrix between an ith image (I_i) and a jth image (I_j), RM is a region similarity matrix between an attention region of I_i and I_j, and α

is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.