Search system employing multiple image based search processing approaches

• US 8,892,588 B2
• Filed: 10/29/2012
• Issued: 11/18/2014
• Est. Priority Date: 05/13/2008
• Status: Expired due to Fees

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: Enpulz LLP
• Inventors: Bennett, James D.
• Primary Examiner(s): Pannala, Sathyanarayan
• Application Number:
  US13/662,807
• Publication Number:
  US 20130054562A1
• Time in Patent Office: 750 Days
• Field of Search: None
• US Class Current: 707/763
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

An Internet infrastructure supports searching of images by correlating a category selection with that of plurality of images hosted in Internet based servers in selected categories. An image search server supports delivery of search result pages to a client device based upon a search image or category selection, and contains images from a plurality of Internet based web hosting servers. The image search server delivers characteristic analysis of an image to the client device upon request. The selection of images is based upon: (i) word match, that is, by selecting images, titles of which correspond to the search image; and (ii) image correlation, that is, by selecting images, image characteristics of which correlates to that of category selection. The selection of images in the search result page also occurs on the basis of popularity. The category selection server also selects category based upon user'"'"'s choice.

Claims

1. An online search system that services both a plurality of web hosting servers and a plurality of user computing devices via an Internet, the online search system comprising:

a processing infrastructure that crawls each of the plurality of web hosting servers to gather a plurality of images, the first processing infrastructure associates at least one of a plurality of image characteristic with each of the plurality of images;

a communication interface through which a user interface setting and an uploaded search image are received by the processing infrastructure, the user interface setting identifying one of a first setting and a second setting; and

the processing infrastructure being operable to respond to the first setting identified via the user interface setting by attempting to match the uploaded search image with each of the plurality of images, and the processing infrastructure being operable to respond to the second setting identified via the user interface setting by (i) analyzing the uploaded search image to identify at least one image characteristic, and (ii) attempting to match the at least one image characteristic with the at least one of the plurality of image characteristics of the plurality of images so as to yield a group of visually similar images, wherein the processing infrastructure performs adult image filtering.

2. The online search system of claim 1, wherein the at least one of the plurality of image characteristics define a plurality of visual similarities.

3. The online search system of claim 1, wherein at least a first of the plurality of image characteristics define a visual image type.

4. The online search system of claim 3, wherein the visual image type includes a graphics image type.

5. The online search system of claim 3, wherein the visual image type includes an architectural image type.

6. The online search system of claim 3, wherein the visual image type includes a portrait image type.

7. The online search system of claim 3, wherein the visual image type includes a cartoon image type.

8. The online search system of claim 3, wherein the visual image type includes a landscape image type.

9. An online search system that services both a plurality of web hosting servers and a plurality of user computing devices via an Internet, the online search system comprising:

a processing infrastructure configured to crawl each of the plurality of web hosting servers to gather a plurality of images, the processing infrastructure associates at least one of a plurality of image characteristic with each of the plurality of images;

a communication interface through which a user interface setting and an uploaded search image are received by the processing infrastructure, the user interface setting identifying one of a first setting and a second setting; and

the processing infrastructure configured to respond to the first setting identified via the user interface setting by attempting to match the uploaded search image with each of the plurality of images, and the processing infrastructure configured to respond to the second setting identified via the user interface setting by (i) analyzing the uploaded search image to identify at least one image characteristic, and (ii) attempting to match the at least one image characteristic with the at least one of the plurality of image characteristics of the plurality of images so as to yield a group of visually similar images, wherein the generation of the search results is based in part on a comparison process associated with text data associated with each of the plurality of images.

10. An online search system that gathers a plurality of images from a plurality of web hosting servers in a crawling process, the online search system comprising:

a communication interface which receives first search request data and second search request data, the first search request data relating to a first uploaded search image, and the second search request data relating to both a second uploaded search image and related user setting data;

a processing infrastructure that responds to the first search request data by attempting to match first uploaded search image with each of the plurality of images; and

the processing infrastructure responds to the second search request data by analyzing the second uploaded search image and, based on the analysis, producing a search results which includes images with visual characteristic similarities corresponding to the second uploaded search image, wherein the generation of the search results is based in part on a comparison process associated with text data associated with each of the plurality of images.

11. The online search system of claim 10, wherein the visual characteristic similarities being associated with graphic images.

12. The online search system of claim 10, wherein the visual characteristic similarities being associated with architectural images.

13. The online search system of claim 10, wherein the visual characteristic similarities being associated with portrait images.

14. The online search system of claim 10, wherein the visual characteristic similarities being associated with cartoon images.

15. The online search system of claim 10, wherein the visual characteristic similarities being associated with landscape images.

16. An online search system that gathers a plurality of images from a plurality of web hosting servers in a crawling process, the online search system comprising:

a communication interface which receives first search request data and second search request data, the first search request data relating to a first uploaded search image, and the second search request data relating to both a second uploaded search image and related user setting data;

a processing infrastructure that responds to the first search request data by using the first uploaded search image in a first process that yields first image based search results; and

the processing infrastructure that responds to the second search request data by using the second uploaded search image in a second process that yields second image based search results, the second process being different from the first process, wherein the second process is based in part on a comparison process associated with text data associated with each of the plurality of images.

17. The online search system of claim 16, wherein the second search results comprises at least a reference to first images of the plurality of images, the first images and the second uploaded search image having at least one common characteristic.

18. The online search system of claim 17, wherein the at least one common characteristic being common to graphic images.

19. The online search system of claim 17, wherein the at least one common characteristic being common to cartoon images.

20. The online search system of claim 17, wherein the at least one common characteristic being common to landscape images.

21. The online search system of claim 17, wherein the at least one common characteristic being common to portrait images.

22. The online search system of claim 17, wherein the at least one common characteristic being common to architectural images.

23. A method performed by an online search system that gathers a plurality of images from a plurality of web hosting servers in a crawling process, the online search system comprising:

receiving first search request data and second search request data, the first search request data relating to a first uploaded search image, and the second search request data relating to both a second uploaded search image and related user setting data;

responding to the first search request data by using the first uploaded search image in a first process that yields first image based search results; and

responding to the second search request data by using the second uploaded search image in a second process that yields second image based search results, the second process being different from the first process, wherein the second process is based in part on a comparison process associated with text data associated with each of the plurality of images.

24. The method of claim 23, wherein the second image based search results comprises at least a reference to a plurality of first images of the plurality of images, the first images and the second uploaded search image having at least one common characteristic.

25. The method of claim 24, wherein the at least one common characteristic being common to graphic images.

26. The method of claim 24, wherein the at least one common characteristic being common to cartoon images.

27. The method of claim 24, wherein the at least one common characteristic being common to landscape images.

28. The method of claim 24, wherein the at least one common characteristic being common to portrait images.

29. The method of claim 24, wherein the at least one common characteristic being common to architectural images.