Method and apparatus for photograph finding

• US 7,844,141 B2
• Filed: 12/01/2008
• Issued: 11/30/2010
• Est. Priority Date: 02/12/2004
• Status: Active Grant

• Current Assignee: Intellectual Ventures I LLC (Intellectual Ventures LLC)
• Original Assignee: Hoshiko LLC (Raoul Management LLC)
• Inventors: Shuster, Gary Stephen
• Primary Examiner(s): Kassa; Yosef
• Application Number:
  US12/325,589
• Publication Number:
  US 20090083236A1
• Time in Patent Office: 729 Days
• Field of Search: 382/209, 382/218, 382/219, 382/305, 382/307
• US Class Current: 382/305
• CPC Class Codes: G06F 16/38 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

Digital image data including discrete photographic images of a variety of different subjects, times, and so forth, are collected and analyzed to identify specific features in the photographs. In an embodiment of the invention, distinctive markers are distributed to aid in the identification of particular subject matter. Facial recognition may also be employed. The digital image data is maintained in a database and quarried in response to search requests. The search requests include criteria specifying any feature category or other identifying information, such as date, time, and location that each photograph was taken, associated with each photograph. Candidate images are provided for review by requesters, who may select desired images for purchase or downloading.

Claims

1. A computer-implemented method, comprising:

collecting digital image data comprising a plurality of discrete photographic images in digital form;

collecting source information for each of the plurality of discrete photographic images;

analyzing the digital image data to assign descriptions of objects appearing in each of the plurality of discrete photographic images;

providing the digital image data for storage in a database in association with the source information and the assigned descriptions of objects appearing in the images;

receiving requests to search the digital image data, wherein the requests comprise search criteria specifying descriptions of objects; and

serving responses to the requests, the responses comprising identifiers for discrete photographic images in the database at least partially matching the search criteria.

2. The method of claim 1, wherein the source information comprises a time and a location that each of the discrete photographic images was first generated.

3. The method of claim 1, further comprising querying the database to identify the discrete photographic images at least partially matching the search criteria.

4. The method of claim 1, wherein analyzing the digital image data further comprises identifying facial characteristics of persons imaged in the digital image data.

5. The method of claim 1, further comprising electronically distributing a plurality of distinctive markers to contributors of the digital image data configured for printing on remote printers to provide distinctive marking signs for placing with subject matter to be photographed to create the digital image data.

6. The method of claim 5, wherein analyzing the digital image data further comprises identifying the distinctive markers when present in the digital image data.

7. The method of claim 5, further comprising searching the database using at least one object description included in the assigned descriptions specifying a selected one of the distinctive markers.

8. The method of claim 1, wherein further comprising searching the database using at least one object description included in the assigned descriptions specifying a personal identifying characteristic.

9. The method of claim 1, further comprising distributing a plurality of distinctive optical markers configured for placing with subject matter to be photographed to create the digital image data, each of the markers marked with optically encoded identifying data and having a predetermined appearance to facilitate computer recognition of the each of the markers in photographic image data.

10. The method of claim 9, further comprising recording predetermined appearances of each of the distinctive optical markers for use in analyzing the digital image data.

11. The method of claim 10, further comprising automatically analyzing the digital image data to detect any of the distinctive optical markers by comparison with the recorded predetermined appearances.

12. The method of claim 9, further comprising reading the identifying data encoded on images of the distinctive optical markers detected in the digital image data.

13. The method of claim 12, further comprising providing the digital image data for storage in the database in association with the identifying data encoded on the distinctive optical markers detected in the digital image data.

14. The method of claim 13, further comprising searching the database using at least one object description included in the assigned descriptions specifying the identifying data.

15. The method of claim 9, further comprising electronically transmitting the plurality of distinctive optical markers configured for printing on remote printers operated by remote clients.

16. A system, comprising:

a server having a memory holding an application, wherein the application is configured for;

collecting digital image data comprising a plurality of discrete photographic images in digital form;

collecting source information for each of the plurality of discrete photographic images;

analyzing the digital image data to assign descriptions of objects appearing in each of the plurality of discrete photographic images;

providing the digital image data for storage in a database in association with the source information and the assigned descriptions of objects appearing in the images;

receiving requests to search the digital image data, wherein the requests comprise search criteria specifying descriptions of objects; and

serving responses to the requests, the responses comprising identifiers for discrete photographic images in the database at least partially matching the search criteria.

17. The system of claim 16, wherein the application is further configured for identifying facial characteristics of persons imaged in the digital image data.

18. The system of claim 16, wherein the application is further configured for serving a plurality of distinctive markers configured for printing on remote printers for providing distinctive marking signs for placing with subject matter to be photographed to create the digital image data.

19. The system of claim 18, wherein the application is further configured for identifying the distinctive markers when present in the digital image data.

20. The system of claim 16, wherein the application is further configured for searching the database using at least one object description included in the assigned descriptions specifying a personal identifying characteristic.

21. A computer-implemented method, comprising:

analyzing digital image data associated with a plurality of photographic images to identify feature information present in respective photographic images;

providing the digital image data for storage in a data structure in association with the respective identified feature information;

receiving requests to access the digital image data, wherein the requests comprise search criteria corresponding to categories of the feature information;

providing responses to the requests, the responses comprising identifiers for discrete photographic images in the data structure at least partially matching the search criteria.

22. The method of claim 21, wherein the feature information comprises facial characteristics of persons imaged in the digital image data.

23. The method of claim 22, wherein the search criteria comprises facial characteristics of users associated with the requests.

24. The method of claim 21, further comprising collecting source information for each image file included in the digital image data.

25. The method of claim 24, wherein the source information comprises a time and a location that each image file was first generated.

26. The method of claim 21, further comprising querying the data structure to identify the discrete photographic images.

27. The method of claim 21, further comprising distributing a plurality of distinctive markers to contributors of the digital image data.

28. The method of claim 27, wherein the analyzing step further comprises identifying the distinctive markers when present in the plurality of photographic images.

29. The method of claim 28, wherein the receiving requests step further comprises receiving search criteria specifying selected ones of the distinctive markers.

30. The method of claim 21, wherein the receiving requests step further comprises receiving search criteria specifying a specific public event occurring at a specified date and location.

31. A system, comprising:

a server having a memory holding an application, wherein the application is configured to;

analyze digital image data associated with a plurality of photographic images to identify feature information present in respective photographic images;

provide the digital image data for storage in a data storage in association with the respective identified feature information;

receive requests to access the digital image data, wherein the requests comprise search criteria corresponding to categories of the feature information;

provide responses to the requests, the responses comprising identifiers for discrete photographic images in the data storage at least partially matching the search criteria.

32. The system of claim 31, wherein the application is further configured for identifying facial characteristics of persons imaged in the digital image data.

33. The system of claim 31, wherein the search criteria comprises facial characteristics of users associated with the requests.

34. The system of claim 31, wherein the application is further configured for serving a plurality of distinctive markers configured for printing on remote printers for providing distinctive marking signs for placing with subject matter to be photographed to create the digital image data.

35. The system of claim 34, wherein the application is further configured for identifying the distinctive markers when present in the digital image data.

36. An article of manufacture including a computer-readable medium having instructions stored thereon that, if executed by a computing system, cause the computing system to perform operations comprising:

collecting digital image data comprising a plurality of discrete photographic images in digital form;

collecting source information for each of the plurality of discrete photographic images;

analyzing the digital image data to assign descriptions of objects appearing in each of the plurality of discrete photographic images;

providing the digital image data for storage in a data storage in association with the source information and the assigned descriptions of objects appearing in the images;

receiving requests to search the digital image data, wherein the requests comprise search criteria specifying descriptions of objects; and

serving responses to the requests, the responses comprising identifiers for discrete photographic images in the database at least partially matching the search criteria.

37. The article of manufacture of claim 36, wherein the operations further comprise identifying facial characteristics of persons imaged in the digital image data.

38. The article of manufacture of claim 36, wherein the operations further comprise serving a plurality of distinctive markers configured for printing on remote printers for providing distinctive marking signs for placing with subject matter to be photographed to create the digital image data.

39. The article of manufacture of claim 38, wherein the operations further comprise identifying the distinctive markers when present in the digital image data.

40. Article of manufacture of claim 36, wherein the operations further comprise searching the data storage using at least one object description included in the assigned descriptions specifying a personal identifying characteristic, to locate the at least one image file in the digital image data.

42. The article of manufacture of claim 36, wherein the operations further comprise identifying facial characteristics of persons imaged in the digital image data.

43. The article of manufacture of claim 36, wherein the search criteria comprises facial characteristics of users associated with the requests.

44. The article of manufacture of claim 36, wherein the operations further comprise serving a plurality of distinctive markers configured for printing on remote printers for providing distinctive marking signs for placing with subject matter to be photographed to create the digital image data.

45. The article of manufacture of claim 44, wherein the operations further comprise identifying the distinctive markers when present in the digital image data.

41. An article of manufacture including a computer-readable medium having instructions stored thereon that, if executed by a computing system, cause the computing system to perform operations comprising:

analyzing digital image data associated with a plurality of photographic images to identify feature information present in respective photographic images;

providing the digital image data for storage in a data structure in association with the respective identified feature information;

receiving requests to access the digital image data, wherein the requests comprise search criteria corresponding to categories of the feature information;

providing responses to the requests, the responses comprising identifiers for discrete photographic images in the data structure at least partially matching the search criteria.