System and method for acquisition of related graphical material in a digital graphics album

• US 6,813,618 B1
• Filed: 08/18/2000
• Issued: 11/02/2004
• Est. Priority Date: 08/18/2000
• Status: Expired due to Term

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: Loui, Alexander C., Cok, David R., Judice, Charles N.
• Primary Examiner(s): Homere, Jean R.
• Assistant Examiner(s): Wong, Leslie
• Application Number:
  US09/642,534
• Time in Patent Office: 1,537 Days
• Field of Search: 707/10, 707/102, 707/104.1, 707/2-5, 704/9, 709/203, 709/219, 345/810
• US Class Current: 1/1
• CPC Class Codes: G06F 16/54 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

Reference material in a digital graphics album is specified. Annotation data is extracted from the reference material and may be processed by a natural language processor to produce search keywords. In addition to the keywords, user directives may be provided, both of which are used to conduct a search for related graphical materials. The search is conducted by querying a graphical material database through a network connection. The search results are received and the user can select from the resultant materials for inclusion in the digital graphics album. If no satisfactory material is found, the user can specify a reference graphical image that is processed to produce search criteria that are image content descriptors. The database is again queried in accordance with these descriptors to provide search results for possible inclusion.

Claims

1. A system for adding graphical material to a digital graphics album having a plurality of digital images, comprising:

means for displaying said digital graphics album;

means for specifying a user selection of said digital images during said displaying, to define reference material in said digital graphics album;

means for processing said reference material to produce prioritized search criteria data that is extracted from the reference material;

means for receiving user directive data;

means for processing said received directive data by a natural language processor to produce additional keywords;

means for prioritizing said keywords and said additional keywords;

means for querying a graphical material database through a network connection in accordance with said prioritized keywords;

means for receiving from said database at least one resultant graphical material;

means for upon not selecting said at least one resultant graphical material, automatically processing said reference material to produce search criteria that are image content descriptors of said reference material;

means for querying a graphical material database in accordance with said search criteria data;

means for receiving from said database at least one resultant graphical material; and

means for inserting said resultant graphical material in the digital graphics album.

2. A system of claim 1 further comprising:

means for selecting at least one of said at least one resultant graphical material.

3. The system of claim 1 and wherein said means for querying is an Internet connection to a private graphical material database.

4. The system of claim 1 wherein said resultant graphical material is a reduced resolution graphical material, further comprising:

means for transferring a full resolution graphical material from said graphical material database in accordance with said reduced resolution graphical material for use as said selected resultant graphical material by said meana means for inserting.

5. The system of claim 1 wherein:

said album has a plurality of digital images and associated annotations,

said means for displaying displays said annotations during said specifying,

said reference material includes respective said annotations.

6. The system of claim 5 and wherein said means for processing utilizes a natural language processor to process said annotations of said reference material.

7. The system of claim 6 and wherein said search criteria data are indicative of the who, what, where, when, or why aspects of said annotations.

8. The system of claim 6 and wherein:

said means for processing processes respective said annotations of said reference material to produce prioritized keywords, and

said search criteria data further comprises said prioritized keywords.

9. The system of claim 5 wherein:

said means for processing processes respective said annotations of said reference material to produce keywords, and further comprising;

means for receiving user directives;

means for processing said received directives to produce additional keywords, and prioritizing said keywords and said additional keywords to provide a set of prioritized keywords;

wherein said search criteria data is said set of prioritized keywords.

10. The system of claim 1 and wherein said reference material includes respective said digital images.

11. The system of claim 10 and wherein said search criteria data are image content descriptors.

12. The system of claim 11 and wherein said means for querying employs an Internet connection to a private graphical material database which is indexed by image content descriptors.

13. The system of claim 10 wherein said album includes a plurality of annotations associated with said digital images, said reference material includes respective said annotations, and said search criteria data are keywords extracted from said annotations of said reference material.

14. The system of claim 13 and wherein said means for processing utilizes a natural language processor to process said annotations of said reference material.

15. The system of claim 14 further comprising:

means for receiving user directives;

means for processing said received directives to produce additional keywords, and

means for prioritizing said keywords and said additional keywords to more narrowly define said querying.

16. The system of claim 14 and wherein said search criteria data are indicative of the who, what, where, when, or why aspects of said annotations.

17. The system of claim 1 and wherein said album includes at least one video clip and said reference material includes a video clip key frame of said video clip.

18. The system of claim 17 and wherein said search criteria data are image content descriptors of said video clip key frame.

19. The system of claim 18 and wherein said means for querying employs an Internet connection to a private graphical material database which is indexed by image content descriptors.

20. The system of claim 17 wherein said video clip key frame has an associated annotation;

and said search criteria data are keywords extracted from said annotation.

21. The system of claim 20 and wherein said means for processing utilizes a natural language processor to process said annotation.

22. The system of claim 20 further comprising:

means for receiving user directives;

means for processing said received directives to produce additional keywords, and

means for prioritizing said keywords and said additional keywords to more narrowly define said querying.

23. The system of claim 21 and wherein said search criteria data are indicative of the who, what, where, when, or why aspects of said annotation.

24. A digital graphics albuming system for searching a graphical material database;

comprising;

a display;

an input device;

a network interface;

a memory;

a processor coupled to said display, said input device, said network interface and said memory, and wherein

said processor is operable to recall and display a plurality of graphical materials of a digital graphics album on said display, and said processor is operable to receive a user selection of one or more of said graphical materials, during said display, to define reference material, and said processor is operable to produce a list of prioritized search criteria that is extracted from said reference material said processor is operable to receive user directive data, process said received directive data by a natural language processor to produce additional keywords, prioritize said keywords and said additional keywords, query a graphical material database through a network connection in accordance with said prioritized keywords, receive from said database at least one resultant graphical material and upon not selecting said at least one resultant graphical material, automatically processing said reference material to produce search criteria that are image content descriptors of said reference material, and said processor is operable to couple said search criteria to said network interface, and said processor is operable to receive and display said at least one resultant graphical material from said network interface, and to receive a selection input specifying at least one of said at least one resultant graphical material from said input device, and said processor is operable to store said selected resultant graphical material in said memory as a part of said digital graphics album.

25. The system of claim 24 and wherein said network interface is an Internet network interface.

26. The system of claim 24 and wherein resultant graphical material is a reduced resolution graphical material, and said processor is operable to receive a full resolution graphical material from said graphical material database through said network interface in accordance with said reduced resolution graphical material, and said processor is operable to store said full resolution graphical material in said memory as a part of said digital graphics album.

27. The system of claim 24 and wherein

said album has a plurality of digital images and associated annotations,

said means for displaying displays said annotations during said specifying,

said reference material includes respective said annotations.

28. The system of claim 27 and wherein said processor is operable as a natural language processor to process said said annotations of said reference material to produce search criteria that are search keywords.

29. The system of claim 27 and wherein said processor is operable to process respective said annotations of said reference material to produce keywords and to receive user directives from said input device, and said processor is operable to process said user directives to produce additional keywords, and said processor is operable to prioritize said keywords and said additional keywords to provide a set of prioritized keywords;

and

wherein said list of prioritized search criteria is said set of prioritized keywords.

30. The system of claim 24 and wherein said reference material includes respective said digital images.

31. The system of claim 30 and wherein said processor is operable to process said digital image of said reference material to produce image content descriptors.

32. The system of claim 30 and wherein said album includes a plurality of annotations associated with said digital images, said reference material includes respective said annotations, said processor is operable as a natural language processor to process said annotations of said reference material to produce search criteria that are search keywords.

33. The system of claim 32 and wherein said processor is operable to receive user directives from said input device, and said processor is operable to process said user directives to produce additional keywords, and said processor is operable to prioritized said search keywords and said additional keywords.

34. The system of claim 24 and wherein said album includes at least one video clip and said reference material includes a video clip key frame of said video clip.

35. The system of claim 34 and wherein said processor is operable to process said video clip key frame to produce image content descriptors of said video clip key frame.

36. The system of claim 35 and wherein said video clip key frame has an associated annotation and said processor is operable as a natural language processor to process said annotation to produce search criteria data that are keywords.

37. The system of claim 36 and wherein said processor is operable to receive user directives from said input device, and said processor is operable to process said user directives to produce additional keywords, and said processor is operable to prioritized said search keywords and said additional keywords.

38. A method of adding graphical material to a digital graphics album, comprising the steps of:

displaying a plurality of graphical materials of the digital graphics album;

during said displaying, specifying a user selection of said graphical materials to define reference material in said digital graphics album;

processing said reference material to produce a list of prioritized search criteria data that is extracted from said reference material;

receiving user directive data;

processing said received directive data by a natural language processor to produce additional keywords;

prioritizing said keywords and said additional keywords;

querying a graphical material database through a network connection in accordance with said prioritized keywords;

receiving from said database at least one resultant graphical material;

upon not selecting said at least one resultant graphical material, automatically processing said reference material to produce search criteria that are image content descriptors of said reference material;

querying a graphical material database in accordance with said search criteria data;

receiving from said database at least one resultant graphical material, responsive to said querying; and

inserting said resultant graphical material in the digital graphics album.

39. The method of claim 38 further comprising the step of:

selecting at least one of said at least one resultant graphical materials for insertion.

40. The method of claim 38 and wherein said querying step is accomplished through an Internet connection to a private graphical material database.

41. The method of claim 38 wherein said resultant graphical material is a reduced resolution graphical material, further comprising the step of:

transferring a full resolution graphical material from said graphical material database in accordance with said reduced resolution graphical material for use as said selected resultant graphical material in said inserting step.

42. The method of claim 38 wherein:

said album has a plurality of digital images and associated annotations,

said displaying of said annotations is during said specifying, and

said reference material includes respective said annotations.

43. The method of claim 42 and wherein said processing step utilizes a natural language processor to process said annotations of said reference material.

44. The method of claim 43 and wherein said search criteria data are indicative of the who, what, where, when, or why aspects of said annotations.

45. The method of claim 43 and wherein:

said processing step processes respective said annotations of said reference material to produce prioritized keywords, and

said search criteria data further comprises said prioritized keywords.

46. The method of claim 42 wherein:

said processing processes respective said annotations of said reference material to produce keywords, and further comprising the steps of;

receiving user directives;

processing said received directives to produce additional keywords; and

prioritizing said keywords and said additional keywords provide a set of prioritized keywords;

wherein said search criteria data is said set of prioritized keywords.

47. The method of claim 39 and wherein said reference material includes respective said digital images.

48. The method of claim 47 and wherein said search criteria are image content descriptors.

49. The method of claim 48 and wherein said querying step is accomplished through an Internet connection to a private graphical material database which is indexed by image content descriptors.

50. The method of claim 47 wherein said album includes a plurality of annotations associated with said digital images, said reference material includes respective said annotations, and said search criteria data are keywords extracted from said annotations of said reference material.

51. The method of claim 50 and wherein said processing step utilizes a natural language processor to process said annotations of said reference material.

52. The method of claim 51 further comprising the steps of:

receiving user directives;

processing said received directives to produce additional keywords; and

prioritizing said keywords and said additional keywords to more narrowly define said querying step.

53. The method of claim 51 and wherein said search criteria data are indicative of the who, what, where, when, or why aspects of said annotations.

54. The method of claim 38 and wherein said album includes at least one video clip and said reference material includes a video clip key frame of said video clip.

55. The method of claim 54 and wherein said search criteria are image content descriptors of said video clip key frame.

56. The method of claim 55 and wherein said querying step is accomplished through an Internet connection to a private graphical material database which is indexed by image content descriptors.

57. The method of claim 54 wherein said video clip key frame has an associated annotation, and said search criteria data are keywords extracted from said annotation.

58. The method of claim 57 and wherein said processing step utilizes a natural language processor to process said annotation.

59. The method of claim 57 further comprising the steps of:

receiving user directives;

processing said received directives to produce additional keywords; and

prioritizing said keywords and said additional keywords to more narrowly define said querying step.

60. The method of claim 58 and wherein said search criteria data are indicative of the who, what, where, when, or why aspects of said annotation.

61. A method of adding graphical material to a digital graphics album;

comprising the steps of;

specifying reference material in a digital graphics album;

extracting annotation data from said reference material;

processing said extracted annotation data by a natural language processor to produce search keywords;

receiving user directive data;

processing said received directive data by a natural language processor to produce additional keywords;

prioritizing said keywords and said additional keywords;

querying a graphical material database through a network connection in accordance with said prioritized keywords;

receiving from said database at least one resultant graphical material;

upon not selecting said at least one resultant graphical material, automatically processing said reference material to produce search criteria that are image content descriptors of said reference material;

querying an image content database through a network connection in accordance with said image content descriptors;

receiving from said image content database at least one resultant image;

selecting at least one of said at least one resultant image; and

inserting said selected resultant image in the digital graphics album.