System for managing multimedia objects

• US 6,301,586 B1
• Filed: 10/06/1997
• Issued: 10/09/2001
• Est. Priority Date: 10/06/1997
• Status: Expired due to Term

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Lavendel, Laurence, Tomat, Andrew H., Yang, Xinping, Kohler, Timothy L.
• Primary Examiner(s): Amsbury, Wayne
• Assistant Examiner(s): HAVAN, THU THAO
• Application Number:
  US08/944,432
• Time in Patent Office: 1,464 Days
• Field of Search: 707/104, 707/5, 707/8, 705/27, 705/24, 705/25, 705/26, 395/200, 345/331, 345/302, 345/328, 358/537, 358/401
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A system for managing multimedia objects such as text, images, sound, and video clips. The system provides improved organization of multimedia objects, through use of albums organized into collections of albums. In addition, improved printout of multimedia objects through user-activateable selection of particular fields from a multimedia database to accompany printouts of multimedia objects. A user interface is defined for allowing a user to obtain a thumbnail view of images in multimedia objects, simply by sliding a mouse cursor over database entry pointing of the image. In addition, a unique architecture of a system for managing multimedia objects is described.

Claims

1. A database system for organizing multimedia objects, with each object including at least an image component and a text component, the database system being organized into at least one collection with each collection having one or more multimedia albums, said database system comprising:

at least one table entry having a customizable format to store information corresponding to a collection in the database system, the collection information including identification of a component of multimedia objects in an album in the corresponding collection;

a user interface for displaying collections in the database system, said user interface further comprising an interface which allows a user to request creation of a new album and an interface which allows a user to request creation of a new collection;

means responsive to user actuation of the interface to request creation of a new album, for copying a pre-existing field format from other albums in the collection to which the new album is assigned; and

means responsive to user actuation of the interface to request creation of a new collection, for defining a new field for albums in the collection and for storing the new field as a new table entry in the database system.

2. A database system according to claim 1, further comprising a table entry for each said multimedia album, each said table entry for each said multimedia album being linked to one of said table entries for a collection.

3. A database system according to claim 2, wherein each said table entry for each said multimedia album includes an entry for a picture file, wherein the picture file stores a list of image files corresponding to image components.

4. A database system according to claim 1, further comprising a table entry for each said image component, wherein each said table entry for each said image component is linked to one of said table entries corresponding to said collections.

5. A database system according to claim 4, wherein each said table entry for each image component includes a field for a thumbnail file and a field for an annotation file.

6. A database system according to claim 1, wherein said user interface displays an entry field for permitting entry of a new album name within an existing album collection.

7. A database system according to claim 1, wherein said user interface displays an option permitting creation of a new collection, and wherein upon selection of the option to create a new collection, said user interface displays a set of default fields for albums in the new collection.

8. A method for printing components of a multimedia object, the multimedia object including at least an image component and a text component, wherein each component corresponds to a field in a database record that stores the multimedia object, said method comprising the steps of:

displaying a user interface which includes a thumbnail view of the image component of the multimedia object, said user interface further displaying user-selectable fields corresponding to fields in the multimedia database;

accepting user selection of up to plural fields for printout with the image component; and

outputting the image component together with the user-selected fields in the template selected by the user.

9. A method according to claim 8, wherein output is to a printer.

10. A method according to claim 8, wherein output is in HTML format for publication on the world wide web.

11. A method according to claim 8, further comprising a step responsive to user selection of a field for printout with the image component, wherein said step so responsive comprises modification of the thumbnail view of the image component so as to include a preview of the selected field.

12. A method according to claim 8, further comprising the step of displaying a user interface to allow a user to define page layout.

13. A method according to claim 8, further comprising the step of displaying a user interface to allow a user to select background and borders, said user interface further displaying a thumbnail preview of printout which includes user selected backgrounds and borders.

14. A method according to claim 8, further comprising the step of displaying a user interface which allows a user to save selected fields, selected page layout, and selected backgrounds and borders, all as a user defined template.

15. A method according to claim 14, further comprising the step of displaying a user interface which allows selection of a previously defined template.

16. A user interface for displaying a database of multimedia objects, with each multimedia object including at least an image component and a non-image component, with each component corresponding to a field in a database record for the multimedia component, the user interface comprising:

a display of at least a portion of the database in a table display, with each subsequent entry for multimedia objects in the database extending a first direction, and with each individual field within each database record extending in a second direction perpendicular to the first direction;

a cursor display of a mouse cursor corresponding to a position indicated by a user'"'"'s pointing device, the mouse cursor being superimposed over one of the tabular entries in said table display; and

a pop-up display of a thumbnail of an image component of a multimedia object, the pop-up display being displayed upon detection that the mouse cursor is displayed superimposed over the corresponding image component of the multimedia object, the pop-up display overlaying a portion of the table display.

17. A user interface according to claim 16, which upon selection of an image component of a multimedia object displays an image component.

18. A user interface according to claim 16, further comprising a pop-up display of a dialog that includes an entry field for global annotation of text, the pop-up display of dialog being displayed upon selection of the mouse cursor over a non-image text component.

19. A user interface according to claim 16, further comprising a pop-up display of a dialog for recording an audio annotation to a multimedia object, the pop-up display of the dialog being displayed upon selection with the mouse cursor of a non-image annotation component.

20. A user interface according to claim 16, further comprising a pop-up dialog including an interface to allow input of keywords, the pop-up dialog being displayed upon selection by the mouse cursor of a non-image keyword component of a multimedia object.

21. A system for managing multimedia objects, with each multimedia object including at least an image component and a non-image component, wherein each component corresponds to a field in a relational database for storing said multimedia objects, said system comprising:

a database access object responsive to structured query language inquiries so as to create database tables and fields, add and manipulate tables into the database, and add and manipulate fields within each table;

an image manager connected to said database access object, said image manager for adding, deleting, inserting, moving, cropping, re-sizing, and manipulating images, the image manager including interfaces to a TWAIN scanning protocol, image format translation applications, and image processing and manipulation applications;

an album manager connected to the database access object, the album manager for creating, opening, closing, saving and manipulating albums within the context of album collections, said album manager including an interface to functional modules for allowing special effects, HTML generation, album printing;

a view manager connected to the database access object, said view manager for view selection, database selection, table selection, and field selection; and

wherein separate tables of the database store entries corresponding to at least one collection, album and multimedia object are created that are relatable so as to include a multimedia object in an album of a collection.

22. A system according to claim 21, wherein said database access objects includes a database description language (DDL) to create database tables and fields, to add tables into the database, and to add fields within each table, and further includes a database manipulation language (DML) to manipulate database tables and fields, to manipulate tables within the database, to manipulate fields within each table, and to update, search and edit database tables.

23. A system according to claim 21, further comprising TWAIN support interfaced to said image manager, said TWAIN support for providing TWAIN scanning protocol including TWAIN protocol for digital cameras.

24. A system according to claim 21, further comprising an image format translation application interfaced to said image manager, the image format translation application for opening and saving images having predefined image formats.

25. A system according to claim 21, further comprising an image processing and manipulation application interfaced to said image manager, the image processing and manipulation application including at least image translation and image color shifting capabilities.

26. A system according to claim 21, further comprising a functional module for special effects, the functional module for special effects interfaced to said album manager and providing image effects including speed and annotation effects.

27. A system according to claim 21, further comprising a functional module for HTML generation interfaced to said album manager, said functional module for HTML generation providing templates and template wizards for generating HTML-formatted files.

28. A system according to claim 21, further comprising a functional module for album printing interfaced to said album manager, said functional module for album printing for allowing printing in spreadsheet, thumbnail and HTML format.

29. A system according to claim 21, wherein said view manager includes an interface to an active server protocol for allowing access to database objects using an HTTP query protocol over the world wide web.

30. Computer-executable process steps stored on a computer readable medium, the process steps to form a database system for organizing multimedia objects, with each object including at least an image component and a text component, the database system being organized into at least one collection with each collection having one or more multimedia albums, the database system comprising:

at least one table entry having a customizable format to store information corresponding to a collection in the database system, the collection information including identification of a component of multimedia objects in an album in the corresponding collection;

a user interface for displaying collections in the database systems, said user interface further comprising an interface which allows a user to request creation of a new album and an interface which allows a user to request creation of a new collection;

means responsive to user actuation of the interface to request creation of a new album, for copying a pre-existing field format from other albums in the collection to which the new album is assigned; and

means responsive to user actuation of the interface to request creation of a new collection, for defining a new field for albums in the collection and for storing the new field as a new table entry in the database system.

31. Computer-executable process steps according to claim 30, wherein the database system further comprises a table entry for each said multimedia album, each said table entry for each said multimedia album being linked to one of said table entries for a collection.

32. Computer-executable process steps according to claim 31, wherein each said table entry for each said multimedia album includes an entry for a picture file, wherein the picture file stores a list of image files corresponding to image components.

33. Computer-executable process steps according to claim 30, wherein the database system further comprises a table entry for each said image component, wherein each said table entry for each said image component is linked to one of said table entries corresponding to said collections.

34. Computer-executable process steps according to claim 33, wherein each said table entry for each image component includes a field for a thumbnail file and a field for an annotation file.

35. Computer-executable process steps according to claim 30, wherein said user interface displays an entry field for permitting entry of a new album name within an existing album collection.

36. Computer-executable process steps according to claim 30, wherein said user interface displays an option permitting creation of a new collection, and wherein upon selection of the option to create a new collection, said user interface displays a set of default fields for albums in the new collection.

37. Computer-executable process steps stored on a computer readable medium, the process steps to print components of a multimedia object, the multimedia object including at least an image component and a text component, wherein each component corresponds to a field in a database record that stores the multimedia object, the computer-executable process steps including steps of:

displaying a user interface which includes a thumbnail view of the image component of the multimedia object, said user interface further displaying user-selectable fields corresponding to fields in the multimedia database;

accepting user selection of up to plural fields for printout with the image component; and

outputting the image component together with the user-selected fields in the template selected by the user.

38. Computer-executable process steps according to claim 37, wherein output is to a printer.

39. Computer-executable process steps according to claim 37, wherein output is in HTML format for publication on the world wide web.

40. Computer-executable process steps according to claim 37, further comprising a step responsive to user selection of a field for printout with the image component, wherein said step so responsive comprises modification of the thumbnail view of the image component so as to include a preview of the selected field.

41. Computer-executable process steps according to claim 37, further comprising the step of displaying a user interface to allow a user to define page layout.

42. Computer-executable process steps according to claim 37, further comprising the step of displaying a user interface to allow a user to select background and borders, said user interface further displaying a thumbnail preview of printout which includes user selected backgrounds and borders.

43. Computer-executable process steps according to claim 37, further comprising the step of displaying a user interface which allows a user to save selected fields, selected page layout, and selected backgrounds and borders, all as a user defined template.

44. Computer-executable process steps according to claim 43, further comprising the step of displaying a user interface which allows selection of a previously defined template.

45. Computer-executable process steps stored on a computer readable medium, the process steps to display a user interface for a database of multimedia objects, with each multimedia object including at least an image component and a non-image component, with each component corresponding to a field in a database record for the multimedia component, the user interface comprising:

a display of at least a portion of the database in a table display, with each subsequent entry for multimedia objects in the database extending a first direction, and with each individual field within each database record extending in a second direction perpendicular to the first direction;

a cursor display of a mouse cursor corresponding to a position indicated by a user'"'"'s pointing device, the mouse cursor being superimposed over one of the tabular entries in said table display; and

a pop-up display of a thumbnail of an image component of a multimedia object, the pop-up display being displayed upon detection that the mouse cursor is displayed superimposed over the corresponding image component of the multimedia object, the pop-up display overlaying a portion of table display.

46. Computer-executable process steps according to claim 45, wherein upon selection of an image component of a multimedia object, the user interface displays an image component.

47. Computer-executable process steps according to claim 45, wherein the user interface further comprises a pop-up display of a dialog that includes an entry field for global annotation of text, the pop-up display of dialog being displayed upon selection of the mouse cursor over a non-image text component.

48. Computer-executable process steps according to claim 45, wherein the user interface further comprises a pop-up display of a dialog for recording an audio annotation to a multimedia object, the pop-up display of the dialog being displayed upon selection with the mouse cursor of a non-image annotation component.

49. Computer-executable process steps according to claim 45, wherein the user interface further comprises a pop-up dialog including an interface to allow input of keywords, the pop-up dialog being displayed upon selection by the mouse cursor of a non-image keyword component of a multimedia object.

50. Computer-executable process steps stored on a computer readable medium, the process steps to implement a system for managing multimedia objects, with each multimedia object including at least an image component and a non-image component, wherein each component corresponds to a field in a relational database for storing said multimedia objects, said system comprising:

a database access object responsive to structured query language inquiries so as to create database tables and fields, add and manipulate tables into the database, and add and manipulate fields within each table;

an image manager connected to said database access object, said image manager for adding, deleting, inserting, moving, cropping, re-sizing, and manipulating images, the image manager including interfaces to a TWAIN scanning protocol, image format translation applications, and image processing and manipulation applications;

an album manager connected to the database access object, the album manger for creating, opening, closing, saving and manipulating albums within the context of album collections, said album manager including an interface to functional modules for allowing special effects, HTML generation, album printing; and

a view manager connected to the database access object, said view manager for view selection, database selection, table selection, and field selection; and

wherein separate tables of the database store entries corresponding to at least one collection, album and multimedia object table entries are created that are relatable so as to include a multimedia object in an album of a collection.

51. Computer-executable process steps according to claim 50, wherein said database access objects includes a database description language (DDL) to create database tables and fields, to add tables into the database, and to add fields within each table, and further includes a database manipulation language (DML) to manipulate database tables and fields, to manipulate tables within the database, to manipulate fields within each table, and to update, search and edit database tables.

52. Computer-executable process steps according to claim 50, wherein the system further comprises TWAIN support interfaced to said image manager, said TWAIN support for providing TWAIN scanning protocol including TWAIN protocol for digital cameras.

53. Computer-executable process steps according to claim 50, wherein the system further comprises an image format translation application interfaced to said image manager, the image format translation application for opening and saving images having predefined image formats.

54. Computer-executable process steps according to claim 50, wherein the system further comprises an image processing and manipulation application interfaced to said image manager, the image processing and manipulation application including at least image translation and image color shifting capabilities.

55. Computer-executable process steps according to claim 50, wherein the system further comprises a functional module for special effects, the functional module for special effects interfaced to said album manager and providing image effects including speed and annotation effects.

56. Computer-executable process steps according to claim 50, wherein the system further comprises a functional module for HTML generation interfaced to said album manager, said functional module for HTML generation providing templates and template wizards for generating HTML-formatted files.

57. Computer-executable process steps according to claim 50, wherein the system further comprises a functional module for album printing interfaced to said album manager, said functional module for album printing for allowing printing in spreadsheet, thumbnail and HTML format.

58. Computer-executable process steps according to claim 50, wherein said view manager includes an interface to an active server protocol for allowing access to database objects using an HTTP query protocol over the world wide web.

59. A memory for organizing multimedia objects within collections of albums, the memory comprising:

plural data structures stored in said memory, the plural data structures comprising;

at least one multimedia object data structure including plural fields containing information of a multimedia object;

at least one album data structure including plural fields containing information of an album;

at least one collection data structure including plural fields containing information of a collection,

wherein each of the data structures are separate from the others, at least one of the plural fields of the collection data structure identifying the at least one album data structure and the at least one multimedia object data structure thereby relating a collection to an album including at least one multimedia object.

60. A memory of claim 59, wherein some of the plural fields of collection entries are customizable and may differ from collection to collection.

61. A memory of claim 59 wherein the collection data structure is part of one or more collection tables in a database system, each collection table corresponding to a different collection of albums.

62. A memory of claim 59 wherein the album data structure is part of one or more album tables in a database system.

63. A memory of claim 59 wherein the multimedia object data structure is part of one or more multimedia object tables in a database system.

64. A memory of claim 59 wherein one or more of the plural fields of the multimedia object data structure reference an externally-stored image component of the multimedia object.

65. A memory of claim 64 wherein the image component is a thumbnail image.

66. A memory of claim 64 wherein one or more of the plural fields of the multimedia object data structure indicate a size of the externally-stored image component.