SYSTEM, METHOD, AND APPARATUS FOR VISUAL BROWSING, DEEP TAGGING, AND SYNCHRONIZED COMMENTING

• US 20100169786A1
• Filed: 03/29/2007
• Published: 07/01/2010
• Est. Priority Date: 03/29/2006
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Motionbox Incorporated (District Photo Incorporated)
• Inventors: Wason, Andrew, O'Brien, Christopher J.
• Application Number:
  US12/294,648
• Publication Number:
  US 20100169786A1
• Time in Patent Office: Days
• US Class Current: 715/738
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

The present invention provides a system, method, and apparatus for visual browsing, deep tagging, and synchronized comment regarding interactive time-based media data. Operational modules are provided that allow users to more effectively discover and preview and view time-based media in order to choose and locate sub-segments in time that are of particular user interest, and to provide user comments viewable by others on selected sections of the time-based media subject matter.

Claims

1. An electronic system, for at least one of a synchronized commenting and a deep tagging of at least a first time-based media by a plurality of users including at least a first user, said electronic system, comprising:

at least one user computerized electronic memory device enabling a manipulation of said time-based media;

user interface means for transferring said at least first time-based media from said computerized electronic memory device to means for encoding and for storing said at least first time-based media in at least a first initial encoded state in an electronic system environment;

metadata system means for creating, storing, and managing at least a first layer of time-dependent metadata in a manner associated with said at least first initial encoded state of said encoded time-based media without modifying said at least first initial encoded state of said encoded time-based media, and in a manner associated with each respective said user;

time sequence means in said metadata system means for generating a sequence of time informational indicators enabling each said user to perceive a useful progression through time of said at least first time-based media;

electronic interaction system means for enabling said plurality of users to interact respectively with said time sequence means and said metadata system means for creating, storing, and managing said at least first layer of metadata according to a plurality of stored respective playback decision lists of ones of said plurality of users; and

said electronic interaction system means including means for enabling a plurality of display control modes and a plurality of play modes of said encoded time-based media according to said respective playback decision lists of ones of said plurality of users.

2. An electronic system, according to claim 1, wherein:

said time informational indicators include at least one indicator selected from a group consisting of;

visual icons, visual icons representing scene changes detected by discontinuities in said time-based media, visual images reconstructed by an image reconstruction system, tags generated by one of a sound or a visual image in a recognition system, and thumbnail images, thereby said at least one indicator enables a convenient visual browsing by said plurality of users.

3. An electronic system, according to claim 1, wherein:

said electronic interaction system means for enabling said plurality of users to interact respectively with said time sequence means and said metadata system means, further comprises;

means for deep tagging time-based metadata and for attaching user personalized deep tags to selected interval segments of said encoded time-based media,

said user personalized deep tags including at least one tag type selected from a group comprising;

user identification, user hierarchy, user-defined use modalities, user descriptive comments reviewable by other users, user instructions to jump to a particular selected sequence in a visual browsing enabled mode, user-personalized sequence indicator identifiers, electronic instructions to change a visual display instruction of a selected sequence, and a system-searchable deep tag available to other users.

4. An electronic system, according to claim 1, wherein:

said electronic interaction system means for enabling a plurality of users to interact respectively with said time sequence means and said metadata system means, further comprises;

means for enabling a plurality of user interactions, said user interactions including at least one user interaction from a group comprising;

editing, virtual browsing, tagging, deep tagging, commenting, synchronized commenting, social browsing, granting of permissions, and creation of a permanent media form linked to respective said user modifications; and

said electronic interaction system for enabling enables a selective storage of each respective users'"'"' interaction in respective user playback decision lists.

5. An operational system, for providing a web-based system enhancing a use for at least one of a plurality of users of time-based media, comprising:

means for receiving via a user interface system a user-transferred time-based media in an electronic operational environment including an electronic memory device and a user interface subsystem;

means for encoding said uploaded time-based media and for storing said encoded time-based media in an initial state;

a metadata creation system for establishing metadata associated with said uploaded time-based media;

means for providing a system of sequenced time informational indicators enabling said user to at least one of a visually and an audibly perceive a progression through time of said encoded time-based media;

an electronic interaction system enabling said at least one user to modify said established metadata associated with said encoded time-based media in at least a first stored playback decision list via a communication path including said user interface system, whereby said stored playback decision list of said at least one user modifies said established metadata without modifying said encoded time-based media in said initial state;

said electronic interaction system including a display control system and a play control system enabling said at least one of said plurality of users to display and play said encoded time-based media in a modified manner according to said at least one playback decision list without modifying said encoded time-based media; and

said electronic interaction system enabling others of said plurality of users to modify said metadata in respective user-linked playback decision lists and for storing each respective user playback decision list separately.

6. An operational system, according to claim 5, wherein:

said user modifications include at least one user modification from a group comprising;

editing, virtual browsing, tagging, deep tagging, commenting, synchronized commenting, social browsing, granting of permissions, and creation of a permanent media form linked to respective said user modifications; and

said electronic interaction system enabling storage of each respective user'"'"'s modifications in respective user playback decision lists.

7. An operational system, according to claim 6, wherein:

said user modifications include at least said synchronized commenting; and

said electronic interaction system includes means for enabling each respective user to view respective user'"'"'s synchronized comment modifications and separately store additional synchronized comments, whereby said electronic interaction system enables at least one of an enhanced multiple user synchronized commenting and a multiple level deep tagging as an enhanced system performance.

8. An operational system, according to claim 7, wherein:

said permanent media form includes at least one of said time-based media in said first encoded standard and established metadata associated with said individually established user playback decision list, whereby said operational system enables convenient transfer of each said stored time-based media.

9. An operational system, according to claim 8, further comprising:

means for capturing and storing metadata and playback decision list data relating to said time-based media enabled for tracking respective user'"'"'s editing of said initial state encoded time-based media;

programming module means for controlling at least one of a display control, a play control, and a multi-level user editing of said time-based media; and

user transfer means for enabling multiple user playback interactions with said encoded time-based media and selected ones of said user'"'"'s playback decision lists, whereby said electronic interaction system includes means for storing said at least one of said user modifications as a synchronized comment for at least an initial portion of said initial user-transferred time-based media, whereby said operational system enables comments related to at least a part or all of said transferred time-based media.

10. An operational system, according to claim 8, wherein:

said means for capturing and storing includes means for directly identifying user-defined portions of time-based metadata, whereby said means for directly identifying includes one of means for adding comments and means for adding user information, whereby said system enables enhanced utility of said initially uploaded time-based media.

11. A method for operating a media system providing a web-based system enhancing use of time-based media by at least one of a plurality of users, comprising the steps of:

providing means for receiving via a user interface system a user-transferred time-based media in an electronic operational environment including an electronic memory device and a user interface subsystem;

providing means for encoding said uploaded time-based media and for storing said encoded time-based media in an initial state;

providing a metadata establishing system for establishing and managing separate time informational sequence indicators in metadata associated with said transferred time-based media;

providing an electronic interaction system enabling said at least a first user of a plurality of users to modify said established metadata associated with said encoded time-based media in at least a first stored playback decision list via a communication path including said user interface system, whereby said first user stored playback decision list modifies said established metadata without modifying said encoded time-based media in said initial state;

providing said electronic interaction system including a display control system and a play control system enabling at least one of said plurality of users to display and play said established time-based media in a modified manner according to said at least one playback decision list without modifying said encoded time-based media;

said step of providing said electronic interaction system enabling others of said plurality of users to modify said established metadata in respective user-linked playback decision lists and for storing each respective user playback decision list separately.

12. A method for operating a media system according to claim 11, wherein:

said user modifications include at least one of a group of user modifications comprising;

editing, virtual browsing, tagging, deep tagging, commenting, synchronized commenting, social browsing, granting of permissions, and creation of a permanent media form linked to respective said user modifications; and

said electronic interaction system enabling storage of each respective user'"'"'s modifications in respective user playback decision lists.

13. A method of operating, according to claim 12, wherein:

said user modifications include at least one of synchronized commenting and deep tagging.

14. A method of operating according to claim 13, wherein:

said user modification is said synchronized commenting; and

said step of providing said electronic interaction system includes a step of providing means for enabling each said respective user to view other respective users'"'"' synchronized comment modifications and separately store synchronized additional comments, whereby said electronic interaction system enables enhanced multiple user synchronized commenting as an enhanced system performance.

15. A method of operating, according to claim 12, wherein:

said permanent media form includes at least one of said time-based media in said first encoded standard and established metadata associated with said encoded time-based media modified according to said at least one stored user playback decision list, whereby said operational system enables transfer of each said stored time-based media.

16. A system for providing enhanced time-based media editing, comprising:

a computer system receiving at least a first of a plurality of user transfers of said time-based media in an operational environment through a user interface system;

means for encoding said at least first of said user transfers of said time-based media in an initial state separate from subsequent user transfers;

computer memory means for storing said encoded first time-based media in said initial state separate from said subsequent user transfers;

a metadata creation system for initially establishing metadata associated with respective user transfers of time-based media said computer memory means storing said established metadata associated with said time-based media separate from said encoded time-based media in said initial state;

means for individually modifying said established metadata as an individual playback decision list and for individually storing said playback decision list separately from said respective initial state time-based media and said respective initial metadata, thereby enabling an individual modification of respective said playback decision lists without a modification of said initial state encoded time-based media;

means for enabling at least one of a visual browsing, a deep tagging, and a synchronized commenting regarding electronic time-based media content, comprising;

at least a first user interface means;

at least a first underlying programming module for enabling interacting with said at least a first user; and

an interactive data model constructing and tracking a user modification and review of each user action relative to said at least one of a visual browsing, a deep tagging, and a synchronized commenting within respective user playback decision lists.