Computer user interface for interacting with video cliplets generated from digital video

• US 20030234805A1
• Filed: 06/19/2002
• Published: 12/25/2003
• Est. Priority Date: 06/19/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Toyama, Kentaro, Drucker, Steven M.
• Granted Patent: US 7,383,508 B2
• Time in Patent Office: Days
• US Class Current: 715/723
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/440263 by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4786 e-mailing message switching systems, e.g. electronic mail systems H04L51/00
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/147 : Scene change detection
• CPC Class Codes: H04N 5/45 : Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen

Abstract

The present invention includes a computer user interface system and a method for displaying short segments of video each representing a single theme or event (called video cliplets or “cliplets”). The computer user interface displays the cliplets and information and properties of each of the cliplets. Through the computer user interface of the invention, a user can quickly and easily determine the contents and interesting portions of the video. The cliplet user interface method includes displaying a plurality of cliplets in a two-dimensional arrangement along with cliplet information. The cliplet user interface system includes a plurality of keyframe windows for displaying cliplets and a keyframe within each keyframe window representing a cliplet therein. Moreover, the cliplet user interface system includes a cliplet property presentation area for displaying a cliplet interest rating. The cliplet interest rating indicates the amount of interesting content within the cliplet for a particular cliplet property.

Claims

1. In a computer system having a user interface including a display device and an input device, a method for displaying short segments of video called video cliplets generated from a digital video, comprising:

displaying a plurality of video cliplets on the display device in a two-dimensional arrangement with each of the plurality of the video cliplets displayed as a single, independent entity; and

displaying a cliplet property for each of the plurality of video cliplets to provide a user with information about a corresponding cliplet.

2. The method as set forth in claim 1, wherein each of the plurality of video cliplets is displayed in its own keyframe window.

3. The method as set forth in claim 2, further comprising displaying interest ratings in the keyframe window.

4. The method as set forth in claim 2, wherein the keyframe window is a thumbnail.

5. The method as set forth in claim 1, wherein each of the plurality of video cliplets is represented by a keyframe.

6. The method as set forth in claim 1, further comprising representing each of the plurality of video cliplets by a plurality of keyframes.

7. The method as set forth in claim 6, further comprising allowing a user to use an input device to rotate through the plurality of keyframes to select a desired keyframe to represent an associated video cliplet.

8. The method as set forth in claim 6, further comprising displaying simultaneously at least two of the plurality of keyframes from a same cliplet.

9. The method as set forth in claim 1, wherein the cliplet property is a cliplet interest rating that is based on any available cliplet information.

10. The method as set forth in claim 1, further comprising organizing the plurality of cliplets into visually-separate groups based on at least one of:

(a) the cliplet property;

(b) any other form of metadata available for the plurality of cliplets.

11. The method as set forth in claim 1, further comprising organizing the plurality of cliplets into visually-separate rows based on at least one of:

(a) the cliplet property;

(b) any other form of metadata available for the plurality of cliplets.

12. The method as set forth in claim 1, further comprising organizing the plurality of cliplets into visually-separate columns based on at least one of:

(a) the cliplet property;

(b) any other form of metadata available for the plurality of cliplets.

13. A method in a computer system for displaying on a display device video cliplets generated from a source video, comprising:

dividing the display area on the display device into a plurality of windows;

displaying each of the video cliplets in each of the plurality of windows; and

displaying a video cliplet rating for each of the video cliplets.

14. The method as set forth in claim 13, further comprising arranging the plurality of windows in a two-dimensional arrangement.

15. The method as set forth in claim 13, further comprising displaying the video cliplet rating as at least one of the following:

(a) a graphical representation;

(b) a textual representation.

16. The method as set forth in claim 15, wherein the graphical representation is interest rating bars.

17. The method as set forth in claim 13, further comprising allowing a user to use an input device to scroll the display area and reveal addition windows containing cliplets.

18. The method as set forth in claim 13, further comprising providing drag and drop functionality such that at least one of the video cliplets can be dragged and dropped into an application for processing.

19. The method as set forth in claim 13, further comprising allowing a user to user an input device to merge at least two of the video cliplets such that a first one of the video cliplets merges with a second one of the video cliplets to create a new video cliplet.

20. The method as set forth in claim 19, wherein the first and second ones of the video cliplets are temporal neighbors.

21. A graphical user interface displayed on a display device for interacting with video cliplets, comprising:

a plurality of keyframe windows for displaying each of the video cliplets in a thumbnail format;

a keyframe disposed within each of the plurality of keyframe windows that are a representation of a video cliplet contained therein; and

a cliplet property presentation area for displaying a cliplet interest rating located in one of the following areas;

(a) adjacent the keyframe window;

(b) within the keyframe window.

22. The graphical user interface as set forth in claim 21, wherein the plurality of keyframe windows are arranged in a two-dimensional manner.

23. The graphical user interface as set forth in claim 21, wherein each of the video cliplets may be played within a respective one of the plurality of keyframe windows.

24. The graphical user interface as set forth in claim 21, wherein the keyframe is a plurality of keyframes, such that a user can rotate through each of the plurality of keyframes within the keyframe window.

25. The graphical user interface as set forth in claim 21, further comprising a video window for playing a desired one of the cliplets therein.

26. The graphical user interface as set forth in claim 21, further comprising an interest bar representing the cliplet interest rating, wherein a longer interest bar indicates more interesting content in a corresponding cliplet.