Operational system and architectural model for improved manipulation of video and time media data from networked time-based media

• US 9,812,169 B2
• Filed: 08/20/2007
• Issued: 11/07/2017
• Est. Priority Date: 03/28/2006
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: O'Brien, Christopher J., Wason, Andrew
• Primary Examiner(s): Belousov, Andrey
• Application Number:
  US12/294,722
• Publication Number:
  US 20100293466A1
• Time in Patent Office: 3,732 Days
• Field of Search: 715201, 715205, 715209, 715723, 715730, 715731, 715733, 715741, 715744, 715745, 715746, 715747, 715748, 715751
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4825 using a list of items to be played back in a given order, e.g. playlists
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

The present invention provides a novel operational system and electronic architectural model for organizing and improving viewing and editing of time-based video media and for overcoming the detriments required by the previous film and video industry based editing technologies. The present system enables an operator to manipulate the visual and audio perception of underlying video and audio data without changing the same. A series of metadata modules enable real-time operation and editing of video data and control of a play back module as well as an improved sharing, viewing, searching, and showing of underlying video and audio data.

Claims

1. A method of processing digitally encoded video with synchronized audio (DEVSA), comprising:

receiving native-format DEVSA that defines a time-sequence rendering of the video and audio during playback;

encoding the received DEVSA into at least one standard-format DEVSA;

storing the encoded DEVSA in a DEVSA file;

consequent to the receiving, encoding, and storing, creating from the DEVSA metadata usable to render the encoded DEVSA, the metadata stored in a metadata file separate from the at least one DEVSA file; and

modifying the metadata file to define a different rendering of the encoded DEVSA during playback without modifying the DEVSA file, the different rendering specifying for playback at least one time segment of the time-sequence rendering.

2. The method of claim 1, comprising:

streaming the encoded DEVSA, as specified by the modified metadata, to a user device capable of rendering DEVSA having the standard format.

3. The method of claim 1, wherein the creating automatically creates the metadata.

4. The method of claim 1, wherein the encoding encodes the received DEVSA into a plurality of DEVSA each having a different standard format.

5. The method of claim 4, wherein different ones of the plurality of standard-format DEVSA correspond to different end user device rendering capabilities, different data transmission speeds, or different size video displays.

6. The method of claim 1, wherein modifying the metadata includes generating at least one playback decision list comprising one or more of edit commands, tags, commentary, or permissions.

7. The method of claim 1, wherein the different rendering produces a different visual and audio perception of the encoded DEVSA during playback than the time-sequence rendering.

8. The method of claim 7, wherein the modified perception includes one or more of a modified video contrast, a modified video brightness, a modified video color, or a superimposed video transition effect.

9. The method of claim 1, comprising:

decoding the encoded DEVSA to create thumbnail images or audio clips that are processable to further modify the metadata.

10. The method of claim 1, wherein the created metadata is independent of the native format of the DEVSA.

17. The method of claim 1, wherein the different rendering specifies a plurality of user-specified time segments of the time-sequence rendering for playback.

18. The method of claim 17, wherein the plurality of time segments are played back in a different order than in the time-sequence rendering.

19. The method of claim 17, wherein each time segment is a user-specified subset of the time-sequence rendering.

11. A digitally encoded video with synchronized audio (DEVSA) processing system, comprising:

one or more servers;

an upload module of at least one of the servers to receive native-format DEVSA that defines a time-sequence rendering of the video and audio during playback;

an encoding module of at least one of the servers coupled to the upload stage to encode the native-format DEVSA into at least one standard-format DEVSA file stored in a file store; and

a video module of at least one of the servers to interactively modify metadata stored separate from the at least one DEVSA file to produce a different rendering of the encoded DEVSA without modifying the encoded DEVSA file, the different rendering comprising at least one time segment of the time-sequence rendering specified to be played back.

12. The system of claim 11, wherein at least one of the upload module or the encoding module automatically creates, from the DEVSA, metadata usable to render the encoded DEVSA.

13. The system of claim 11, wherein the modified metadata that produce a different time-sequence rendering of the encoded DEVSA comprise a playback decision list.

14. The system of claim 13, comprising:

a play controller to generate, responsive to the playback decision list, a DEVSA stream having the different rendering by processing the stored DEVSA in accordance with the playback decision list.

15. The system of claim 11,

wherein the system is accessible over a network by a plurality of users, and

wherein each user independently interacts with the video module to modify the metadata for a same DEVSA to generate a different playback decision list, each different playback decision list generating to the corresponding user a different time-sequence rendering of the encoded DEVSA without modifying the encoded DEVSA.

16. The system of claim 11,

wherein the upload module receives a plurality of different native-format DEVSA, each of which the encoding module encodes into at least one standard-format DEVSA, and

wherein a data stream generated by the system in accordance with a playback decision list of the modified metadata includes a different time-sequence rendering of the encoded DEVSA that corresponds to at least two of the different native-format DEVSA.

20. The system of claim 11, wherein the video module further interactively modifies at least one of a video contrast, video brightness, video color, or transition effect of the DEVSA.