System and process for compression, multiplexing, and real-time low-latency playback of networked audio/video bit streams

• US 20020154691A1
• Filed: 07/26/2001
• Published: 10/24/2002
• Est. Priority Date: 04/19/2001
• Status: Abandoned Application

• Current Assignee: VectorMAX Corporation
• Original Assignee: Good Technology Incorporated (Blackberry Limited)
• Inventors: Kost, James F., Lottes, Timothy
• Application Number:
  US09/916,100
• Publication Number:
  US 20020154691A1
• Time in Patent Office: Days
• US Class Current: 375/240.01
• CPC Class Codes: H04M 3/5307 for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04M 7/006 Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 21/2347 involving video stream encryption
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82

Abstract

A system and a process for converting analog or digital video presentations such that the presentations remain within a browser as used in Intranet or Internet related applications or the like. A process for modified encoding, proprietary implementation using constant prediction based vectoring to eliminate image error factors resulting in a convergence of quality while eliminating arbitrary positioning to reduce bandwidth transfer rates, multiplexing of variable bit streams, encryption, thread manipulation, plug-in technologies, browser resource utilization, and a unique method of caching, buffering, synchronization, timing, and on-line installation of the plug-in. Further, the present invention may be used in a variety of applications including talking advertising banners, home pages, news reports, greeting cards, sports and entertainment programming, training and education, video conferencing, video E-Mail grams, internet video telephone, webcams, even wireless video telephones. The present invention may develop products including a RIO type player for streaming audio playback and storage, PDA applications, video cell phones, wearable applications, security-cams, interactive video games, interactive sports applications, archiving, VRML video applications, and 360-degree video technologies.

Claims

1. A system for conversion of a video presentation to an electronic media format, the system comprising:

a source file having signals;

a video capture board having means for receiving signals from the source file;

means for interpreting the signals received by the video capture board;

means for converting the signals received by the video capture board to digital data;

means for producing a pre-processed file from the digital data of the video capture board; and

means for producing output from the pre-processed file of the video capture board.

2. The system of claim 1 further comprising:

an input means associated with the video capture board for receiving the signals from the source.

3. The system of claim 1 further comprising:

a pre-authoring program wherein the pre-authoring program receives the output from the pre-processed file of the video capture board and modifies the output.

4. The system of claim 3 further comprising:

a disk wherein the output modified by the pre-authoring program is written to the disk such that a user may obtain the modified output.

5. The system of claim 3 further comprising:

means for encoding the output modified by the pre-authoring program.

6. The system of claim 5 further comprising:

means for encrypting the output after the output has been encoded.

7. The system of claim 1 further comprising:

means for multiplexing the output.

8. The system of claim 7 further comprising:

means for encrypting the output after the output has been multiplexed.

9. A process for conversion of a video presentation to an electronic media format, the process comprising the steps of:

providing a source file having signals;

providing a video capture board having means for receiving signals from the source file;

interpreting the signals received from the source file;

converting the signals received from the source file to digital data;

producing a pre-processed file from the digital data; and

producing a finished file output from the pre-processed file.

10. The process of claim 9 wherein the finished file output is an analog video presentation.

11. The process of claim 9 wherein the finished file output is a digital video presentation.

12. The process of claim 9 further comprising the step of:

modifying the finished file output such that a video image size is modified.

13. The process of claim 9 further comprising the step of:

modifying the finished file output such that a frame rate is modified.

14. The process of claim 9 further comprising the step of:

modifying the finished file output such that a re-sampling audio is modified.

15. The process of claim 9 further comprising the step of:

providing an input associated with the video capture board wherein the video capture board acquires the signals from the source file.

16. The process of claim 9 further comprising the step of:

retrieving the finished file output produced from the pre-processed file wherein the finished file output is in an uncompressed format.

17. The process of claim 9 further comprising the step of:

retrieving the finished file output produced from the pre-processed file wherein the finished file output is visual finished file output.

18. The process of claim 9 further comprising the step of:

retrieving the finished file output produced from the pre-processed file wherein the finished file output is an audio finished file output.

19. The process of claim 9 further comprising the step of:

retrieving the finished file output produced from the pre-processed file wherein the finished file output is a combination of an audio output and a visual output.

20. The process of claim 19 further comprising the step of:

creating delays to maintain synchronization between the audio output and the visual output.

21. The process of claim 20 further comprising the step of:

correcting for cumulative errors from loss of synchronization of the audio output and the visual output.

22. The process of claim 19 further comprising the step of:

encoding the audio output and the visual output.

23. The process of claim 22 further comprising:

selecting a desired transfer rate for adjusting encoding levels for the audio output and the visual output.

24. The process of claim 9 further comprising the step of:

encoding the finished file output.

25. The process of claim 24 further comprising the step of:

encrypting the finished file output after the finished file output has been encoded.

26. The process of claim 9 further comprising the step of:

multiplexing the finished file output.

27. The process of claim 26 further comprising the step of:

encrypting the finished file output after the finished file output has been multiplexed.

28. The process of claim 9 further comprising the steps of:

dividing the finished file output into a pre-determined size of incremental segments; and

multiplexing the predetermined size of incremental segments into one bit stream.

29. The process of claim 28 further comprising the step of:

encrypting the bit stream after multiplexing.

30. The process of claim 28 wherein the bit stream is an alternating pattern of signals.

31. The process of claim 28 further comprising the step of:

incorporating intentional delays into the bit stream while encoding the bit stream.

32. The process of claim 9 further comprising the step of:

decrypting signals from the finished file output as the signals are received.

33. The process of claim 9 further comprising the step of:

creating a rim buffering system for playback of the finished file output.

35. The process of claim 34 further comprising the steps of:

extracting vectors from the first frame after the data has been processed; and

extracting vectors from the second frame after the data has been processed.

36. The process of claim 35 further comprising the step of:

quantifying the vectors.

37. The process of claim 36 further comprising the step of:

compressing the vectors into a bit stream to create motion.

39. The encoding process of claim 38 further comprising the step of:

processing data and vectors from subsequent frames.

40. The encoding process of claim 39 further comprising the step of:

rejecting data and vectors from the subsequent frame that are identical to the data and vectors of the first frame and second frame.

41. The encoding process of claim 39 further comprising the step of:

adding the processed data and vectors from the subsequent frames to the encoded frame.

34. A process for encoding a file, the process comprising the steps of:

providing a file having a first frame and a second frame;

processing data from the first frame;

reading data from the second frame;

skipping data from the second frame that was processed in the first frame; and

processing data from the second frame that was not skipped.

38. An encoding process, the process comprising the steps of:

processing data and vectors from a first frame;

creating an encoded frame from the processed data and vectors of the first frame;

processing data and vectors from the second frame;

rejecting data and vectors from the second frame that are identical to the data and vectors of the first frame; and

adding the processed data and vectors from the second frame to the encoded frame.

42. An encoding process for encoding an audio file, the process comprising the steps of:

providing an audio sub-band encoding algorithm designed for audio signal processing;

splitting the audio file into frequency bands;

removing undetectable portions of the audio file; and

encoding detectable portions of the audio file using bit-rates.

43. The process of claim 42 further comprising the step of:

using the bit-rates with more bits per sample used in a mid-frequency range.

44. The process of claim 43 wherein the bit-rates are variable.

45. The process of claim 43 wherein the bit-rates are fixed.

48. The process of claim 47 further comprising the step of:

using a low bit stream transfer rate.

46. A rim buffering system, the system comprising:

means for loading a file;

means for presenting the file that has been loaded;

a buffer for buffering the file that has been presented;

means for automatically pausing the file while being presented when the buffer drops to a certain level; and

means for restarting the presentation of the file while maintaining synchronization after the buffer reaches another level.

47. A process for enabling a bit stream to be indexed on a random access basis, the process comprising the steps of:

providing one key frame;

inserting the one key frame into a bit stream at least every two seconds;

evaluating the one key frame;

eliminating the one key frame if the one key frame is not required; and

updating the bit stream with the one key frame.