Method and systems for scalable representation of multimedia data for progressive asynchronous transmission
First Claim
1. A system for transmitting digital data representing an original over plural transmission links, at least some of which have limited bandwidth, comprising:
- a digital data source storing digital data representing the original;
a digital data receiver receiving said digital data representing the original via one of said plural transmission links having limited bandwidth; and
a digital data transmitter operative to transmit said digital data representing the original to said receiver over a transmission link having a limited bandwidth in plural blocks which are sequentially transmitted at a rate determined by said limited bandwidth, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by said receiver even when less than all of said plural blocks have been received, receipt of subsequent blocks by the receiver being used to cumulatively improve the quality of the digital data viewed by the receiver.
10 Assignments
0 Petitions
Accused Products
Abstract
A system for transmitting digital data representing an original over plural transmission links, at least some of which have limited bandwidth, including a digital data source storing digital data representing the original, a digital data receiver receiving the digital data representing the original via one of the plural transmission links -having limited bandwidth and a digital data transmitter operative to transmit the digital data representing the original to the receiver over a transmission link having a limited bandwidth in plural blocks which are sequentially transmitted at a rate determined by the limited bandwidth, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by the receiver even when less than all of the plural blocks have been received, receipt of subsequent blocks by the receiver being used to cumulatively improve the quality of the digital data viewed by the receiver.
-
Citations
112 Claims
-
1. A system for transmitting digital data representing an original over plural transmission links, at least some of which have limited bandwidth, comprising:
-
a digital data source storing digital data representing the original;
a digital data receiver receiving said digital data representing the original via one of said plural transmission links having limited bandwidth; and
a digital data transmitter operative to transmit said digital data representing the original to said receiver over a transmission link having a limited bandwidth in plural blocks which are sequentially transmitted at a rate determined by said limited bandwidth, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by said receiver even when less than all of said plural blocks have been received, receipt of subsequent blocks by the receiver being used to cumulatively improve the quality of the digital data viewed by the receiver. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A block generator comprising:
-
a producer interface; and
a digital data compressor, operative in response to producer control parameters received via said producer interface for receiving digital data representing the original and providing plural blocks, each block being an incomplete collection of data which includes parts of multiple frames. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A digital data receiver comprising:
-
a data receipt interface receiving digital data representing an original in a plurality of sequential blocks, each block being an incomplete collection of data which includes parts of multiple frames;
a block accumulator for combining plural blocks as they are received for viewing by the recipient; and
a viewer including a recipient interface which permits each frame to be viewed in an order selected by the recipient, even when less than all of said plural blocks have been received, combining of plural blocks by said block accumulator being used to improve the quality of the digital data viewed by said recipient. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A digital data transmitter actuator comprising:
-
an organizer operative, when actuated, to access digital data representing the original which is organized in plural blocks for subsequent transmission, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by said a receiver even when less than all of said plural blocks have been received; and
a receiver instruction interface responsive to interactive inputs from a receiver for actuating said organizer to select a given block and at least one given partial frame within said given block for transmission.
-
-
35. A method for transmitting digital data representing an original over plural transmission links at least some of which have limited bandwidth comprising:
-
storing digital data representing the original;
receiving at a receiver said digital data representing the original via one of said plural transmission links having limited bandwidth; and
transmitting said digital data representing the original to said receiver over a transmission link having a limited bandwidth in plural blocks which are sequentially transmitted at a rate determined by said limited bandwidth, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by said receiver even when less than all of said plural blocks have been received, receipt of subsequent blocks by the receiver being used to cumulatively improve the quality of the digital data viewed by the receiver. - View Dependent Claims (36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46)
-
-
47. A method for digital data transmission comprising:
-
organizing digital data representing the original into plural blocks for subsequent transmission, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by said a receiver even when less than all of said plural blocks have been received;
responsive to interactive inputs from a receiver for actuating said organizer, selecting a given block and at least one given partial frame within said given block for transmission; and
transmitting the selected given block and at least one given partial frame to a user.
-
-
48. A method for providing on-line virtual reality movies, comprising:
-
inputting a cyclic movie sequence into an encoder;
determining the number of portions that each frame of said movie is divided into, and forming partial frames;
specifying hot-spots and independent objects for interaction within a partial frame;
transmitting the partial frames part by part to a user'"'"'s asynchronous database, and displaying said frames on a user'"'"'s interface. - View Dependent Claims (49, 50, 51, 57)
-
-
52. A system for providing on-line virtual reality movies, comprising:
-
a production workstation for producing VR movies;
an encoder for preparing the VR movie for transmission; and
a server including a repository for the VR movie and a transceiver for transmitting the movie part by part to a user, upon request. - View Dependent Claims (53, 54, 55, 56, 58)
-
-
59. A method for encoding original digital video data to be stored on a server computer for on-line delivery to client computers, comprising the steps of:
-
encoding the digital video into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the video for on-line playback;
storing the database on a server computer;
processing a request by a client computer for on-line delivery of the video in order to determine which data blocks to transmit, so as to accommodate the client bandwidth;
transmitting the necessary data blocks to the client;
decoding the data blocks on the client computer;
integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital video; and
playing the reconstructed video on the client computer. - View Dependent Claims (60, 61, 62)
-
-
63. A method for encoding original digital audio data to be stored on a server computer for on-line delivery to client computers, comprising the steps of:
-
encoding the digital audio into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the audio for on-line playback;
storing the database on a server computer;
processing a request by a client computer for on-line delivery of the audio in order to determine which data blocks to transmit, so as to accommodate the client bandwidth;
transmitting the necessary data blocks to the client;
decoding the data blocks on the client computer;
integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital audio; and
playing the reconstructed audio on the client computer. - View Dependent Claims (64, 65)
-
-
66. A method for encoding original digital object movie data to be stored on a server computer for on-line delivery to client computers, comprising the steps of:
-
encoding the digital object movie into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the object movie for on-line playback;
storing the database on a server computer;
processing a request by a client computer for on-line delivery of the object movie in order to determine which data blocks to transmit, so as to accommodate the client bandwidth;
transmitting the necessary data blocks to the client;
decoding the data blocks on the client computer;
integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital object movie; and
playing the reconstructed object movie on the client computer. - View Dependent Claims (67, 68)
-
-
69. A method for encoding an original digital panorama to be stored on a server computer for on-line delivery to client computers, comprising the steps of:
-
encoding the digital panorama into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the panorama for on-line playback;
storing the database on a server computer;
processing a request by a-client computer for on-line delivery of the panorama in order to determine which data blocks to transmit, so as to accommodate the client bandwidth;
transmitting the necessary data blocks to the client;
decoding the data blocks on the client computer;
integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital panorama; and
playing the reconstructed panorama on the client computer. - View Dependent Claims (70, 71)
-
-
72. A method for encoding original digital large still image data to be stored on a server computer for on-line delivery to client computers, comprising the steps of:
-
encoding the large digital image into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded multi-resolution tiles of the image, with the property that successive blocks when decoded and integrated together provide successively higher quality versions of the tiles for display;
storing the database on a server computer;
processing a request by a client computer for on-line delivery of the image in order to determine which data blocks to transmit;
transmitting the necessary data blocks to the client;
decoding the data blocks on the client computer;
integrating the data blocks together on the client computer to reconstruct an appropriate version of the original multi-resolution image tiles; and
interactively displaying the reconstructed tiles on the client computer. - View Dependent Claims (73, 74)
-
-
75. A video processing system operative on digital video data for encoding the digital video, storing it on a server computer and delivering it to client computers on-line upon request comprising:
-
an encoder for compressing the digital video into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the video for on-line playback;
a storage device for archiving the database on a server computer;
a processing unit for accepting a request by a client computer for on-line delivery of the video and determining which data blocks to transmit, so as to accommodate the client bandwidth;
a transmitter for delivering the necessary data blocks to the client;
a decoder for decompressing the data blocks back into video data on the client computer;
an accumulator for integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital video; and
a player on the client computer for playing the reconstructed digital video. - View Dependent Claims (76, 77, 78)
-
-
79. An audio processing system operative on digital audio data for encoding the digital audio, storing it on a server computer and delivering it to client computers on-line upon request comprising:
-
an encoder for compressing the digital audio into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the audio for on-line playback;
a storage device for archiving the database on a server computer;
a processing unit for accepting a request by a client computer for on-line delivery of the audio and determining which data blocks to transmit, so as to accommodate the client bandwidth;
a transmitter for delivering the necessary data blocks to the client;
a decoder for decompressing the data blocks back into audio data on the client computer;
an accumulator for integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital audio; and
a player on the client computer for playing the reconstructed digital audio. - View Dependent Claims (80, 81)
-
-
82. An object movie processing system operative on digital object movie data for encoding the digital object movie, storing it on a server computer and delivering it to client computers on-line upon request comprising:
-
an encoder for compressing the digital object movie into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the object movie for on-line playback;
a storage device for archiving the database on a server computer;
a processing unit for accepting a request by a client computer for on-line delivery of the object movie and determining which data blocks to transmit, so as to accommodate the client bandwidth;
a transmitter for delivering the necessary data blocks to the client;
a decoder for decompressing the data blocks back into object movie data on the client computer, an accumulator for integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital object movie; and
a player on the client computer for playing the reconstructed digital object movie. - View Dependent Claims (83, 84)
-
-
85. A panorama processing system operative on digital panorama data for encoding the digital panorama, storing it on a server computer and delivering it to client computers on-line upon request comprising:
-
an encoder for compressing the digital panorama into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the panorama for on-line playback;
a storage device for archiving the database on a server computer;
a processing unit for accepting a request by a client computer for on-line delivery of the panorama and determining which data blocks to transmit, so as to accommodate the client bandwidth;
a transmitter for delivering the necessary data blocks to the client;
a decoder for decompressing the data blocks back into panorama data on the client computer;
an accumulator for integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital panorama; and
a player on the client computer for playing the reconstructed digital panorama. - View Dependent Claims (86, 87)
-
-
88. An image processing system operative on large digital image data for encoding the digital image, storing it on a server computer and delivering it to client computers on-line upon request comprising:
-
an encoder for compressing the large digital image into a database comprising a series of encoded data blocks, each block comprising a sequence of encoded multi-resolution tiles of the image, with the property that successive blocks when decoded and integrated together provide successively higher quality versions of the image tiles;
a storage device for archiving the database on a server computer;
a processing unit for accepting a request by a client computer for on-line delivery of the image and determining which data blocks to transmit;
a transmitter for delivering the necessary data blocks to the client;
a decoder for decompressing the data blocks back into image tile data on the client computer;
an accumulator for integrating the data blocks together on the client computer to reconstruct an appropriate version of the original multi-resolution image tiles; and
an interactive viewer on the client computer for displaying the reconstructed image tiles. - View Dependent Claims (89, 90)
-
-
91. A method for caching of data which gets transmitted from servers to clients on a central hub within a network, comprising the steps of:
-
encoding digital multimedia data into databases comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the media for on-line playback;
storing the databases on a multitude of server computers;
managing within the hub requests by client computers for on-line delivery of media stored on server computers in order to determine which data blocks to transmit, so as to accommodate the client bandwidth;
transmitting the necessary data blocks from the server and from the hub to the client;
storing the data blocks delivered by the server in the cache residing in the central hub;
processing within the hub the data blocks it receives;
decoding the data blocks on the client computer;
integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital media; and
playing the reconstructed media on the client computer. - View Dependent Claims (92, 93, 94)
-
-
95. A proxy system operative on a server/client network for caching of data which gets transmitted from servers to clients on a central hub, comprising:
-
an encoder for compressing digital multimedia data into databases comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the media for on-line playback;
server communication lines from the servers to the hub for sending data blocks;
client communication lines from the hub to the clients for sending digital data;
storage devices for archiving the databases on a multitude of server computers;
a management unit within the hub to process requests by client computers for on-line delivery of media stored on server computers in order to determine which data blocks to transmit, so as to accommodate the client bandwidth;
a transmitter for delivering the necessary data blocks on the server communication lines from the server to the hub, and on the client communication lines from the hub to the client;
a storage device for saving the data blocks delivered by the server communication lines in the cache residing in the central hub;
a processing unit within the hub for processing the data blocks which the hub receives;
a decoder for decompressing the data blocks on the client computer;
an accumulator for integrating the data blocks together on the client computer to reconstruct an appropriate version of the original digital media; and
a player for playing the reconstructed media on the client computer. - View Dependent Claims (96, 97, 98)
-
-
99. A multi-casting unit (MCU) system operative on a broadcasting network for caching of data which gets transmitted from stations to viewers, comprising:
-
an encoder for compressing digital multimedia data into databases comprising a series of encoded data blocks, each block comprising a sequence of encoded frames, with the property that successive blocks when decoded and integrated together provide successively higher bandwidth versions of the media for on-line playback;
station communication lines from the stations to the MCU for sending data blocks;
viewer communication lines from the MCU to the viewers for sending data;
viewer receiver units for receiving the data sent by the MCU;
storage devices for archiving the databases on a multitude of station computers;
a management unit within the MCU to process requests by viewers for on-line delivery of media stored on station computers in order to determine which data blocks to transmit, so as to accommodate the viewer bandwidth;
a transmitter for delivering the necessary data blocks on the station communication lines from the station to the MCU, and on the viewer communication lines from the MCU to the viewer receiver units;
a storage device for saving the data blocks delivered by the station communication lines in the cache residing in the MCU;
a processing unit within the MCU for processing the data blocks which the MCU receives;
a decoder for decompressing the data blocks on the viewer receiver;
an, accumulator for integrating the data blocks together on the viewer receiver unit to reconstruct an appropriate version of the original digital media; and
a player for playing the reconstructed media from the viewer receiver unit. - View Dependent Claims (100, 101, 102)
-
-
103. A method for streaming multimedia data over a network, comprising the steps of:
-
encoding the media into a progressive database indexed according to frame and progressive block numbers;
serializing-the encoded database;
storing the serialized database on a server;
streaming the serialized database to a client upon request;
creating a mirror copy of the encoded database on the client computer from the data which streams in; and
decoding the encoded database on the client computer into a sequence of frames for real time display.
-
-
104. A multimedia network streaming system, comprising:
-
an encoder for compressing the media into a progressive database indexed according to frame and progressive block numbers;
a sequencer for serializing the encoded database;
a storage device for archiving the serialized database on a server;
a transmitter for streaming the serialized database to a client upon request;
a processor for creating a mirror copy of the encoded database on the client computer from the data which streams in; and
a decoder for decompressing the encoded database on the client computer into a sequence of frames for real time display.
-
-
105. A system for transmitting model based data representations of three dimensional images over plural transmission links having limited bandwidth, said system comprising:
-
a digital data source storing model based data representations of three dimensional images;
an image processor for rendering views of said model based data representations into raster bitmap format;
a digital data receiver receiving said digital data in said raster bitmap format over a one of said plural transmission links having limited bandwidth; and
a digital data transmitter operative to transmit said digital data in said raster bitmap format to said receiver over a transmission link having a limited bandwidth in plural blocks which are sequentially transmitted at a rate determined by said limited bandwidth, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by said receiver even when less than all of said plural blocks have been received, receipt of subsequent blocks by the receiver being used to cumulatively improve the quality of the digital data viewed by the receiver. - View Dependent Claims (106, 107, 108)
-
-
109. A method for transmitting model based data representations of three dimensional images over plural transmission links having limited bandwidth, said system comprising:
-
storing model based data representations of three dimensional images;
rendering views of said model based data representations into raster bitmap format;
receiving said digital data in said raster bitmap format over a one of said plural transmission links having limited bandwidth; and
transmit said digital data in said raster bitmap format to said receiver over a transmission link having a limited bandwidth in plural blocks which are sequentially transmitted at a rate determined by said limited bandwidth, each block being an incomplete collection of data which includes parts of multiple frames, each frame being viewable in a selectable order by said receiver even when less than all of said plural blocks have been received, receipt of subsequent blocks by the receiver being used to cumulatively improve the quality of the digital data viewed by the receiver. - View Dependent Claims (110, 111, 112)
-
Specification