System and method for progressive delivery of multimedia objects

• US 8,775,662 B2
• Filed: 09/27/2006
• Issued: 07/08/2014
• Est. Priority Date: 09/27/2005
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Yang, En-Hui, Singh, Ajit, Wang, Longji, Lamb, Brian
• Primary Examiner(s): ALGIBHAH, HAMZA N
• Application Number:
  US11/535,765
• Publication Number:
  US 20070294333A1
• Time in Patent Office: 2,841 Days
• Field of Search: 709/232
• US Class Current: 709/232
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: H04L 63/20 for managing network security; network security policies in general filtering policies H04L63/0227
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04W 12/069 using certificates or pre-shared keys
• CPC Class Codes: H04W 28/06 Optimizing the usage of the radio link, e.g. header compression, information sizing , discarding information system modifying transmission characteristic according to link quality by modifying frame length H04L1/0007; dynamic adaptation of the packet size for flow control or congestion control H04L47/365

Abstract

The present disclosure relates to methods and systems for progressively delivering multimedia content over a network. According to one aspect, a system for delivering multimedia content through a network includes a server side sub-system and a client side sub-system. The server side sub-system is configured to: concurrently send a first predetermined portion of each of the plurality of objects through the network, wherein the first predetermined portion is less than a complete object for at least one of the plurality of objects; and after sending the first predetermined portion of each of the plurality of objects, successively send subsequent predetermined portions of each of the plurality of objects until all portions of the plurality of objects have been sent. The client side sub-system is configured to: receive the first predetermined portion of each of the plurality of objects through the network; and after receiving the first predetermined portion of each of the plurality of objects, successively receive subsequent predetermined portions of each of the plurality of objects until all portions of each of the plurality of objects have been received.

Claims

1. A method for sending multimedia content in a client and server system in a network, wherein the multimedia content comprises a plurality of separate and distinct images, the method comprising:

concurrently, for each image of the plurality of separate and distinct images, sending a first predetermined portion only of that image from the server system through the network, the first predetermined portion of that image comprising a reconstruction of the entirety of that image at a first quality level; and

after sending the first predetermined portion of each image of the plurality of separate and distinct images, for each image of the plurality of separate and distinct images, successively sending at least one subsequent predetermined portion of that image, the at least one subsequent predetermined portion of that image comprising image refinement data for concurrently reconstructing the entirety of that image at a successive higher quality level;

wherein sending the first predetermined portion is handled using a Hyper-Text Transfer Protocol connection and sending the subsequent predetermined portions is handled using another predetermined protocol connection after the Hyper-Text Transfer Protocol connection has closed.

2. A method according to claim 1, further comprising:

receiving information related to the sending of the plurality of separate and distinct images; and

wherein the sending of the first predetermined portions and subsequent predetermined portions of the plurality of separate and distinct images is based on the received information.

3. A method according to claim 2, wherein the information related to the sending of the plurality of separate and distinct images comprises information selected from the group consisting of:

information related to the plurality of separate and distinct images for which sending is to be delayed and information related to the ordering in which the plurality of separate and distinct images are to be sent.

4. A method according to claim 1, further comprising:

prior to sending, determining if any of the plurality of separate and distinct images is appropriate for division into predetermined portions; and

dividing each appropriate image of the plurality of separate and distinct images into predetermined portions prior to sending.

5. A method according to claim 4, further comprising compressing at least one of the plurality of separate and distinct images that is not appropriate for division prior to sending.

6. A method according to claim 1, wherein the network is a wireless network and the server system is a web server or a server side proxy.

7. A method according to claim 1, wherein the plurality of separate and distinct images is a plurality of separate and distinct still images.

8. A method according to claim 1, wherein for each image of the plurality of separate and distinct images, the at least one subsequent predetermined portion of that image is a plurality of subsequent predetermined portions of that image, and the method further comprises, for each image of the plurality of separate and distinct images, successively sending subsequent predetermined portions of that image, wherein the subsequent predetermined portions of that image comprise image refinement data for concurrently reconstructing the entirety of that image at successive higher quality levels.

9. A method according to claim 8, wherein for each image of the plurality of separate and distinct images, successively sending subsequent predetermined portions of that image comprises, after sending the first predetermined portion of that image, concurrently sending subsequent predetermined portions of that image.

10. A method according to claim 1, wherein for each image of the plurality of separate and distinct images, successively sending subsequent predetermined portions of that image occurs automatically after sending the first predetermined portions of that image.

11. A system for delivering multimedia content through a network, wherein the multimedia content comprises a plurality of separate and distinct images, the system comprising:

a server side computing device comprising a server side processor configured to;

concurrently, for each image of the plurality of separate and distinct images, send a first predetermined portion only of that image through the network, the first predetermined portion of that image comprising a reconstruction of the entirety of that image at a first quality level; and

after sending the first predetermined portion of each image of the plurality of separate and distinct images, for each image of the plurality of separate and distinct images, successively send at least one subsequent predetermined portion of that image, the at least one subsequent predetermined portion of that image comprising image refinement data for concurrently reconstructing the entirety of that image at a successive higher quality level;

wherein sending the first predetermined portion is handled using a Hyper-Text Transfer Protocol connection and sending the subsequent predetermined portions is handled using another predetermined protocol connection after the Hyper-Text Transfer Protocol connection has closed; and

a client side computing device comprising a client side processor configured to;

for each image of the plurality of separate and distinct images, receive the first predetermined portion only of that image, the first predetermined portion of that image comprising a reconstruction of the entirety of that image at a first quality level; and

after receiving the first predetermined portion of each image of the plurality of separate and distinct images, for each image of the plurality of separate and distinct images, successively receive at least one subsequent predetermined portion of that image, the at least one subsequent predetermined portion of that image comprising image refinement data for concurrently reconstructing the entirety of that image at a successive higher quality level;

wherein receiving the first predetermined portion is handled using the Hyper-Text Transfer Protocol connection and receiving the at least one subsequent predetermined portion is handled using the other predetermined protocol connection after the Hyper-Text Transfer Protocol connection has closed.

12. A system according to claim 11, wherein the client side processor is further configured to, before receiving at least one of the first predetermined portion and the at least one subsequent predetermined portion, send a request for multimedia content, where the request comprises information related to the sending of the plurality of separate and distinct images, and the server side processor is further configured to receive the request and send the multimedia content in accordance with the request.

13. A system according to claim 12, wherein the information related to the sending of the plurality of separate and distinct images comprises information related to the plurality of separate and distinct images for which sending is to be delayed.

14. A system according to claim 12, wherein the information related to the sending of the plurality of separate and distinct images comprises information related to the ordering in which the plurality of separate and distinct images are to be sent.

15. A system according to claim 11, wherein the server side processor is further configured to:

prior to sending, determine if any of the plurality of separate and distinct images is appropriate for division into predetermined portions; and

divide each appropriate image of the plurality of separate and distinct images into predetermined portions prior to sending.

16. A system according to claim 15, wherein the server side processor is further configured to compress at least one of the plurality of separate and distinct images that is not appropriate for division prior to sending.

17. A system according to claim 11, wherein the network is a wireless network.

18. A system according to claim 11, wherein the server side computing device comprises a web server or a server side proxy.

19. A system according to claim 11, wherein the client side computing device comprises a mobile device or a client side proxy.

20. A system according to claim 11, wherein the plurality of separate and distinct images is a plurality of separate and distinct still images.

21. A system according to claim 11, wherein for each image of the plurality of separate and distinct images, the at least one subsequent predetermined portion of that image is a plurality of subsequent predetermined portions of that image, and the server side processor is further configured to:

for each image of the plurality of separate and distinct images, successively send subsequent predetermined portions of that image, wherein the subsequent predetermined portions of that image comprise image refinement data for concurrently reconstructing the entirety of that image at successive higher quality levels; and

the client side processor is further configured to;

for each image of the plurality of separate and distinct images, successively receive subsequent predetermined portions of that image, wherein the subsequent predetermined portions of that image comprise image refinement data for concurrently reconstructing the entirety of that image at successive higher quality levels.

22. A system according to claim 21, wherein for each image of the plurality of separate and distinct images, the client side processor is configured to

after receiving the first predetermined portion of that image, concurrently reconstruct the entirety of that image from the subsequent predetermined portions of that image to a next higher quality level in the successive higher quality levels;

and

step-wise progressively further concurrently reconstruct the entirety of that image to a successive higher quality level in the successive higher quality levels.

23. A physical computer-readable storage medium for sending multimedia content in a client and server system in a network, wherein the multimedia content comprises a plurality of separate and distinct images, the computer-readable medium storing instructions which, when executed by a computing device, cause the computing device to:

concurrently, for each image of the plurality of separate and distinct images, send only a first predetermined portion of that image from the server through the network, the first predetermined portion of that image comprising a reconstruction of the entirety of that image at a first quality level; and

after sending the first predetermined portion of each image of the plurality of separate and distinct images, for each image of the plurality of separate and distinct images, successively send at least one subsequent predetermined portion of that image, the at least one subsequent predetermined portion of that image comprising image refinement data for concurrently reconstructing the entirety of that image at a successive higher quality level;

wherein sending the first predetermined portion is handled using a Hyper-Text Transfer Protocol connection and sending the at least one subsequent predetermined portions is handled using another predetermined protocol connection after the Hyper-Text Transfer Protocol connection has closed.

24. A physical computer-readable storage medium according to claim 23, wherein for each image of the plurality of separate and distinct images, the at least one subsequent predetermined portion of that image is a plurality of subsequent predetermined portions of that image, and the physical computer-readable medium stored instructions, when executed by a computing device, further causes the computing device to, for each image of the plurality of separate and distinct images, successively send subsequent predetermined portions of that image, wherein the subsequent predetermined portions of that image comprise image refinement data for concurrently reconstructing the entirety of that image at successive higher quality levels.

25. A physical computer-readable storage medium according to claim 24, wherein for each image of the plurality of separate and distinct images, successively sending subsequent predetermined portions of that image comprises, after sending the first predetermined portion of that image, concurrently sending the subsequent predetermined portions of that image.

26. A method for receiving multimedia content in a client and server system in a network, wherein the multimedia content comprises a plurality of separate and distinct images, the method comprising:

for each image of the plurality of separate and distinct images, receiving a predetermined portion only of that image through the network at the client, the first predetermined portion of that image comprising a reconstruction of the entirety of that image at a first quality level; and

after receiving the first predetermined portion of each image of the plurality of separate and distinct images, for each image of the plurality of separate and distinct images, successively receiving at least one subsequent predetermined portion of that image, the at least one subsequent predetermined portion of that image comprising image refinement data for concurrently reconstructing the entirety of that image at a successive higher quality level;

wherein receiving the first predetermined portion is handled using a Hyper-Text Transfer Protocol connection and receiving the at least one subsequent predetermined portions is handled using another predetermined protocol connection after the Hyper-Text Transfer Protocol connection has closed.

27. A method according to claim 26, further comprising:

before receiving at least one of the first predetermined portion and the at least one subsequent predetermined portion, sending a request for multimedia content, where the request comprises information related to the sending of the plurality of separate and distinct images.

28. A method according to claim 27, wherein the information related to the sending of the plurality of separate and distinct images comprises information selected from the group consisting of information related to the plurality of separate and distinct images for which sending is to be delayed and information related to the ordering in which the plurality of separate and distinct images are to be sent.

29. A method according to claim 26, wherein the network is a wireless network and the client system is a mobile device or a client side proxy.

30. A method according to claim 26, further comprising:

prior to receiving, determining if the multimedia content is available in a cache; and

where, for each image of the plurality of separate and distinct images, the first predetermined portion of that image is available in the cache but the at least one subsequent predetermined portion of that image is not available in the cache, sending a request for the at least one subsequent predetermined portion of that image without requesting the first predetermined portion of that image.

31. A method according to claim 26, wherein the plurality of separate and distinct images is a plurality of separate and distinct still images.

32. A method according to claim 26, wherein for each image of the plurality of separate and distinct images, the at least one subsequent predetermined portion of that image is a plurality of subsequent predetermined portions of that image, and the method further comprises, for each image of the plurality of separate and distinct images, successively receiving subsequent predetermined portions of that image, wherein the subsequent predetermined portions of that image comprise image refinement data for concurrently reconstructing the entirety of that image at successive higher quality levels.

33. A method according to claim 32, wherein for each image of the plurality of separate and distinct images, successively receiving subsequent predetermined portions of that image comprises,

after receiving the first predetermined portion of that image, concurrently reconstructing the entirety of that image from the subsequent predetermined portions of that image to a next higher quality level in the successive higher quality levels;

and

step-wise progressively further concurrently reconstructing the entirety of that image to a successive higher quality level in the successive higher quality levels.

34. A physical computer-readable storage medium for receiving multimedia content in a client and server system in a network, wherein the multimedia content comprises a plurality of separate and distinct images, the computer-readable medium storing instructions which, when executed by a computing device, cause the computing device to:

for each image of the plurality of separate and distinct images, receive only a first predetermined portion of that image through the network at the client, the first predetermined portion of that image comprising a reconstruction of the entirety of that image at a first quality level; and

after receiving the first predetermined portion of each image of the plurality of separate and distinct images, for each image of the plurality of separate and distinct images, successively receive at least one subsequent predetermined portion of that image, the at least one subsequent predetermined portion of that image comprising image refinement data for concurrently reconstructing the entirety of that image at a successive higher quality level;

wherein receiving the first predetermined portion is handled using a Hyper-Text Transfer Protocol connection and receiving the at least one subsequent predetermined portions is handled using another predetermined protocol connection after the Hyper-Text Transfer Protocol connection has closed.

35. A physical computer-readable storage medium according to claim 34, wherein for each image of the plurality of separate and distinct images, the at least one subsequent predetermined portion of that image is a plurality of subsequent predetermined portions of that image, and the physical computer-readable medium stored instructions, when executed by a computing device, further causes the computing device to for each image of the plurality of separate and distinct images, successively receive subsequent predetermined portions of that image,

wherein the subsequent predetermined portions of that image comprise image refinement data for concurrently reconstructing the entirety of that image at successive higher quality levels.

36. A physical computer-readable storage medium according to claim 35, wherein for each image of the plurality of separate and distinct images, successively receiving subsequent predetermined portions of that image comprises,

after receiving the first predetermined portion of that image, concurrently reconstructing the entirety of that image from the subsequent predetermined portions of that image to a next higher quality level in the successive higher quality levels;

and

step-wise progressively further concurrently reconstructing the entirety of that image to a successive higher quality level in the successive higher quality levels.