Transport of reversible and unreversible embedded wavelets

• US 20040078491A1
• Filed: 10/18/2002
• Published: 04/22/2004
• Est. Priority Date: 10/18/2002
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Gormish, Michael, Banerjee, Serene
• Granted Patent: US 7,734,824 B2
• Time in Patent Office: Days
• US Class Current: 709/247
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application

Abstract

A method and apparatus for transporting portions of a codestream over a communications mechanism is described. In one embodiment, the method comprises sending a request over a network and receiving tile-parts of a JPEG 2000 compliant codestream from the network as a return type as part of a response to the request.

Claims

8. An article of manufacture comprising one or more recordable media storing instructions thereon which, when executed by a system, cause the system to:

send a request over a network; and

receive tile-parts of a JPEG 2000 compliant codestream from the network as a return type as part of a response to the request.

9. The article of manufacture defined in claim 8 wherein the network comprises one selected from a group consisting of a local area network (LAN), a wide area network (WAN), the Internet, and the World Wide Web (WWW).

10. The article of manufacture defined in claim 8 wherein the response comprises an HTTP response.

11. An apparatus comprising:

means for sending a request over a network; and

means for receiving tile-parts of a JPEG 2000 compliant codestream from the network as a return type as part of a response to the request.

12. The apparatus defined in claim 11 wherein the network comprises one selected from a group consisting of a local area network (LAN), a wide area network (WAN), the Internet, and the World Wide Web (WWW).

13. The apparatus defined in claim 11 wherein the response comprises an HTTP response.

14. A system comprising:

a client; and

a server coupled to the client to exchange portions of a compressed codestream via a network using a protocol in which requests and responses processed at the client from the server are with image objects and requests and responses processed at the server from the client are with byte ranges.

15. The system defined in claim 14 wherein byte ranges are specified using program calls.

16. The system defined in claim 15 wherein the program comprises a C program.

17. The system defined in claim 16 wherein the program caller comprises a sequence of fseek( ) and fread( ) calls.

18. The method defined in claim 14 wherein the responses comprise HTTP responses.

19. The method defined in claim 14 wherein the server and client use HTTP chunked transfer encoding to exchange requests and responses.

20. The method defined in claim 14 further comprising ending at least one of the responses without closing an HTTP channel.

21. A method of transporting a codestream of compressed data between a client and a server using a series of stages, wherein

a first stage to convert a sequence of compressed image object responses and viewports into image data;

a second stage to convert viewport requests into compressed data object requests;

a third stage to create a compressed image object in response to a byte range response; and

a fourth stage to convert compressed image object requests to byte range requests.

1. A method comprising:

sending a request over a network; and

receiving tile-parts of a JPEG 2000 compliant codestream from the network as a return type as part of a response to the request.

2. The method defined in claim 1 wherein the network comprises one selected from a group consisting of a local area network (LAN), a wide area network (WAN), the Internet, and the World Wide Web (WWW).

3. The method defined in claim 1 wherein the response comprises an HTTP response.

4. The method defined in claim 3 further comprising using HTTP chunked transfer encoding.

5. The method defined in claim 4 further comprising ending the response without closing an HTTP channel.

6. The method defined in claim 5 further comprising starting a new response to a new request because the user has changed a viewport within an image corresponding to the codestream.

7. The method defined in claim 1 further comprising uploading at least one of the tile-parts to a server via HTTP.

22. The method defined in claim 21 wherein two or more of the stages are performed in a single location.

23. The method defined in claim 22 wherein the two or more stages are performed by a proxy server communicably coupled between the server and the client.

24. The method defined in claim 23 wherein the two or more stages comprise the second stage.

25. The method defined in claim 23 wherein the two or more stages comprise the third stage.

26. The method defined in claim 21 wherein the first, second, third and fourth stages are performed at the server.

27. The method defined in claim 21 wherein the first stage is performed at the client.

28. The method defined in claim 21 wherein the second, third and fourth stages are performed at the server.

29. The method defined in claim 21 wherein the first and second stages are performed at the client.

30. The method defined in claim 21 wherein the third and fourth stages are performed at the server.

31. The method defined in claim 21 wherein the first, second, third and fourth stages are performed at the client.

32. The method defined in claim 21 further comprising a decompressor stage to run a decoder on received data.

33. The method defined in claim 32 wherein the decoder decodes a region of interest.

34. The method defined in claim 33 wherein the region of interest is a client-specified region of interest.

35. The method defined in claim 32 wherein the decoder comprises a JPEG 2000 decompressor.

36. The method defined in claim 32 wherein the decoder is operable to generate a full resolution image, generate a cropped image by cropping a region of interest in the full resolution image, and scale that cropped image to another resolution.

37. The method defined in claim 32 wherein the decoder decodes only that portion of the codestream necessary for a desired resolution, region of interest, components, and quality.

38. The method defined in claim 21 further comprising, during the second stage, maintaining a list of responses transferred to the first stage.

40. The method defined in claim 21 further comprising, during the second stage, storing one bit to indicate whether a tile-part is to be sent to the client and one bit to indicate whether the tile-part has been sent.

41. The method defined in claim 21 further comprising, during the second stage, storing additional information to indicate priority for each tile-part.

42. The method defined in claim 21 further comprising, during the third stage, buffering a sequence of image object requests.

43. The method defined in claim 21 further comprising, during the third stage,

obtaining desired data;

wrapping returned data in an HTTP response; and

sending the HTTP response with the returned data to the second stage.

44. The method defined in claim 21 further comprising, during the third stage, wrapping the returned data with an identifier.

45. The method defined in claim 44 wherein the identifier comprises a new header.

46. The method defined in claim 44 wherein the identifier comprises a sequence of types in a message body preceding coded data in a response.

47. The method defined in claim 21 further comprising, during the fourth stage, returning requests image objects only even if multiple reads were used to determine location of the requests.

48. The method defined in claim 21 further comprising, during the fourth stage;

reading SOC and SIZ markers of the main header;

reading SOT markers to obtain lengths of each tile-part;

generating the byte range requests by using a list of the beginning and length of each tile-part to identify the range.

49. The method defined in claim 21 further comprising concatenating responses to requests to form a JPEG 2000 codestream to be decoded with a JPEG 2000 decoder.

50. The method defined in claim 49 wherein the JPEG 2000 decoder has no understanding of the protocol.

38-1. The method defined in claim 21 further comprising, during the second stage,

converting a desired region of interest in the image to reference grid units,

determining which tiles intersect the region of interest, and

selecting tile-parts using specified resolution and quality.

51. An article of manufacture comprising one or more recordable media storing instructions thereon which, when executed by a system, cause the system to transport a codestream of compressed data between a client and a server using a series of stages, wherein

a first stage to convert a sequence of compressed image object responses and viewports into image data;

a second stage to convert viewport requests into compressed data object requests;

a third stage to create a compressed image object in response to a byte range response; and

a fourth stage to convert compressed image object requests to byte range requests.

52. The article of manufacture defined in claim 51 wherein two or more of the stages are performed in a single location.

53. The article of manufacture defined in claim 52 wherein the two or more stages are performed by a proxy server communicably coupled between the server and the client.

54. The article of manufacture defined in claim 53 wherein the two or more stages comprise second stage.

55. The article of manufacture defined in claim 53 wherein the two or more stages comprise third stage.

56. The article of manufacture defined in claim 51 wherein the first, second, third and fourth stages are performed at the server.

57. The article of manufacture defined in claim 51 wherein the first stage is performed at the client.

58. The article of manufacture defined in claim 51 wherein the second, third and fourth stages are performed at the server.

59. The article of manufacture defined in claim 51 wherein the first and second stages are performed at the client.

60. The article of manufacture defined in claim 51 wherein the third and fourth stages are performed at the server.

61. The article of manufacture defined in claim 51 wherein the first, second, third and fourth stages are performed at the client.

62. The article of manufacture defined in claim 51 further comprising instructions which when executed by the system cause the system to perform a decompressor stage to run a decoder on received data.

63. An apparatus for transporting a codestream of compressed data between a client and a server, the apparatus comprising:

a first stage to convert a sequence of compressed image object responses and viewports into image data;

a second stage to convert viewport requests into compressed data object requests;

a third stage to create a compressed image object in response to a byte range response; and

a fourth stage to convert compressed image object requests to byte range requests.

64. The apparatus defined in claim 63 wherein two or more of the stages are performed in a single location.

65. The apparatus defined in claim 63 wherein the two or more stages are performed by a proxy server communicably coupled between the server and the client.

66. The apparatus defined in claim 65 wherein the two or more stages comprise the second stage.

67. The apparatus defined in claim 65 wherein the two or more stages comprise the third stage.

68. The apparatus defined in claim 63 wherein the first, second, third and fourth stages are performed at the server.

69. The apparatus defined in claim 63 wherein the first stage is performed at the client.

70. The apparatus defined in claim 63 wherein the second, third and fourth stages are performed at the server.

71. The apparatus defined in claim 63 wherein the first and second stages are performed at the client.

72. The apparatus defined in claim 63 wherein the third and fourth stages are performed at the server.

73. The apparatus defined in claim 63 wherein the first, second, third and fourth stages are performed at the client.

74. The apparatus defined in claim 63 further comprising a decompressor stage to run a decoder on received data.

75. A method comprising:

a server receiving a request;

the server generating tile-parts that can be concatenated into a JPEG 2000 compliant codestream.

76. The method defined in claim 75. wherein the server generating tile-parts that can be concatenated into a JPEG 2000 compliant codestream comprises using POC markers to enable the tile-parts to correspond to a main header in the codestream.

77. An article of manufacture comprising one or more recordable media storing instructions thereon which, when executed by a system, cause the system to:

receive a request at a server; and

generate, at the server, tile-parts that can be concatenated into a JPEG 2000 compliant codestream.

78. The article of manufacture defined in claim 77 wherein the instructions to cause the system to generate tile-parts that can be concatenated into a JPEG 2000 compliant codestream comprises instructions which when executed by the system cause the system to use POC markers to enable the tile-parts to correspond to a main header in the codestream.

79. An apparatus comprising:

means for receiving a request; and

means for generating tile-parts that can be concatenated into a JPEG 2000 compliant codestream.

80. The apparatus defined in claim 79 wherein the means for generating tile-parts that can be concatenated into a JPEG 2000 compliant codestream comprises means for using POC markers to enable the tile-parts to correspond to a main header in the codestream.

81. A method comprising:

storing tile-parts on a server in a first order;

the server receiving a request from a client for the tile-parts, the request specifying a second order in which the client wants the tile-parts;

the server rearranging tile-parts within a tile to the second order;

sending rearranged tile-parts over a network.

82. The method defined in claim 81 further comprising the server writing a POC marker with some of the returned tile-parts.

83. The method defined in claim 82 wherein the POC marker specifying resolutions, layers, and components contained in said each tile-part.

84. A method of transporting portions of a JPEG 2000 image over a network, the JPEG 2000 image being part of a JPEG 20000 codestream, the method comprising:

requesting portions of the JPEG 2000 codestream; and

receiving the portions of the JPEG 2000 codestream as tile parts.

85. The method defined in claim 84 wherein receiving the portions of the JPEG 2000 codestream is via a HTTP response.

86. The method defined in claim 84 wherein requesting the portions of the JPEG 2000 codestream comprises requesting the tile parts using a range header.

87. The method defined in claim 84 wherein the range header comprises an HTTP range header.

88. The method defined in claim 84 further comprising indicating data available at the client to enable a server to determine that the tile parts are the only data necessary to be sent to the client to fulfill the request.

89. The method defined in claim 88 wherein the data available comprises regions the client previously received.

90. The method defined in claim 88 wherein the data available comprises tile parts the client has previously received.

91. The method defined in claim 84 further comprising:

storing the codestream in a file at a server in a progression order with tile parts for low resolutions stored earlier in the file than tile parts of higher resolutions.

92. The method defined in claim 91 wherein the progression order comprises a resolution-layer-component-position (RLCP) progression order.

93. The method defined in claim 92 wherein the progression order is such that tile parts are split at every resolution and every layer.

94. The method defined in claim 91 wherein the progression order comprises a layer-resolution-component-position (LRCP) progression order.

95. The method defined in claim 94 wherein the progression order is such that at least one tile is split into tile parts at a layer boundary only.

96. The method defined in claim 94 wherein the progression order includes coded data for a lossless representation.

97. The method defined in claim 96 wherein the coded data for the lossless representation is stored in the last tile-part of the progression order.

98. The method defined in claim 84 further comprising concatenating responses to a plurality of requests to form a codestream.

99. The method defined in claim 84 further comprising specifying one or more boxes for a parameter in a Tier 3 request to indicate one or more boxes a client is interested in.

100. The method defined in claim 99 further comprising specifying one or more subboxes.

101. The method defined in claim 84 further comprising requesting data on an image level and at least a portion of meta data at a byte-range.

102. A transport process using a series of stages to process a request from a client to a server and a response from the server to the client, wherein using the series of stages comprises:

converting viewport requests into tile parts by mapping a viewport to a set of tiles;

converting image object requests to byte range requests;

generating a byte range response; and

creating an image object from the byte range response.

103. The transport process defined in claim 102 further comprising running a decompressor on the image object.

104. The transport process defined in claim 102 further comprising:

generating a full resolution image;

cropping the full resolution image to obtain a region of interest; and

scaling the region of interest to a predetermined region of interest.

105. An article of manufacture comprising one or more recordable media storing instructions thereon which, when executed by a system, cause the system to:

convert viewport requests into tile parts by mapping a viewport to a set of tiles;

convert image object requests to byte range requests;

generate a byte range response; and

create an image object from the byte range response.

106. The article of manufacture defined in claim 105 further comprising instructions which when executed by the system cause the system to run a decompressor on the image object.

107. The article of manufacture defined in claim 105 further comprising instructions which when executed by the system cause the system to

generate a full resolution image;

crop the full resolution image to obtain a region of interest; and

scale the region of interest to a predetermined region of interest.

108. An apparatus comprising:

means for converting viewport requests into tile parts by mapping a viewport to a set of tiles;

means for converting image object requests to byte range requests;

means for generating a byte range response; and

means for creating an image object from the byte range response.

109. The apparatus defined in claim 108 further comprising means for running a decompressor on the image object.

110. The apparatus defined in claim 108 further comprising:

means for generating a full resolution image;

means for cropping the full resolution image to obtain a region of interest; and

means for scaling the region of interest to a predetermined region of interest.