Method and apparatus for clipping video information before scaling

• US 7,215,345 B1
• Filed: 04/09/1999
• Issued: 05/08/2007
• Est. Priority Date: 04/09/1999
• Status: Expired due to Term

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Hanko, James G.
• Primary Examiner(s): Brier; Jeffery A.
• Application Number:
  US09/289,785
• Time in Patent Office: 2,951 Days
• Field of Search: 345/434, 345/344, 345/433, 345/340, 345/435, 345/24, 345/16, 345/620, 345/719, 345/590, 345/720, 345/619, 345/721, 345/629, 345/722, 345/621, 345/723, 345/622, 345/724, 345/623, 345/725, 345/624, 345/726, 345/625, 345/628, 348 1401- 1413, 348/739, 348/565, 248917-924, 248 91- 94, 248114-116, 725/1, 725/12, 725/20, 725/117, 725/41, 704500-504, 382232-253, 382/70, 370/477, 37524001-24029
• US Class Current: 345/620
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/440263 by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/47 End-user applications

Abstract

A method and apparatus for clipping video information before scaling. In an embodiment of the invention, a transmitter obtains video information in the form of image data, as well as clipping information defining one or more display regions in which the image data is to be displayed. In accordance with the clipping information, the transmitter performs clipping operations on the image data, and transmits the clipped image data to a receiver. Prior to displaying the clipped image data, the receiver performs any needed scaling of the clipped image data to conform to the dimensions of the display regions. By performing clipping operations prior to transmission, and scaling operations subsequent to transmission, unnecessary image data is omitted and greater transmission efficiency is achieved.

Claims

1. A method comprising:

obtaining image data on a server, the image data defining a complete image having a horizontal extent and a vertical extent when rendered in a display;

clipping said image data on said server to obtain clipped image data, the clipped image data representing a portion of the complete image when rendered in the display;

transmitting said clipped image data from a transmitter on said server via a computer network without conversion to a receiver on a client;

said receiver scaling said clipped image data for display; and

said receiver displaying said scaled clipped image data,

wherein clipping said image data includes obtaining by said server a clip-list specifying at least one clipping rectangle, the at least one clipping rectangle defining a portion of the complete image having the horizontal extent and the vertical extent, and

wherein clipping said image data includes mapping by said server of said at least one clipping rectangle to said image data to determine said clipped image data, wherein the mapping includes determining for each of two diagonally opposed corner locations of said at least one clipping rectangle one respective nearest pixel in said image data.

2. The method of claim 1, wherein determining a nearest pixel is based on a Euclidean distance.

3. The method of claim 1, wherein said clipped image data are further compressed, wherein said clipped and compressed image data comprises one or more subsampled chroma components and one or more differentiated and quantized luma components, and wherein determining said nearest pixel further comprises:

determining a plurality of pixels that comprise samples from said one or more subsampled chroma components and values from said one or more differentiated and quantized luma components; and

determining said nearest pixel from said plurality of pixels.

4. The method of claim 1, wherein said at least one clipping rectangle comprises a plurality of clipping rectangles, and wherein mapping comprises mapping said plurality of clipping rectangles to a plurality of regions of image data.

5. The method of claim 4, wherein transmitting comprises individually transmitting said plurality of clipping rectangles of image data.

6. The method of claim 4, wherein scaling comprises independently scaling up said plurality of regions of image data by said client to fill respective regions of a display.

7. The method of claim 6, wherein said independently scaling said plurality of regions of image data comprises applying independent scale factors that reduce scaling along a horizontal axis and increase scaling along a vertical axis.

8. The method of claim 1, wherein said client is a thin client computer.

9. The method of claim 1, wherein said computer network is a shared network.

10. The method of claim 9, wherein said shared network is a low bandwidth network.

11. The method of claim 9, wherein said computer network is a digital network.

15. The computer readable medium of claim 11, wherein said at least one clipping rectangle comprises a plurality of clipping rectangles, and wherein said program instructions for directing said server to map comprises program instructions for directing said server to map said plurality of clipping rectangles to a plurality of regions of image data.

16. The computer readable medium of claim 15, wherein said program instructions for directing said server to transmit comprises program instructions for directing said server to individually transmit said plurality of regions of image data.

17. The computer readable medium of claim 15, wherein said program instructions for directing said receiver to scale comprises program instructions for directing said receiver to independently scale up said plurality of regions of image data to fill respective regions of a display.

18. The computer readable medium of claim 17, wherein said program instructions for directing said receiver to independently scale said plurality of regions of image data comprises program instructions for directing said receiver to apply independent scale factors that reduce scaling along a horizontal axis and increase scaling along a vertical axis.

12. A computer readable medium encoded with computer program instructions for processing image data, the computer program instructions comprising:

program instructions for directing a server to obtain image data, the image data defining a complete image having a horizontal extent and a vertical extent when rendered in a display;

program instructions for directing said server to clip said image data to obtain clipped image data, the clipped image data representing a portion of the complete image when rendered in the display;

program instructions for directing said server to transmit said clipped image data via a computer network without conversion to a receiver on a client;

program instructions for directing said receiver to scale said clipped image data for display; and

program instructions for directing said receiver to display said clipped image data,

wherein said program instructions for directing said server to clip said image data includes program instructions for directing said server to obtain a cliplist specifying at least one clipping rectangle, the at least one clipping rectangle defining a portion of the complete image having the horizontal extent and the vertical extent, and program instructions for directing said server to map said at least one clipping rectangle to said image data to determine said clipped image data and to cause said server to determine for each of two diagonally opposed corner locations of said at least one clipping rectangle one respective nearest pixel in said image data.

13. The computer readable medium of claim 12, wherein said program instructions for directing said server to determine a nearest pixel determines a Euclidean distance.

14. The computer readable medium of claim 12, wherein said clipped image data are further compressed, wherein said clipped and compressed image data comprises one or more subsampled chroma components and one or more differentiated and quantized luma components, and wherein said program instructions for directing said server to determine said nearest pixel further comprises:

program instructions for directing said server to determine a plurality of pixels that comprise samples from said one or more subsampled chroma components and values from said one or more differentiated and quantized luma components; and

program instructions for directing said server to determine said nearest pixel from said plurality of pixels.

19. The computer readable medium of claim 12, wherein said client is a thin client computer.

20. The computer readable medium of claim 12, wherein said computer network is a shared network.

21. The computer readable medium of claim 20, wherein said shared network is a low bandwidth network.

22. The computer readable medium of claim 12, wherein said computer network is a digital network.

23. An apparatus comprising:

a network;

a thin client;

a server configured to obtain image data and perform a mapping of at least one clipping rectangle to said image data to obtain clipped image data, the server configured to perform the mapping by determining for each of two diagonally opposed corner locations of said at least one clipping rectangle one respective nearest pixel in said image data, said server further configured to transmit said clipped image data over said network; and

a receiver on said thin client configured to receive said clipped image data without conversion over said network, said receiver further configured to scale said clipped image data for display and display said scaled clipped image data.

24. The apparatus of claim 23, wherein said at least one clipping rectangle is defined within a clip-list accessible to said server.

25. The apparatus of claim 23, wherein said server is configured to determine said nearest pixel based upon a Euclidean distance.

26. The apparatus of claim 23, wherein said clipped image data are further compressed, wherein said clipped and compressed image data comprises at least one subsampled chroma component and at least one differentiated and quantized luma components, and wherein said server is configured to determine said nearest pixel from a plurality of pixels that comprise samples from said at least one subsampled chroma component and values from said at least one differentiated and quantized luma component.

27. The apparatus of claim 23, wherein said server is configured to map a plurality of clipping rectangles to a plurality of regions of image data.

28. The apparatus of claim 27, wherein said server is configured to individually transmit said plurality of regions of image data to said receiver.

29. The apparatus of claim 27, wherein said receiver is configured to independently scale up said plurality of regions of image data to fill respective regions of a display.

30. The apparatus of claim 29, wherein said receiver is configured to apply independent scale factors to said regions of image data and wherein said scale factors reduce scaling along a horizontal axis and increase scaling along a vertical axis.

31. The apparatus of claim 23, wherein said network is a shared, low bandwidth network.

32. The apparatus of claim 31, wherein said network is a digital network.

33. The apparatus of claim 23, wherein said thin client provides a network interface to a user and wherein said server provides a plurality of computational services removed from said thin client to said user.

34. The apparatus of claim 33, wherein said plurality of computational services comprise a computational power and a state maintenance for said thin client.

35. The apparatus of claim 23, wherein said image data is clipped only at said server and said clipped image data is scaled only at said thin client in order to provide greater image data transmission efficiency from said server to said thin client via said network.

36. The apparatus of claim 23, further comprising a clip-list identifying visible region displayed on the client, wherein said server is configured to obtain a copy of said clip-list and wherein said copy of said clip-list residing on said server is used by said server to obtain said clipped image data from said obtained image data.

37. An apparatus comprising:

means on a server for obtaining image data, the image data defining a complete image having a horizontal extent and a vertical extent when rendered in a display;

means on a server for mapping at least one clipping rectangle to the image data to obtain clipped image data, wherein the mapping includes determining for each of two diagonally opposed corner locations of said at least one clipping rectangle one respective nearest pixel in the image data, wherein the clipped image data represents a portion of the complete image when rendered in the display;

means for transmitting said clipped image data via a computer network from a transmitter on said server without conversion to a receiver on a thin client, wherein said computer network is a shared, low bandwidth network;

means, at said receiver, for scaling said clipped image data for display; and

means at said receiver for displaying said clipped image data.

38. The apparatus of claim 37, wherein said computer network is a digital network.