Rotation and scaling optimization for mobile devices

• US 7,710,434 B2
• Filed: 05/30/2007
• Issued: 05/04/2010
• Est. Priority Date: 05/30/2007
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Gu, Chuang
• Primary Examiner(s): Sajous; Wesner
• Application Number:
  US11/755,082
• Publication Number:
  US 20080297532A1
• Time in Patent Office: 1,070 Days
• Field of Search: 345589-591, 345/593, 345600-601, 345/604, 345/606, 345618-619, 345629-630, 345649-660, 345/548, 345/549, 345/557, 345/574, 348/441, 348/467, 348/488, 348/552, 348/553, 348/557, 348580-584, 348/612, 348/630, 358518-525, 382/167, 382/254, 382/276, 382/293
• US Class Current: 345/589
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2340/06 Colour space transformation
• CPC Class Codes: G09G 2360/12 Frame memory handling
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters

Abstract

Image processing in mobile devices is optimized by combining at least two of the color conversion, rotation, and scaling operations. Received images, such as still images or frames of video stream, are subjected to a combined transformation after decoding, where each pixel is color converted (e.g. from YUV to RGB), rotated, and scaled as needed. By combining two or three of the processes into one, read/write operations consuming significant processing and memory resources are reduced enabling processing of higher resolution images and/or power and processing resource savings.

Claims

1. A method to be executed at least in part in a computing device for optimizing rotation and scaling operations on an image, the method comprising:

receiving an image to be rendered;

performing a transformation operation on the image that includes a combination of color conversion, rotation, and scaling, wherein the transformation is performed in a single loop on image data, wherein the color conversion comprises converting the received image from YUV color space to RGB color space by providing pixel location coordinates in the RGB color space to a rotation module for rotating the received image prior to a scaling operation performed by a scaling module for scaling the received image; and

storing the transformed image data to be rendered on a display.

2. The method of claim 1, wherein performing the transformation in a single loop includes:

reading the image data from a cache memory;

performing the transformation on the image data pixel-by-pixel; and

writing the transformed image data to the cache memory.

3. The method of claim 2, wherein the rotation and scaling transformation includes an affine transformation using:

i=ax+by+c;

j=dx+ey+f;

where x and y are pixel location coordinates in the YUV color space, i and j are pixel location coordinates in the RGB color space, and {a, b, c, d, e, f} are parameters defining a rotation angle and a scaling coefficient.

4. The method of claim 2, wherein the rotation and scaling transformation includes a non-affine transformation.

5. The method of claim 1, further comprising:

decoding the received image data prior to performing the transformation operation.

6. The method of claim 5, wherein the decoded image data is in the YUV color space.

7. The method of claim 6, wherein the transformed image data is in the RGB color space.

8. The method of claim 1, wherein the rotation and the scaling operations are performed to automatically adjust the received image to be rendered on a mobile device display.

9. The method of claim 1, wherein the image includes at least one from a set of:

a still image, a video stream frame, and a graphic.

10. A system for optimizing rotation and scaling operations on an image, the system comprising:

a cache memory;

a processor coupled to the memory, wherein the processor is configured to execute program modules including;

an image processing application that includes;

a transformation module configured to;

read decoded image data associated with a received image from the cache memory;

perform a transformation operation on the decoded image data that includes a combination of a color conversion, a rotation, and a scaling, wherein the transformation is performed in a single loop on the image data and wherein, during the color conversion, the received image is converted the image from YUV color space to RGB color space by pixel location coordinates in the RGB color space provided to a rotation module for rotating the received image prior to a scaling operation performed by a scaling module for scaling the received image; and

write the transformed image data to the cache memory; and

a rendering module for rendering the transformed image data to be displayed.

11. The system of claim 10, wherein the image processing application further includes a codec for decoding the received image data.

12. The system of claim 10, wherein the decoded image data is in the YUV color space and the transformed image data is in the RGB color space.

13. The system of claim 12, wherein the transformation module is configured to perform a rotation and scaling portion of the transformation using:

i=ax+by+c;

j=dx+ey+f;

where x and y are pixel location coordinates in YUV color space, i and j are pixel location coordinates in the RGB color space, and {a, b, c, d, e, f} are parameters defining a rotation angle and a scaling coefficient.

14. The system of claim 13, wherein the rotation and scaling portion of the transformation is for automatically adjusting the received image from one of a portrait presentation mode and a landscape presentation mode to another of the portrait presentation mode and the landscape presentation mode.

15. The system of claim 10, wherein the transformation module is further configured to combine at least one additional transformation operation with the color conversion, rotation, and scaling operations.

16. A computer-readable storage medium with instructions encoded thereon for optimizing rotation and scaling operations on an image, the instructions comprising:

receiving image data to be rendered on a mobile device display;

decoding the received image data;

writing the decoded image data to a cache memory;

reading the decoded image from the cache memory;

performing a transformation operation on the decoded image data that includes a combination of a color conversion, a rotation, and a scaling, wherein a rotation and scaling portion of the transformation is performed in a single loop using;

i=ax+by+c;

j=dx+ey+f;

where x and y are pixel location coordinates in YUV color space, i and j are pixel location coordinates in RGB color space, and {a, b, c, d, e, f} are parameters defining a rotation angle and a scaling coefficient;

writing the transformed image data to the cache memory; and

rendering the transformed image data on the mobile device display.

17. The computer-readable storage medium of claim 16, wherein the instructions further comprise:

determining the {a, b, c, d, e, f} parameters automatically based on a size, resolution, and an orientation of the mobile device display.

18. The computer-readable storage medium of claim 16, wherein the image data is for one of:

a still image and a video stream frame.

19. The computer-readable storage medium of claim 16, wherein the instructions further comprise:

performing at least one additional transformation operation in combination with the color conversion, rotation, and scaling operations.