Image file generation device, image processing device, image file generation method, image processing method, and data structure for image files

• US 8,724,914 B2
• Filed: 07/29/2010
• Issued: 05/13/2014
• Est. Priority Date: 10/26/2009
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.), Sony Corporation (Sony Group Corp.)
• Inventors: Inada, Tetsugo
• Primary Examiner(s): Bayat, Ali
• Application Number:
  US13/502,409
• Publication Number:
  US 20120268465A1
• Time in Patent Office: 1,384 Days
• Field of Search: 382/240, 382/232, 382/233, 382/245, 382/246, 382/250, 382/251, 345/589, 345/428, 345/660, 345/619, 345/136, 341/79
• US Class Current: 382/240
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2360/122 Tiling
• CPC Class Codes: G09G 5/39 Control of the bit-mapped memory
• CPC Class Codes: G11B 27/329 on a disc [VTOC]

Abstract

Hierarchical data in which image data that represents an image at different resolutions is arranged according to the resolution comprises three types of data including a header, index blocks, and tile images. The header defines a plurality of areas produced by dividing the pyramidal hierarchical structure in the virtual space in which the hierarchical data is generated. A pointer pointing to one of the index blocks is set in each area. The index blocks are generated for the respective areas in the structure defined by the header. A pointer pointing to one of the tile images is defined for a position in the images in a plurality of layers belonging to each area. The images are image data actually used to render an image.

Claims

1. An image file generation device comprising:

an image hierarchy generation unit configured to generate a plurality of pieces of image data with different resolutions from input image data and to generate hierarchical data formed by hierarchizing the plurality of pieces of data according to resolution;

an image division unit configured to partition image data in each layer of the hierarchical data into tile images of a predetermined size;

an index creation unit configured to create index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations; and

an image file generation unit configured to generate an image file that includes data for the tile images and the index data,

wherein the index block creation unit creates the index data in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

2. The image file generation device according to claim 1, wherein the index block creation unit further generates header data that maps areas produced by partitioning the hierarchical structure to the corresponding index blocks, and the image file generation unit includes the header data and the index blocks in the index data.

3. The image file generation device according to claim 1, further comprising:

a redundancy detection unit configured to analyze an image in a layer of a given resolution so as to identify an area in a higher resolution image in a layer with a higher resolution that can be rendered by using data for a tile image included in the image in the layer of the given resolution,

wherein the index creation unit maps, in the index data, data for a tile image only to areas other than the area in the higher resolution image identified by the redundancy detection unit.

4. The image file generation device according to claim 1, further comprising:

a redundancy detection unit configured to analyze an image in a layer of a given resolution so as to identify an area in a higher resolution image in a layer with a higher resolution that can be rendered by using data for a tile image included in the image in the layer of the given resolution,

wherein, when the area in the higher resolution image identified by the redundancy detection unit extends over the entirety of an area produced by partitioning the hierarchical structure, the image file generation unit excludes from the image file the index block corresponding to said area in the higher resolution image.

5. The image file generation device according to claim 1, wherein the index data maps data for a single tile image to a plurality of tile locations, and the image file does not include data for a tile image not mapped in the index data.

6. The image file generation device according to claim 1, wherein each of the areas produced by partitioning the hierarchical structure includes corresponding areas in the images in a plurality of layers included in the hierarchical data.

7. The image file generation device according to claim 1, wherein the number of tile locations that can be mapped in a single index block to data for tile images is uniform across all index blocks.

8. An image processing device comprising:

a storage device configured to store an image file including data for tile images produced by partitioning, to a predetermined size, images in hierarchical data comprising image data that represents a single image at different resolutions, and including index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations;

an input information acquisition unit configured to acknowledge a user request to change a display area, the user request including a movement on an image plane or change of resolution; and

a tile image identification unit configured to identify data for a tile image necessary to render an area that should be newly displayed in accordance with the request to change a display area, by referring to the index block;

a display image processing unit configured to read the data for the identified tile image from the storage device and render the area that should be newly displayed,

wherein the index data is in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

9. The image processing device according to claim 8,

wherein the index data includes header data that maps areas produced by partitioning the hierarchical structure to the corresponding index blocks,

the tile image identification unit identifies data for the necessary tile image, by searching the header data based on information on an area that should be newly displayed, identifying one of the areas produced by partitioning the hierarchical structure that includes the area that should be displayed, and referring to the index block mapped to the identified area.

10. The image processing device according to claim 9,

wherein, when a tile location in an image that can be rendered by using data for a tile image included in an image in a layer of a lower resolution extends over the entirety of an area produced by partitioning the hierarchical structure, the header data maps invalid data to said area,

when the invalid data is mapped in the header data to an area including the area that should be newly displayed and produced by partitioning the hierarchical structure, the tile image identification unit searches the hierarchical data in a direction in which an image is reduced for an area including a reduced version of the area that should be newly displayed and mapped to a specific index block, so as to identify the specific index block and identify a tile image of the reduced version accordingly, and

the displayed image processing unit renders the area that should be newly displayed by enlarging the tile image identified by the tile image identification unit.

11. The image processing device according to claim 8,

wherein the index data maps invalid data to a tile location in an image that can be rendered by using data for a tile image included in an image in a layer of a lower resolution,

when the invalid data is mapped in the index data to a tile location included in the area that should be newly displayed, the tile image identification unit searches the hierarchical data in a direction in which an image is reduced for a tile location mapped to data for a specific tile image included in an area that is a reduced version of the area that should be newly displayed, so as to identify data for the specific tile image, and

the displayed image processing unit renders the area that should be newly displayed by enlarging the specific tile image identified by the tile image identification unit.

12. The image processing device according to claim 8, wherein the index data maps a tile location to data for a tile image belonging to a file different from the image file, designating identification information of the file, and the displayed image processing unit reads data for a tile image used in the area that should be newly displayed from the file designated by the index data and renders an image accordingly.

13. An image processing device comprising:

an image file acquisition unit configured to read an image file including data for tile images produced by partitioning, to a predetermined size, images in hierarchical data comprising image data that represents a single image at different resolutions, and including index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations;

an update information acquisition unit configured to acquire information on update to an image displayed by using the image file;

a tile image generation unit configured to generate data for a new tile image used to render an area to be updated, based on the update information;

an index data update unit configured to update data for a tile image mapped to a tile location defined in the index data as being included in the area to be updated to the data for the new tile image; and

an image file generation unit configured to generate an image file that includes data for the tile image generated by the tile image generation unit and the index data updated by the index data update unit,

wherein the index data is in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

14. The image processing device according to claim 13,

wherein the tile image generation unit generates data for new tile images used to render an area to be updated, for all layers forming the hierarchical data, and

the index data update unit updates data for tile images mapped to tile locations included in the area to be updated in all layers.

15. The image processing device according to claim 13,

wherein the tile image generation unit generates data for a new tile image used to render an area to be updated, only for a specific layer designated by the update information, and

the index data update unit updates data for a tile image mapped to a tile location included in the area to be updated in the specific layer.

16. The image processing device according to claim 13, wherein, when the update information designates writing of an image with a resolution higher than the highest resolution in the hierarchical data before the update, the index data update unit additionally defines tile locations in a new layer that has the resolution of the written image and that should be added to the hierarchical data, and maps those of the defined tile locations that should updated to tiles image that include the written image and that are newly generated by the tile image generation unit.

17. The image processing device according to claim 13, wherein, when the update information designates addition of a new image area to an image before the update, the index data update unit newly generates an area corresponding to a portion of the hierarchical structure that changes as a result of adding the new image area, and further generates the index block corresponding to the generated area.

18. The image processing device according to claim 17, wherein the tile image generation unit identifies an area of tile images in which the added image area and the image before the update coexist, and generates data for tile images where coexistence occurs in addition to data for a tile image of the added image area.

19. An image file generation method comprising:

generating a plurality of pieces of image data with different resolutions from input image data, generating hierarchical data formed by hierarchizing the plurality of pieces of data according to resolution, and storing the data in a memory;

reading image data in each layer of the hierarchical data from the memory and partitioning the read data into tile images of a predetermined size;

creating index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations, and storing the index data in the memory; and

generating an image file that includes data for the tile images and the index data, and storing the generated file in the memory,

wherein the creating of index data creates the index data in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

20. An image processing method comprising:

reading, from a memory, an image file including data for tile images produced by partitioning, to a predetermined size, images in hierarchical data comprising image data that represents a single image at different resolutions, and including index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations;

acknowledging a user request to change a display area including movement on an image plane and change of resolution;

identifying data for a tile image necessary to render an area that should be newly displayed in accordance with the request to change a display area, by referring to the index block; and

reading the data for the identified tile image from the memory, rendering the area that should be newly displayed, and displaying the rendered data on a display device;

wherein the index data is in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

21. An image processing method comprising;

reading, from a memory, an image file including data for tile images produced by partitioning, to a predetermined size, images in hierarchical data comprising image data that represents a single image at different resolutions, and including index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations;

acquiring information on update to an image displayed by using the image file;

generating data for a new tile image used to render an area to be updated, based on the update information, and storing the generated data in the memory;

updating data for a tile image mapped to a tile location defined in the index data as being included in the area to the data for the new tile image; and

generating an image file that includes data for the tile image generated by the tile image generation unit and the index data updated by the index data update unit, and storing the data in the memory,

wherein the index data is in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

22. A computer program embedded in a non-transitory computer-readable recording medium, comprising:

a module configured to generate a plurality of pieces of image data with different resolutions from input image data, generate hierarchical data formed by hierarchizing the plurality of pieces of data according to resolution, and store the data in a memory;

a module configured to read image data in each layer of the hierarchical data from the memory and partitioning the read data into tile images of a predetermined size;

a module configured to create index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations, and store the index data in the memory; and

a module configured to generate an image file that includes data for the tile images and the index data, and store the file in the memory,

wherein the module to create index data creates the index data in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

23. A computer program embedded in a non-transitory computer-readable recording medium, comprising:

a module configured to read, from a memory, an image file including data for tile images produced by partitioning, to a predetermined size, images in hierarchical data comprising image data that represents a single image at different resolutions, and including index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations;

a module configured to acknowledge a user request to change a display area including movement on an image plane and change of resolution;

a module configured to identify data for a tile image necessary to render an area that should be newly displayed in accordance with the request to change a display area, by referring to the index block; and

a module configured to read the data for the identified tile image from the memory, render the area that should be newly displayed, and display the rendered data on a display device;

wherein the index data is in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

24. A computer program embedded in a non-transitory computer-readable recording medium, comprising:

a module configured to read, from a memory, an image file including data for tile images produced by partitioning, to a predetermined size, images in hierarchical data comprising image data that represents a single image at different resolutions, and including index data that maps tile locations defined by partitioning an image in each layer of the hierarchical data into tile images to data for the tile images used to render the tile locations;

a module configured to acquire information on update to an image displayed by using the image file;

a module configured to generate data for a new tile image used to render an area to be updated, based on the update information, and store the generated data in the memory;

a module configured to update data for a tile image mapped to a tile location defined in the index data as being included in the area to the data for the new tile image; and

a module configured to generate an image file that includes data for the tile image generated by the tile image generation unit and the index data updated by the index data update unit, and store the data in the memory,

wherein the index data is in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

25. A data structure of an image file read from a storage device to display at least a part of an image on a display,

wherein the data structure maps data for tile images produced by partitioning, to a predetermined size, image data that represents a single image at different resolutions, to index data,

the index data mapping tile locations defined by partitioning an image in each layer of hierarchical data into tile images to data for the tile images used to render the tile locations, the hierarchical data being formed by hierarchizing said image data according to resolution, and

wherein the index data is in the form of index blocks that organize index data for respective tile locations, for each of areas produced by partitioning a hierarchical structure comprising the hierarchical data in a virtual space defined by an image plane of the hierarchical data and an axis of resolution perpendicular to the image plane.

26. The data structure of an image file according to claim 25,

wherein the number of tile locations that can be defined in a single index block is uniform across all index blocks.

27. The data structure of an image file according to claim 25, wherein the index data maps invalid data to a tile location in an image that can be rendered by using data for a tile image included in an image in a layer of a lower resolution, so as to indicate that an image can be rendered by using the included tile image.