Method and device for encoding a sub-aperture image of a set of sub-aperture images obtained from a plenoptic image

• US 20150319456A1
• Filed: 04/28/2015
• Published: 11/05/2015
• Est. Priority Date: 04/30/2014
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: LE FLOCH, HERV
• Application Number:
  US14/698,688
• Publication Number:
  US 20150319456A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding

Abstract

The invention relates to a method for encoding a plenoptic image comprising a plurality of microlens images, each microlens image formed by an associated microlens, the plenoptic image being associated with acquisition parameters of a plenoptic acquisition system with which the plenoptic image has been obtained, the method comprising decomposing the plenoptic image into a plurality of sub-aperture images, and encoding said plurality of sub-aperture images using one or more encoding parameters, which one or more encoding parameters are determined in dependence upon the acquisition parameters associated with the plenoptic image.

The invention also relates to a corresponding device for encoding a plenoptic image.

Claims

1. A method for encoding a plenoptic image comprising a plurality of microlens images, each microlens image formed by an associated microlens,

the plenoptic image being associated with acquisition parameters of a plenoptic acquisition system with which the plenoptic image has been obtained,

the method comprising;

decomposing the plenoptic image into a plurality of sub-aperture images, and

encoding the plurality of sub-aperture images using one or more encoding parameters, which one or more encoding parameters are determined-in dependence upon the acquisition parameters associated with the plenoptic image.

2. The method according to claim 1, comprising classifying the plenoptic image into one of a plurality of categories by comparing the acquisition parameters with predetermined threshold parameters defining the categories.

3. The method according to claim 2, wherein a first category is defined and wherein the sub-aperture images of a plenoptic image of the first category are encoded using a rate-distortion optimization process to determine encoding parameters.

4. The method according to claim 2, wherein a second category is defined and wherein at least one sub-aperture image of a plenoptic image of the second category is encoded using a restricted sub-set of encoding parameters.

5. The method according to claim 4, wherein the sub-aperture images corresponding to a plenoptic image are indexed to be encoded in an order defined by the index, and at least one sub-aperture image is encoded using encoding parameters determined for a lower indexed, sub-aperture image.

6. The method according to claim 5, wherein the lower indexed, sub-aperture image is encoded using a rate-distortion optimization process to determine encoding parameters.

7. The method according to claim 5, wherein the lower indexed, sub-aperture image is the second indexed sub-aperture image.

8. The method according to claim 5, wherein sub-aperture images are indexed to be encoded in an order defined by the index, and the first indexed, sub-aperture image is encoded using a rate-distortion optimization process to determine encoding parameters from a set of possible parameters, and wherein at least one higher indexed, sub-aperture image is encoded using parameters selected from a restricted sub-set of the possible parameters.

9. The method according to claim 2,

wherein determining the one or more encoding parameters comprises for each parameter to be determined:

determining, based on the category to which the plenoptic image belongs, a sub-set of possible encoding parameters based on the acquisition parameters; and

determining the encoding parameter to be used for encoding in the determined subset.

10. The method according to claim 1, wherein the encoding parameter comprises the size of a search area for motion estimation.

11. The method according to claim 1, wherein the sub-aperture images are encoded in blocks of pixels, a determined encoding parameter comprising an encoding mode of the blocks of pixels.

12. The method according to claim 1, wherein pixel blocks are independently encoded, a determined encoding parameter comprising a size of the blocks of pixels.

13. The method according to claim 11, wherein the block of pixels is a prediction unit.

14. The method according to claim 11, wherein the block of pixels is a coding unit.

15. The method according to claim 1, wherein the acquisition parameters comprise an aperture of a lens of the acquisition system.

16. The method according to claim 15, wherein the acquisition parameters comprise a focal length of a lens of the acquisition system.

17. The method according to claim 15, wherein the acquisition parameters comprise a distance of a focusing plane from the acquisition system.

18. The method according to claim 17, wherein the distance value of the focusing plane is determined using information provided by a camera autofocus system.

19. A device for encoding a plenoptic image comprising a plurality of microlens images, each microlens image formed by an associated microlens, the plenoptic image being associated with acquisition parameters of a plenoptic acquisition system with which the plenoptic image has been obtained,

the device comprising:

means configured to decompose the plenoptic image into a plurality of sub-aperture images, and

means configured to encode the plurality of sub-aperture images using one or more encoding parameters, which one or more encoding parameters are determined-in dependence upon the acquisition parameters associated with the plenoptic image.

20. A method for encoding a sub-aperture image of a plurality of sub-aperture images obtained from a plenoptic image,

the plenoptic image being associated with acquisition parameters of a plenoptic acquisition system from which the plenoptic image has been obtained,

the method comprising;

determining one or more encoding parameters and encoding the sub-aperture image using the determined encoding parameters,

wherein the determining of the one or more encoding parameters comprises for each parameter to be determined;

determining a subset of possible encoding parameters based on the acquisition parameters; and

determining the encoding parameter to be used for encoding in the determined subset.