Electronic devices for and methods of implementing memory transfers for image warping in an electronic device

• US 10,565,778 B2
• Filed: 08/22/2017
• Issued: 02/18/2020
• Est. Priority Date: 08/22/2017
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Goel, Manish, Subramaniam, Akila, Rithe, Rahul, Lee, Seok-Jun
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US15/682,777
• Publication Number:
  US 20190066358A1
• Time in Patent Office: 910 Days
• CPC Class Codes: G06F 13/10 Program control for peripheral devices G06F13/14 - G06F13/42 take precedence
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A method of implementing memory transfers for image warping in an electronic device is described. The method comprises receiving an input tile associated with an image; generating a geometric boundary around pixels of the input tile; and remapping the pixels in the geometric boundary to an output tile. An electronic device and a non-transitory computer readable storage medium for performing the method are also disclosed.

Claims

1. A method of implementing memory transfers for image warping in an electronic device, the method comprising:

receiving an input tile comprising a matrix of pixels associated with an image, wherein the matrix of pixels comprises a height and a width associated with a first area of the matrix;

generating, using a processor, a geometric boundary around pixels of the input tile to perform a memory transfer associated with image warping; and

remapping data associated with the pixels of the input tile associated with the image in the geometric boundary to an output tile;

wherein the geometric boundary is formed within the matrix and comprises a second area that is less than the first area; and

wherein the output tile is smaller than the input tile.

2. The method of claim 1 wherein the geometric boundary comprises a convex hull.

3. The method of claim 1 wherein the geometric boundary comprises a bounding box.

4. The method of claim 1 wherein the remapping of the data associated with the pixels in the geometric boundary comprises implementing a lookup table.

5. The method of claim 1 wherein the remapping of the data associated with the pixels in the geometric boundary comprises implementing a function that accounts for at least one of rotation, translation or perspective.

6. The method of claim 1 wherein the remapping of the data associated with the pixels in the geometric boundary comprises identifying minimum and maximum values along rows of the geometric boundary.

7. The method of claim 1 wherein the remapping of the data associated with the pixels in the geometric boundary comprises compensating for distortion caused by a lens of the electronic device.

8. An electronic device, comprising:

a lens;

a processor coupled to the lens, the processor configured to;

receive an input tile comprising a matrix of pixels associated with an image, wherein the matrix of pixels comprises a height and a width associated with a first area of the matrix;

generate a geometric boundary around pixels of the input tile to perform a memory transfer associated with image warping; and

remap data associated with the pixels of the input tile associated with the image in the geometric boundary to an output tile;

wherein the geometric boundary is formed within the matrix and comprises a second area that is less than the first area; and

wherein the output tile is smaller than the input tile.

9. The electronic device of claim 8 wherein the geometric boundary comprises a convex hull.

10. The electronic device of claim 8 wherein the geometric boundary comprises a bounding box.

11. The electronic device of claim 8 wherein the remapping of the data associated with the pixels in the geometric boundary comprises implementing a lookup table.

12. The electronic device of claim 8 wherein the remapping of the data associated with the pixels in the geometric boundary comprises implementing a function that accounts for at least one of rotation, translation or perspective.

13. The electronic device of claim 8 wherein the remapping of the data associated with the pixels in the geometric boundary comprises identifying minimum and maximum values along rows of the geometric boundary.

14. The electronic device of claim 8 wherein the remapping of the data associated with the pixels in the geometric boundary comprises compensating for distortion caused by a lens of the electronic device.

15. A non-transitory computer-readable storage medium having data stored therein representing instructions executable by a processor to perform a method comprising:

receiving an input tile comprising a matrix of pixels associated with an image, wherein the matrix of pixels comprises a first height and a first width associated with a first area of the matrix;

generating a geometric boundary around pixels of the input tile to perform a memory transfer associated with image warping; and

remapping data associated with the pixels of the input tile associated with the image in the geometric boundary to an output tile;

wherein the geometric boundary is formed within the matrix and comprises a second area that is less than the first area; and

wherein the output tile is smaller than the input tile.

16. The non-transitory computer-readable storage medium of claim 15 wherein the geometric boundary comprises a convex hull.

17. The non-transitory computer-readable storage medium of claim 15 wherein the geometric boundary comprises a bounding box.

18. The non-transitory computer-readable storage medium of claim 15 wherein the remapping of the data associated with the pixels in the geometric boundary comprises implementing a lookup table.

19. The non-transitory computer-readable storage medium of claim 15 wherein the remapping of the data associated with the pixels in the geometric boundary comprises implementing a function that accounts for at least one of rotation, translation or perspective.

20. The non-transitory computer-readable storage medium of claim 15 wherein the remapping of the data associated with the pixels in the geometric boundary comprises identifying minimum and maximum values along rows of the geometric boundary.

21. The non-transitory computer-readable storage medium of claim 15 wherein the remapping of the data associated with the pixels in the geometric boundary comprises compensating for distortion caused by a lens of the electronic device.