Representation and coding of panoramic and omnidirectional images

• US 20060251336A1
• Filed: 07/12/2006
• Published: 11/09/2006
• Est. Priority Date: 12/03/2002
• Status: Active Grant

• Current Assignee: Dan Lelescu, Frank Jan Bossen
• Original Assignee: Dan Lelescu, Frank Jan Bossen
• Inventors: Lelescu, Dan, Bossen, Frank Jan
• Granted Patent: US 7,292,722 B2
• Time in Patent Office: Days
• US Class Current: 382/276
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

A method for representing an omni directional-like image by capturing an omni-directional-like image and determining a representation format that is commonly applicable to any image acquisition system that is able to capture the omni-directional-like image. The captured omni-directional-like image is mapped onto the determined representation format.

Claims

1. A method for representing an omni-directional-like image, comprising:

capturing an omni-directional-like image;

determining a representation format that is commonly applicable to any image acquisition system that is able to capture said omni-directional-like image; and

mapping said captured omni-directional-like image onto said determined representation format.

2. The method of claim 1, further comprising displaying said mapped omni-directional-like image.

3. The method of claim 1, wherein said determining comprises:

mapping points of said captured omni-directional-like image to the surface of a sphere.

4. The method of claim 3, wherein said sphere is centered about a center of projection of an image acquisition system that captures said captured omni-directional-like image.

5. The method of claim 1, wherein said determining comprises:

mapping points of said captured omni-directional-like image to a surface of a sphere; and

mapping points on said surface of said sphere to a sensor plane of a camera that captures said omni-directional-like image.

6. The method of claim 5, wherein said mapping points on said surface of said sphere to a sensor plane models an acquisition process of an image acquisition system that captures said omni-directional-like image.

7. The method of claim 1, wherein said determining comprises:

mapping points of said captured omni-directional-like image to a surface of a sphere; and

mapping points on said surface of said sphere to a surface of a solid inscribed within said sphere.

8. The method of claim 7, further comprising mapping points on said surface of said solid to an equatorial plane of said sphere.

9. The method of claim 8, wherein said equatorial plane corresponds to a sensor plane of a camera that captures said omni-directional-like image.

10. The method of claim 8, wherein a first image corresponding to a first hemisphere of said sphere is formed on said equatorial plane and a second image corresponding to a second hemisphere opposite said first hemisphere is formed on said equatorial plane.

11. The method of claim 10, further comprising packing said first image and said second image.

12. The method of claim 11, further comprising encoding said packed first image and said packed second image.

13. The method of claim 12, wherein said encoding takes into account the nature of said packed first image and said packed second image.

14. The method of claim 12, wherein said encoding takes into account optical flow characteristics of said packed first image and said packed second image.

15. The method of claim 12, further comprising decoding said encoded first and second packed images, wherein said decoding is universal in that it is the same irregardless of the type of image acquisition system used to capture said omni-directional-like image.

16. The method of claim 15, further comprising texture-mapping said decoded first and second packed images onto faces of a polyhedron to form a texture-mapped image.

17. The method of claim 16, further comprising displaying said texture-mapped image.

18. The method of claim 17, wherein said displaying comprises displaying a panoramic image of said texture-mapped image.

19. The method of claim 18, wherein said displaying comprises displaying a perspective view of said panoramic image.

20. The method of claim 18, wherein said panoramic image is generated interactively.

21. The method of claim 19, wherein said perspective view of said panoramic image is generated interactively.

22. The method of claim 11, further comprising encoding said first image and said second image.

23. The method of claim 22, wherein said encoding takes into account the nature of said first image and said second image.

24. The method of claim 22, wherein said encoding takes into account optical flow characteristics of said first image and said second image.

25. The method of claim 22, further comprising decoding said encoded first and second images, wherein said decoding is universal in that it is the same irregardless of the type of image acquisition system used to capture said omni-directional-like image.

26. The method of claim 25, further comprising texture-mapping said decoded first and second images onto faces of a polyhedron to form a texture-mapped image.

27. The method of claim 26, further comprising displaying said texture-mapped image.

28. The method of claim 27, wherein said displaying comprises displaying a panoramic image of said texture mapped image.

29. The method of claim 28, wherein said displaying comprises displaying a perspective view of said panoramic image.

30. The method of claim 28, wherein said panoramic image is generated interactively.

31. The method of claim 29, wherein said perspective view of said panoramic image is generated interactively.