Method and apparatus for processing photographic images

• US 20030095131A1
• Filed: 11/07/2002
• Published: 05/22/2003
• Est. Priority Date: 11/08/2001
• Status: Abandoned Application

• Current Assignee: EyeSee360, Inc.
• Original Assignee: EyeSee360, Inc.
• Inventors: Rondinelli, Michael
• Application Number:
  US10/289,701
• Publication Number:
  US 20030095131A1
• Time in Patent Office: Days
• US Class Current: 345/582
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations

Abstract

The present invention provides a method of processing images including the steps of retrieving a source image file including pixel data, mapping the source image file pixel data into at least one viewable image, mapping the source image file pixel data into at least one representation of one or more dormant properties of the viewable image, and displaying cooperatively the at least one viewable image and the at least one representation of the one or more dormant properties of the viewable image. The representations of the one or more dormant properties of the viewable image may be displayed adjacent to the viewable image, overlaid on the viewable image, and/or the viewable image may be transformed into a representation of the one or more dormant properties of the viewable image, and vice versa. The representations of the one or more dormant properties of the viewable image may include a perspective representation, a compass representation, an unwrapped cylinder representation, a globe representation, or a rear view mirror representation, and the dormant properties may include the panoramic nature of the viewable image, the current viewing direction of the viewable image, an additional view of a surrounding scene, or action occurring in another portion of the surrounding scene. Apparatus for processing images in accordance with the method is also provided.

Claims

1. A method of processing images, the method comprising the steps of:

retrieving a source image file including pixel data;

mapping the source image file pixel data into at least one viewable image;

mapping the source image file pixel data into at least one representation of one or more dormant properties of the at least one viewable image; and

displaying cooperatively the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image.

2. The method of claim 1, wherein the step of displaying cooperatively the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image comprises the steps of:

displaying the at least one viewable image; and

displaying the at least one representation of the one or more dormant properties of the at least one viewable image adjacent to the at least one viewable image.

3. The method of claim 1, wherein the step of displaying cooperatively the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image comprises the steps of:

overlaying the at least one representation of the one or more dormant properties of the at least one viewable image onto at least a portion of the at least one viewable image; and

displaying the at least one viewable image and the at least one overlaid representation of the one or more dormant properties of the at least one viewable image.

4. The method of claim 1, wherein the step of displaying cooperatively the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image comprises the steps of:

displaying the at least one viewable image; and

transforming over a period of time the at least one displayed viewable image into at least one displayed representation of the one or more dormant properties of the at least one viewable image.

5. The method of claim 1, wherein the step of displaying cooperatively the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image comprises the steps of:

displaying the at least one representation of the one or more dormant properties of the at least one viewable image; and

transforming over a period of time the at least one displayed representation of the one or more dormant properties of the at least one viewable image into at least one displayed viewable image.

6. The method of claim 1, wherein the at least one representation of the one or more dormant properties of the at least one viewable image comprises:

a perspective representation, a compass representation, an unwrapped cylinder representation, a globe representation, or a rear view mirror representation.

7. The method of claim 1, wherein the at least one representation of the one or more dormant properties of the at least one viewable image comprises a viewable image.

8. The method of claim 1, wherein the one or more dormant properties comprise:

a panoramic nature of the viewable image, a current viewing direction of the viewable image, an additional view of a surrounding scene, or action occurring in another portion of the surrounding scene.

9. The method of claim 1, further comprising the steps of:

pre-determining the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image to be cooperatively displayed; and

pre-determining how the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image will be cooperatively displayed.

10. The method of claim 1, further comprising the steps of:

allowing a user to determine the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image to be cooperatively displayed; and

allowing a user to determine how the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image will be cooperatively displayed.

11. An apparatus for processing images, the apparatus comprising:

means for retrieving a source image file including pixel data;

a processor for mapping the source image file pixel data into at least one viewable image and for mapping the source image file pixel data into at least one representation of one or more dormant properties of the at least one viewable image; and

means for cooperatively displaying the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image.

12. The apparatus of claim 11, wherein the means for cooperatively displaying the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image is the processor for:

displaying the at least one viewable image; and

displaying the at least one representation of the one or more dormant properties of the at least one viewable image adjacent to the at least one viewable image.

13. The apparatus of claim 11, wherein the means for cooperatively displaying the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image is the processor for:

overlaying the at least one representation of the one or more dormant properties of the at least one viewable image onto at least a portion of the at least one viewable image; and

displaying the at least one viewable image and the at least one overlaid representation of the one or more dormant properties of the at least one viewable image.

14. The apparatus of claim 11, wherein the means for cooperatively displaying the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image is the processor for:

displaying the at least one viewable image; and

transforming the at least one displayed viewable image into at least one displayed representation of the one or more dormant properties of the at least one viewable image.

15. The apparatus of claim 11, wherein the means for cooperatively displaying the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image is the processor for:

displaying the at least one representation of the one or more dormant properties of the at least one viewable image; and

transforming over a period of time the at least one displayed representation of the one or more dormant properties of the at least one viewable image into at least one displayed viewable image.

16. The apparatus of claim 11, wherein the at least one representation of the one or more dormant properties of the at least one viewable image comprises:

a perspective representation, a compass representation, an unwrapped cylinder representation, a globe representation, or a rear view mirror representation.

17. The apparatus of claim 11, wherein the at least one representation of the one or more dormant properties of the at least one viewable image comprises a viewable image.

18. The apparatus of claim 11, wherein the one or more dormant properties comprise:

a panoramic nature of the viewable image, a current viewing direction of the viewable image, an additional view of a surrounding scene, or action occurring in another portion of the surrounding scene.

19. A method of processing panoramic images, the method comprising the steps of:

retrieving a panoramic source image file including pixel data;

mapping the panoramic source image file pixel data into a viewable perspective image;

mapping the panoramic source image file pixel data into at least one representation of one or more dormant properties of the viewable perspective image; and

displaying cooperatively the perspective viewable image and the at least one representation of the one or more dormant properties of the perspective viewable image.

20. The method of claim 19, further comprising the step of:

mapping the panoramic source image file pixel data into one or more viewable perspective images.

21. An apparatus for processing panoramic images, the apparatus comprising:

means for retrieving a panoramic source image file including pixel data;

a processor for mapping the panoramic source image file pixel data into a viewable perspective image and for mapping the panoramic source image file pixel data into at least one representation of one or more dormant properties of the viewable perspective image; and

means for cooperatively displaying the viewable perspective image and the at least one representation of the one or more dormant properties of the viewable perspective image.

22. The apparatus of claim 21, wherein the processor further serves as means for mapping the panoramic source image file pixel data into one or more viewable perspective images.

23. A method of processing images, the method comprising the steps of:

creating a texture map memory buffer including pixel data from a source image;

producing a plurality of vertices for at least one primary model of at least one viewable image, wherein the vertices are representative of one or more points corresponding to one or more space vectors of the source image;

computing one or more texture map coordinates for each of the vertices of the at least one primary model, wherein the one or more texture map coordinates are representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image;

producing a plurality of vertices for at least one secondary model of at least one representation of one or more dormant properties of the at least one viewable image, wherein the vertices are representative of one or more points corresponding to one or more space vectors of the source image;

transferring the at least one primary model and the at least one secondary model, including the vertices and the one or more texture map coordinates, to a graphics hardware device; and

instructing the graphics hardware device to use the pixel data to complete the at least one primary model and the at least one secondary model and to cooperatively display the completed models as the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image.

24. The method of claim 23, further comprising the step of:

computing one or more texture map coordinates for each of the vertices of the at least one secondary model, wherein the one or more texture map coordinates are representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image;

25. The method of claim 23, wherein one or more of the steps may be repeated sequentially to display a plurality of viewable images and representations of one or more dormant properties of the viewable images at a video frequency rate.

26. The method of claim 24, wherein the step of instructing the graphics hardware device to cooperatively display the completed models as the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image comprises the steps of:

displaying the at least one viewable image; and

displaying the at least one representation of the one or more dormant properties of the at least one viewable image adjacent to the at least one viewable image.

27. The method of claim 24, wherein the step of instructing the graphics hardware device to cooperatively display the completed models as the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image comprises the steps of:

overlaying the at least one representation of the one or more dormant properties of the at least one viewable image onto at least a portion of the at least one viewable image; and

displaying the at least one viewable image and the at least one overlaid representation of the one or more dormant properties of the at least one viewable image.

28. The method of claim 23, further comprising the steps of:

producing the plurality of vertices and the one or more texture map coordinates for the at least one secondary model by transforming the at least one primary model into the at least one secondary model over a period of time; and

instructing the graphics hardware device to display the at least one completed primary model as it is transformed into the at least one completed secondary model.

29. The method of claim 28, further comprising the steps of:

transforming the at least one secondary model back into the at least one primary model over a period of time; and

instructing the graphics hardware device to display the at least one completed secondary model as it is transformed back into the at least one completed primary model.

30. The method of claim 23, wherein the at least one primary model comprises one of:

a cube, a hexahedron, a sphere, an ellipsoid, a cylinder, an unwrapped cylinder representation, an icosahedron, or a compass representation.

31. The method of claim 23, wherein the at least one secondary model comprises one of:

a cube, a hexahedron, a sphere, an ellipsoid, a cylinder, an unwrapped cylinder representation, an icosahedron, or a compass representation.

32. The method of claim 23, wherein the one or more dormant properties comprise:

a panoramic nature of the viewable image, a current viewing direction of the viewable image, an additional view of a surrounding scene, or action occurring in another portion of the surrounding scene.

33. The method of claim 23, further comprising the steps of:

pre-determining the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image to be cooperatively displayed; and

pre-determining how the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image will be cooperatively displayed.

34. The method of claim 23, further comprising the steps of:

allowing a user to determine the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image to be cooperatively displayed; and

allowing a user to determine how the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image will be cooperatively displayed.

35. An apparatus for processing images, the apparatus comprising:

a processor for creating a texture map memory buffer including pixel data from a source image, for producing a plurality of vertices for at least one primary model of at least one viewable image, wherein the vertices are representative of one or more points corresponding to one or more space vectors of the source image, for computing one or more texture map coordinates for each of the vertices of the at least one primary model, wherein the one or more texture map coordinates are representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image, and for producing a plurality of vertices for at least one secondary model of at least one representation of one or more dormant properties of the at least one viewable image, wherein the vertices are representative of one or more points corresponding to one or more space vectors of the source image; and

a graphics hardware device for receiving the at least one primary model and the at least one secondary model, including the vertices and the one or more texture map coordinates, for utilizing the pixel data to complete the at least one primary model and the at least one secondary model, and for cooperatively displaying the completed models as the at least one viewable image and the at least one representation of the one or more dormant properties of the at least one viewable image.

36. The apparatus of claim 35, wherein the processor further serves as means for:

computing one or more texture map coordinates for each of the vertices of the at least one secondary model, wherein the one or more texture map coordinates are representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image

37. The apparatus of claim 36, wherein the graphics hardware device further serves as means for:

displaying the at least one viewable image; and

displaying the at least one representation of the one or more dormant properties of the at least one viewable image adjacent to the at least one viewable image.

38. The apparatus of claim 36, wherein the graphics hardware device further serves as means for:

overlaying the at least one representation of the one or more dormant properties of the at least one viewable image onto at least a portion of the at least one viewable image; and

displaying the at least one viewable image and the at least one overlaid representation of the one or more dormant properties of the at least one viewable image.

39. The apparatus of claim 35, wherein the processor further serves as means for producing the plurality of vertices and the one or more texture map coordinates for the at least one secondary model by transforming the at least one primary model into the at least one secondary model;

and

the graphics hardware device further serves as means for displaying the at least one primary model as it is transformed into the at least one secondary model.

40. The apparatus of claim 35, wherein the processor further serves as means for transforming the at least one secondary model back into the at least one primary model over a period of time;

and

the graphics hardware device further serves as means for displaying the at least one completed secondary model as it is transformed back into the at least one completed primary model.

41. The apparatus of claim 35, wherein the at least one primary model comprises one of:

a cube, a hexahedron, a sphere, an ellipsoid, a cylinder, an unwrapped cylinder representation, an icosahedron, or a compass representation.

42. The apparatus of claim 35, wherein the at least one secondary model comprises one of:

a cube, a hexahedron, a sphere, an ellipsoid, a cylinder, an unwrapped cylinder representation, an icosahedron, or a compass representation.

43. The apparatus of claim 35, wherein the one or more dormant properties comprise:

a panoramic nature of the viewable image, a current viewing direction of the viewable image, an additional view of a surrounding scene, or action occurring in another portion of the surrounding scene.

47. The method of claim 42, wherein the one or more dormant properties comprise:

a panoramic nature of the viewable image, a current viewing direction of the viewable image, an additional view of a surrounding scene, or action occurring in another portion of the surrounding scene.

44. A method of processing images, the method comprising the steps of:

creating a texture map memory buffer including pixel data from a source image;

producing a plurality of vertices for at least one model of at least one viewable image, wherein the vertices are representative of one or more points corresponding to one or more space vectors of the source image;

computing a first set of one or more texture map coordinates for each of the vertices of the at least one model, wherein the first set of texture map coordinates is representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image;

computing a second set of one or more texture map coordinates for at least a portion of the vertices of the at least one model, wherein the second set of texture map coordinates is representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image;

transferring the at least one model, including the vertices and first and second set of texture map coordinates, to a graphics hardware device; and

instructing the graphics hardware device to use the pixel data to complete the at least one model and to display the at least one completed model as the at least one viewable image and at least one representation of one or more dormant properties of the at least one viewable image.

45. The method of claim 44, wherein one or more of the steps may be repeated sequentially to display a plurality of the viewable images and the representations of the one or more dormant properties of the viewable images, and wherein the plurality of viewable images may be displayed at a video frequency rate.

46. The method of claim 44, wherein the at least one model comprises one of:

a cube, a hexahedron, a sphere, an ellipsoid, a cylinder, an unwrapped cylinder representation, an icosahedron, a compass representation, or a rear view mirror representation.

48. An apparatus for processing images, the apparatus comprising:

a processor for creating a texture map memory buffer including pixel data from a source image, for producing a plurality of vertices for at least one model of at least one viewable image, wherein the vertices are representative of one or more points corresponding to one or more space vectors of the source image, for computing a first set of one or more texture map coordinates for each of the vertices of the at least one model, wherein the first set of texture map coordinates is representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image, and for computing a second set of one or more texture map coordinates for at least a portion of the vertices of the at least one model, wherein the second set of texture map coordinates is representative of one or more pieces of pixel data in the texture map memory buffer corresponding to one or more pieces of pixel data in the source image; and

a graphics hardware device for receiving the at least one model, including the vertices and first and second set of texture map coordinates, for utilizing the pixel data to complete the at least one model, and for displaying the at least one completed model as the at least one viewable image and at least one representation of one or more dormant properties of the at least one viewable image.

49. The apparatus of claim 48, wherein the at least one model comprises one of:

a cube, a hexahedron, a sphere, an ellipsoid, a cylinder, an unwrapped cylinder representation, an icosahedron, a compass representation, or a rear view mirror representation.

50. The method of claim 48, wherein the one or more dormant properties comprise:

a panoramic nature of the viewable image, a current viewing direction of the viewable image, an additional view of a surrounding scene, or action occurring in another portion of the surrounding scene.