Method and system for digital image acquisition and continuous zoom display from multiple resolutional views using a heterogeneous image pyramid representation

• US 6,681,056 B1
• Filed: 03/30/1999
• Issued: 01/20/2004
• Est. Priority Date: 03/30/1999
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Shae, Zon-Yin, Wang, Xiping, Tseng, Belle L., Hendriks, Ferdinand
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): Kassa, Yosef
• Application Number:
  US09/281,049
• Time in Patent Office: 1,757 Days
• Field of Search: 382/282, 382/284, 382/286, 382/294, 382/151, 382/103, 382/104, 382/123, 382/165, 382/170, 382/171, 382/175, 382/180, 382/190, 382/219, 382/275, 382/278, 382/293, 382/295, 382/299, 345/115, 345/435, 355/1.2, 355/453, 355/450, 355/537, 355/538, 355/540, 348/576, 348/580, 348/584
• US Class Current: 382/282
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

The invention allows a user to construct a collection of resolutionally non-uniform, captured digital image views of static scene, thereby defining the more interesting sections of the scene for viewing. The invention provides a system and a method for continuous zooming and display of composite image representation having different levels of resolution at different locations. The invention discloses techniques for acquisition of multiple resolution and overlapping digital images, composite representation of those captured images, and the continuous zooming display of the complete image data.

Claims

1. A system for collecting and using plural images of target object to allow a user to view selected regions of said target object with increasing degree of resolution and detail, said system comprising:

an image acquisition means for acquiring one image of the entire target object at a relatively low resolution, and for acquiring at least one additional image of a particular area of the target object and at a relatively high resolution;

a first processing means for determining image registration parameters of each of said images relative to a defined coordinate system;

a second processing means for constructing a pyramidal representation of said images;

a third processing means for creating a composite image of said target object using said pyramidal representation; and

a display means for displaying said composite image while allowing said user to view selected regions of said target object with an increasing degree of resolution and detail.

2. The system of claim 1, wherein said image acquisition means comprises:

a. a means for determining a desired position of a camera according to an author'"'"'s preferences;

b. a means for adjusting a direction and zoom of said camera according to said author'"'"'s preferences;

c. a means for capturing an image by photographing said target object; and

whereby steps (b) and (c) are repeated for each image requested by said author.

3. The system of claim 2, wherein said image acquisition means accepts the following parameters:

number of image inputs, resolution magnitudes, and image importance.

4. The system of claim 2, wherein said determined desired position of said camera is fixed.

5. The system of claim 1, wherein said first processing means further comprises means for compressing said images and for storing said compressed images and registration parameters.

6. The system of claim 1, wherein said first processing means further comprises means for calibrating and rectifying said images and for creating a corresponding collection of distortion-corrected images.

7. The system of claim 6, wherein said first processing means determines said registration parameters of said distortion-corrected images for a Global Coordinate System by determining alignment, scaling and rotation of said distortion-corrected images with respect to said Global Coordinate System.

8. The system of claim 1, wherein said second processing means sorts, orders and places said images according to said registration parameters.

9. The system of claim 8, wherein said second processing means re-orders said images of said constructed pyramidal representation according an editor'"'"'s preferences.

10. The system of claim 9, wherein said pyramidal representation accommodates different resolution magnification and different spacial offset, rotation, overlap, size and shape images.

11. The system of claim 10, wherein said images are sparsely resident anywhere in said pyramidal representation and are not confined to quantized levels.

12. The system of claim 10, wherein said third processing means dynamically generates one composite image for each user-selected view display to allow said user to continuously change view display, zoom in on image, translate said image, rotate said image, view said image through different lens perspectives.

13. The system of claim 12, wherein said third processing means dynamically generates a set of quantized composite images for texture mapping and allows pre-storage of required levels of texture maps.

14. The system of claim 9, wherein said third processing means creates said composite image using a view window, neighborhood pixels, and image interpolation.

15. A method for collecting and using plural images of a target object to allow a user to view selected regions of said target object with an increasing degree of resolution and detail, said method comprising the steps of:

acquiring one image of the entire target object at a relatively low resolution, and acquiring at least one additional image of a particular area of the target object and at a relatively high resolution;

determining image registration parameters of each of said images relative to a defined coordinate system;

constructing a pyramidal representation of said images;

creating a composite image of said target object using said pyramidal representation; and

displaying said composite image while allowing said user to view selected regions of said target object with an increasing degree of resolution and detail.

16. The method of claim 15, wherein said acquiring step comprises the steps of:

a. determining a desired position of a camera according to an author'"'"'s preferences;

b. adjusting a direction and zoom of said camera according to said author'"'"'s preferences;

c. capturing an image by photographing said target object; and

repeating steps (b) and (c) for each image requested by said author.

17. The method of claim 16, wherein said acquiring step accepts the following parameters:

number of image inputs, resolution magnitudes, and image importance.

18. The method of claim 16, wherein said determined desired position is fixed.

19. The method of claim 15, wherein said determining step further comprises steps of compressing said images;

and storing said compressed images and said registration parameters.

20. The method of claim 15, wherein said determining step further comprises a step of calibrating and rectifying said images to create a corresponding collection of distortion-corrected images.

21. The method of claim 20, wherein said determining step includes the step of determining said registration parameters of said distortion-corrected images for a Global Coordinate System by determining alignment, scaling and rotation with respect to said Global Coordinate System.

22. The method of claim 15, wherein said constructing step includes the step of sorting, ordering and placing said images according to said registration parameters.

23. The method of claim 22, wherein said constructing step includes the step of re-ordering said images of said constructed pyramidal representation according to an editor'"'"'s preferences.

24. The method of claim 23, wherein said composite image is created using a view window, neighborhood pixels, and image interpolation.

25. The method of claim 23, wherein said pyramidal representation accommodates different resolution magnification and different spacial offset, rotation, overlap, size and shape images.

26. The method of claim 25, wherein said images are sparsely resident anywhere in said pyramidal representation and are not confined to quantized levels.

27. The method of claim 25, wherein said creating step dynamically generates one composite image for each view display selected by said user to allow said user to continuously change view display, zoom in on an image, translate said image, rotate said image, view said image through different lens perspectives.

28. The method of claim 27, wherein said creating step dynamically generates a set of quantized composite images for texture mapping and allows pre-storage of required levels of texture maps.

29. A computer program device readable by a machine, tangibly embodying a program of instructions executable by a machine to perform method steps for collecting and using plural images of a target object to allow a user to view selected regions of said target object with an increasing degree of resolution and detail, said method comprising the steps of:

acquiring one image of the entire target object at a relatively low resolution, and acquiring at least one additional image of a particular area of the target object and at a relatively high resolution;

determining image registration parameters of each of said images relative to a defined coordinate system;

constructing a pyramidal representation of said images;

creating a composite image of said target object using said pyramidal representation; and

displaying said composite image while allowing said user to view selected regions of said target object with an increasing degree of resolution and detail.

30. The computer program device of claim 29, wherein said acquiring step comprises the steps of:

a. determining a desired position of a camera according to an author'"'"'s preferences;

b. adjusting a direction and zoom of said camera according to said author'"'"'s preferences;

c. capturing an image by photographing said target object; and

repeating steps (b) and (c) for each image requested by said author.

31. The computer program device of claim 30, wherein said acquiring step accepts the following parameters:

number of image inputs, resolution magnitudes, and image importance.

32. The computer program device of claim 30, wherein said determined desired position is fixed.

33. The computer program device of claim 29, wherein said determining step further comprises steps of compressing said images;

and storing said compressed images and said registration parameters.

34. The computer program device of claim 29, wherein said determining step further comprises a step of calibrating and rectifying said images to create a corresponding collection of distortion-corrected images.

35. The computer program device of claim 34, wherein said determining step includes the step of determining said registration parameters of said distortion-corrected images for a Global Coordinate System by determining alignment, scaling and rotation with respect to said Global Coordinate System.

36. The computer program device of claim 29, wherein said constructing step includes the step of sorting, ordering and placing said images according to said registration parameters.

37. The computer program device of claim 36, wherein said constructing step includes the step of re-ordering said images of said constructed pyramidal representation according to an editor'"'"'s preferences.

38. The computer program device of claim 37, wherein said pyramidal representation accommodates different resolution magnification and different spacial offset, rotation, overlap, size and shape images.

39. The computer program device of claim 38, wherein said images are sparsely resident anywhere in said pyramidal representation and are not confined to quantized levels.

40. The computer program device of claim 38, wherein said creating step dynamically generates one composite image for each view display selected by said user to allow said user to continuously change view display, zoom in on an image, translate said image, rotate said image, view said image through different lens perspectives.

41. The computer program device of claim 40, wherein said creating step dynamically generates a set of quantized composite images for texture mapping and allows pre-storage of required levels of texture maps.

42. The computer program device of claim 37, wherein said composite image is created using a view window, neighborhood pixels, and image interpolation.