System for manipulating digitized image objects in three dimensions

• US 5,999,641 A
• Filed: 11/19/1996
• Issued: 12/07/1999
• Est. Priority Date: 11/18/1993
• Status: Expired due to Term

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: The Duck Corporation (Alphabet Inc.)
• Inventors: Miller, Daniel B., Yurkovsky, Viktor
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): Tran, Phuoc
• Application Number:
  US08/751,374
• Time in Patent Office: 1,113 Days
• Field of Search: 382/100, 382/141, 382/154, 382/232, 382/285, 382/293, 382/296, 382/298, 382/305, 395/119, 395/120, 348/578, 364/410, 345/139, 345/419, 345/420
• US Class Current: 382/154
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 9/001 Model-based coding, e.g. wire frame

Abstract

This invention relates to a method and apparatus for displaying photo-realistic three-dimensionally projected views of real objects in real scenes and enabling the viewer to manipulate these objects and the scene with several degrees of freedom, such as rotation, zooming, or otherwise "handling" them as though they were physically manipulated.

Claims

1. A system for remotely and electronically manipulating image objects in three dimensions, comprising:

means for capturing a plurality of images of an object from different directions around said object;

means for generating a digital signal having information representing each of said plurality of image and the spatial location of each of said plurality of images in relation to said means, said plurality of images being views of said object on a background;

a digital compressor, said digital compressor being capable of processing said digital signal to remove information in said signal corresponding to said background of said images and generating digitally compressed information lacking said background information;

a storage unit for storing said digitally compressed information, as a database of a plurality of views of said object, and;

a control unit connected to said storage means to address said digitally compressed information stored on said storage unit wherein said control unit can be controlled by an operator to access said digitally compressed information and to manipulate said object on an image display unit connected to said control unit and to said storage unit to form a display of said object.

2. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein images all around said object are formed.

3. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein said object comprises a plurality of objects.

4. A system for remotely and electronically manipulating real image objects in three dimensions according to claim 3, further comprising a manually controlled input means connected to said control unit.

5. A system for remotely and electronically manipulating image objects in three dimensions according to claim 4, wherein said manually controlled input means comprises a mouse.

6. A system for remotely and electronically manipulating image object in three dimensions according to claim 1, wherein said means to form said plurality of images comprises a camera.

7. A system for remotely and electronically manipulating image objects in three dimensions according to claim 6, wherein said camera is moved around said object.

8. A system for remotely and electronically manipulating image objects in three dimensions according to claim 7, wherein said camera is moved in a spiral path around said object.

9. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein said control unit and said image display form means to create a scene on said image display utilizing any of the plurality of stored images.

10. A system for remotely and electronically manipulating image objects in three dimensions according to claim 9, wherein said plurality of images comprises overlapping objects capable of being mapped onto and off from other of said images.

11. A system for remotely and electronically manipulating image objects in three dimensions according to claim 9, wherein said control unit comprises means to move said plurality of images.

12. A system for remotely and electronically manipulating image objects in three dimensions according to claim 9, wherein said storage unit comprises means to store digital information corresponding to background scenes to be used with any of said plurality of stored images.

13. A system for remotely and electronically manipulating image objects in three dimensions according to claim 12, wherein said background comprises a moving scene.

14. A system for remotely and electronically manipulating image objects in three dimensions according to claim 12, wherein said background is stationary.

15. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein said means for generating a digital signal comprises means to create a standard blue background of each of said formed images.

16. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein said manipulation of said object includes zooming in on said object.

17. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1,wherein said manipulation of said object comprises rotating said object.

18. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein said camera is located inside the object being viewed and said object is moved relative to said camera.

19. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein said means to form a plurality of images comprises a plurality of cameras.

20. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, further comprising an audio command controlled input means connected to said control unit.

21. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, further comprising a first location where said means for capturing a plurality of images is implemented in real time and a second location remote from said first location where said control unit is controlled by an operator.

22. A system for remotely and electronically manipulating image objects in three dimensions according to claim 21, wherein said control unit located at said second location receives a plurality of images from different sources at a plurality of different first locations.

23. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, further comprising means to form and store artificial computer generated images to be used with said control unit to be displayed on said image display unit in conjunction with said display of said object.

24. A system for remotely and electronically manipulating image objects in three dimensions according to claim 1, wherein said object is in motion.