System and method for providing a functional virtual environment with real time extracted and transplanted images

• US 6,798,407 B1
• Filed: 11/28/2000
• Issued: 09/28/2004
• Est. Priority Date: 11/28/2000
• Status: Expired due to Term

• Current Assignee: William Benman
• Original Assignee: William Benman
• Inventors: Benman, William J.
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Nguyen, Kimbinh T.
• Application Number:
  US09/905,692
• Time in Patent Office: 1,400 Days
• Field of Search: 345/418, 345/419, 345/584, 345/473, 345/734, 345/738, 345/756, 345/757, 345/758, 345/582
• US Class Current: 345/419
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities

Abstract

A system and method for providing a functional virtual environment with real time extracted and transplanted images. The system includes hardware and software for providing a multi-dimensional computer generated environment and for receiving a plurality of extracted video images. The system is adapted to transplant the extracted video images into the environment in a manner that preserves the virtual metaphor thereof. In the illustrative embodiment, a realistic virtual city is created in accordance with the Virtual Reality Modeling Language (VRML) protocol. The extracted images are transplanted onto an object in the environment as a texture. In the best mode, the object is invisible. The extracted video images are streamed continuously into the environment such that a live real time interaction is enabled. The environment is networked and the system is adapted to receive multiple simultaneous streams which are transplanted and exported to enable a virtual community. Within the community, users seated in their native environment, appear to walk when navigating due to the unique teaching of the present invention by which a series of stored extracted images of the user walking are transplanted into the environment and replayed for so long as the user is navigating. A separate series is displayed to each person within a predetermined range of the walker that has the walker in his field of view depending on the viewing angle of the observer. A master copy of the environment is stored on a server and downloaded to each client on the network as part of a setup process. Thereafter, local changes in the environment are uploaded to the server and subsequently downloaded to selected clients as updates. The environment will support private areas and the system is adapted to allow extracted video streams within private environments to be sent to each person in the private environment directly, bypassing the server.

Claims

1. A system for transplanting extracted video image data comprising:

first means for providing a multi-dimensional computer generated environment, said first means including means for providing a three-dimensional computer generated environment, said environment including at least one object;

second means for receiving a plurality of video images extracted from a heterogeneous background; and

third means for transplanting said extracted video images into said environment, said third means including means for transplanting at least some of said extracted images into said environment as a texture on said object.

2. A system for transplanting extracted video image data comprising:

first means for providing a multi-dimensional computer generated environment;

second means for receiving a plurality of video images extracted from a heterogeneous background; and

third means for transplanting said extracted video images into said environment.

3. The invention of claim 2 wherein said environment includes at least one invisible object.

4. The invention of claim 3 wherein said third means includes means for transplanting at least some of said extracted images on said invisible object.

5. The invention of claim 2 wherein said extracted video image data includes dynamic foreground image data and excludes static background image data with respect to a native environment.

6. The invention of claim 2 wherein said extracted video images are streamed continuously.

7. The invention of claim 6 wherein said environment is a networked virtual environment.

8. The invention of claim 7 wherein said second means includes means for receiving plural simultaneous streams of extracted image data.

9. The invention of claim 8 wherein said third means includes means for transplanting said plural simultaneous streams of extracted image data.

10. The invention of claim 9 further including means for exporting at least one of said plural simultaneous streams of extracted image data.

11. The invention of claim 10 further including means for exporting a plurality of said simultaneous streams of extracted image data.

12. The invention of claim 11 further including means for selectively exporting said plurality of said simultaneous streams of extracted image data depending on a viewing angle of a participant in said networked virtual environment.

13. The invention of claim 11 wherein said means for exporting includes a server.

14. The invention of claim 13 further including means for effecting communication of at least one stream from a first participant to a second participant while bypassing said server.

15. The invention of claim 2 wherein said extracted video images are stored.

16. The invention of claim 15 wherein a subset of said stored images is transplanted depending on a viewing angle of an observer.

17. The invention of claim 2 wherein said second means includes a network.

18. The invention of claim 17 wherein said network is the Internet.

19. The invention of claim 17 wherein said network is an Intranet.

20. The invention of claim 17 wherein said network is a broadcast network.

21. The invention of claim 17 wherein said network is a multi-cast network.

22. The invention of claim 17 wherein said network is a wireless network.

23. The invention of claim 2 wherein said images are transplanted depending on a viewing angle of an observer.

24. A system for transplanting extracted video image data comprising:

first means for providing a multi-dimensional computer generated environment, said first means including means for providing a three-dimensional computer generated environment, said environment including at least one computer generated building, said first means includes means for adjusting the height of said building based on the amount of traffic therethrough;

second means for receiving a plurality of extracted video images; and

third means for transplanting said extracted video images into said environment.

25. The invention of claim 24 wherein said first means includes means for adjusting the height of said building based on the amount of traffic therethrough averaged over a predetermined time period.

26. A system for transplanting extracted video image data comprising:

first means for providing a multi-dimensional computer generated environment, said environment including at least one computer generated building, said first means includes means for adjusting the color of said building based on the amount of traffic therethrough;

second means for receiving a plurality of extracted video images; and

third means for transplanting said extracted video images into said environment.

27. The invention of claim 26 wherein said first means includes means for adjusting the color of said building based on the amount of instantaneous traffic therethrough.

28. A system for depicting a walking motion of a video avatar comprising:

first means for providing a multi-dimensional computer generated environment said first means including means for providing a three-dimensional computer generated environment created in accordance with the Virtual Reality Modeling Language protocol, said environment including at least one object;

second means for receiving a plurality of extracted video images extracted from a heterogeneous background;

third means for storing a set of said extracted images; and

fourth means for transplanting a series of said set of extracted video images into said environment depending on a viewing angle of an observer, said third means including means for transplanting at least some of said extracted images into said environment as a texture on said object.

29. The invention of claim 28 wherein said series of images represent a user in motion.

30. The invention of claim 29 wherein said motion is walking.

31. The invention of claim 30 wherein said series of images are repeated continuously while said user is navigating in said environment.

32. A system for transplanting extracted video image data comprising:

first means for providing a multi-dimensional computer generated networked virtual environment, said first means including means for providing a three-dimensional computer generated environment created in accordance with the Virtual Reality Modeling Language protocol, said environment including at least one object;

second means for receiving plural simultaneous continuous streams of video images extracted from a heterogeneous background, said second means further including means for selectively exporting at least one of said plural simultaneous streams of extracted image data depending on a viewing angle of a participant in said networked virtual environment; and

third means for transplanting said selectively exported simultaneous stream of extracted video images into said environment, said third means including means for transplanting at least some of said extracted images into said environment as a texture on said object.

33. A system for transplanting extracted video image data comprising:

first means for providing a multi-dimensional computer generated environment;

second means for receiving a plurality of video images extracted from a heterogeneous background; and

third means for transplanting a subset of said extracted video images into said environment depending on a viewing angle of an observer.

34. A system for transplanting extracted video image data comprising:

first means for providing a multi-dimensional computer generated environment;

second means for receiving a plurality of video images extracted from a heterogeneous background; and

third means for transplanting a subset of said extracted video images into said environment in real time.