Mutli-user 3D virtual reality interaction system utilizing protocol data units for data communication among WWW server and clients

• US 6,226,669 B1
• Filed: 12/16/1998
• Issued: 05/01/2001
• Est. Priority Date: 12/19/1997
• Status: Expired due to Fees

• Current Assignee: Jiung-Yao Huang
• Original Assignee: Jiung-Yao Huang
• Inventors: Huang, Jiung-Yao, Chang, Jia-Lin, Lee, Ai-Jye
• Primary Examiner(s): Luu, Le Hien
• Application Number:
  US09/212,420
• Time in Patent Office: 867 Days
• Field of Search: 709/230, 709/204, 709/205, 709/227, 380/24, 370/397, 370/352, 345/474
• US Class Current: 709/204
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

Real-time interactivity is provided across a shared multiple-participant three-dimensional (3D) virtual-reality environment on the World Wide Web (WWW), with the purpose of allowing a plurality of users to participate in a 3D virtual-reality world where the participants can share information and interact with each other substantially in real time. Through the use of a Client-Information Manager Program (CIMP) module, which is connected via a Common Gateway Interface (CGI) module to the WWW server, each user is able to interactively communicate with any of the other users participating together in the same 3D virtual-reality world. The shared multiple-participant 3D virtual-reality environment utilizes modified Protocol Data Unit (PDU) formats based on the Distributive tive Interactive Simulation (DIS) protocol for data communication among the WWW server and the various client sites. Moreover, the shared multiple-participant 3D virtual-reality environment utilizes a Dead Reckoning (DR) method with a predetermined optimal mal DR threshold to help reduce the rate of Object-State PDUs that are generated in response sponse to changes in each user'"'"'s avatar state, so that avatar state updates can be more quickly transmitted to all the other client sites participating in the same 3D virtual-reality world.

Claims

1. A method for use on a network system having a plurality of client sites and a WWW server providing a shared multiple-participant 3D virtual-reality environment, for the purpose of allowing the plurality of client sites to interact with each other in real time;

the method comprising the steps of;

(1) providing a CIMP module with a client table for registering client information about each client site participating in the shared multiple-participant 3D virtual-reality environment;

(2) linking the CIMP module via a CGI module to the WWW server;

(3) at a newcomer'"'"'s client site that just logs into the shared multiple-participant 3D virtual-reality environment, issuing a login request via the network system to the WWW server, causing the WWW server to download a virtual-reality scene file back to the newcomer'"'"'s client site;

(4) at the newcomer'"'"'s client site, issuing an Initial PDU via the network system to the WWW server when the downloaded virtual-reality scene file is received;

(5) at the WWW server, forwarding the received Initial PDU via the CGI module to the CIMP module;

(6) at the CIMP module, upon receiving the Initial PDU, performing the steps of;

(6-1) issuing an Acknowledge PDU with a uniquely-assigned User ID via the network system back to the newcomer'"'"'s client site;

(6-2) forwarding the received Initial PDU together with the newcomer'"'"'s User ID to every other client site that is previously registered in the client table indicative of current participation in the shared multiple-participant 3D virtual-reality environment;

(7) at any client site, if a change in avatar state occurs, issuing a corresponding Object-State PDU indicative of the change in avatar state to the CIMP module; and

(8) at the CIMP module, broadcasting the received Object-State PDU to every other client site currently participating in the shared multiple-participant 3D virtual-reality environment, if any.

2. The method of claim 1, wherein in the step (7), each Object-State PDU is generated in response to such a positional change in avatar state that the positional change causes the difference between the actual avatar position after the positional change and the predicted avatar position by a Dead Reckoning method exceeds a predetermined threshold.

3. The method of claim 2, wherein the predetermined threshold is three times the width of the avatar.

4. The method of claim 1, wherein the Initial PDU format, the Acknowledge PDU format, and the Object-State PDU format each include a PDU Header field for containing a PDU header for PDU identification, which includes:

a PDU Type field for indicating the type of the associated PDU;

a Time Stamp field for indicating the time when the associated PDU is issued;

a Scene Name field for indicating the filename of the downloaded virtual-reality scene file; and

a Scene ID field for indicating a uniquely identification name assigned to the 3D virtual-reality world represented by the downloaded virtual-reality scene file.

5. The method of claim 4, wherein the Initial PDU fonnat further includes:

a User Information field for containing user information about the identity of the user participating in the virtual-reality world; and

an LTP-UID field for containing three pieces of information respectively indicative of user'"'"'s login name, time stamp, and listening port at the client site.

6. The method of claim 5, wherein the User Information field in the Initial PDU format includes:

a User ID field for containing a unique user identification number assigned by the virtual-reality environment when the user successfully logs in;

an IP Address field for containing the IP address of the associated client site; and

an Avatar Type field for containing user'"'"'s selected avatar type in the virtual-reality environment.

7. The method of claim 4, wherein the Acknowledge PDU format further includes:

a User Information field for containing user information about the identity of the user participating in the virtual-reality world; and

an LTP-UID field for containing three pieces of information respectively indicative of user'"'"'s login name, time stamp, and listening port at the client site.

8. The method of claim 7, wherein the User Information field in the Acknowledge PDU format includes:

a User ID field for containing a unique user identification number assigned by the virtual-reality environment when the user successfully logs in;

an IP Address field for containing the IP address of the associated client site; and

an Avatar Type field for containing user'"'"'s selected avatar type in the virtual-reality environment.

9. The method of claim 4, wherein the Object-State PDU format further includes:

a Location field for storing the current location of the avatar of the associated client site;

a Linear Velocity field for storing the linearly velocity of the movement of the avatar of the associated client site;

a Orientation field for storing the current orientation of the avatar of the associated client site; and

a DR Parameter field for indicating a user-specified Dead Reckoning algorithm.

10. The method of claim 1, wherein the CIMP module utilizes Unreliable Datagram Protocol for data transfer of each Acknowledge PDU and Object-State PDU to each client site participating in the shared multiple-participant 3D virtual-reality environment.

11. A shared multiple-participant 3D virtual-reality system for use on a network system connecting to a plurality of client sites, capable of allowing real-time interactivity across the client sites participating therein;

the shared multiple-participant 3D virtual-reality system comprising;

(a) a WWW server for serving up a plurality of virtual-reality scene files, each representing a 3D virtual-reality world;

(b) a browser program running at each of the participating client sites;

(c) a CGI module connected to the WWW server; and

(d) a CIMP module having a client table, the CIMP module being coupled to the CGI module so that PDU information received by the WWW server can be forwarded from the WWW server to the CIMP module and being used for managing client information about every client site currently participating in the virtual-reality world, if any;

wherein

at a newcomer'"'"'s client site that just logs into the shared multiple-participant 3D virtual-reality environment, the browser program at the newcomer'"'"'s client site issues a login request via the network system to the WWW server, causing the WWW server to download a virtual-reality scene file back to the newcomer'"'"'s client site;

in response, the browser program at the newcomer'"'"'s client site issues an Initial PDU via the network system to the WWW server when the downloaded virtual-reality scene file is received;

in response, the WWW server forwards the received Initial PDU via the CGI module to the CIMP module;

at the CIMP module, upon receiving the Initial PDU, the CIMP module performs the steps of;

issuing an Acknowledge PDU with a uniquely-assigned User ID via the network system back to the newcomer'"'"'s client site;

forwarding the received Initial PDU together with the newcomer'"'"'s User ID to every other client site that is previously registered in the client table indicative of current participation in the shared multiple-participant 3D virtual-reality environment; and

at any client site, if a change in avatar state occurs, issuing a corresponding Object-State PDU indicative of the change in avatar state to the CIMP module which then broadcasts the received Object-State PDU to every other client site currently participating in the shared multiple-participant 3D virtual-reality environment, if any.

12. The shared multiple-participant 3D virtual-reality system of claim 11, wherein each Object-State PDU is generated in response to such a positional change in avatar state that the positional change causes the difference between the actual avatar position after the positional change and the predicted avatar position by a Dead Reckoning method exceeds a predetermined threshold.

13. The shared multiple-participant 3D virtual-reality system of claim 12, wherein the predetermined threshold is three times the width of the avatar.

14. The shared multiple-participant 3D virtual-reality system of claim 11, wherein the Initial PDU format, the Acknowledge PDU format, and the Object-State PDU format each include a PDU Header field for containing a PDU header for PDU identification, which includes:

a PDU Type field for indicating the type of the associated PDU;

a Time Stamp field for indicating the time when the associated PDU is issued;

a Scene Name field for indicating the filename of the downloaded virtual-reality scene file; and

a Scene ID field for indicating a uniquely identification name assigned to the 3D virtual-reality world represented by the downloaded virtual-reality scene file.

15. The shared multiple-participant 3D virtual-reality system of claim 14, wherein the Initial PDU format further includes:

a User Information field for containing user information about the identity of the user participating in the virtual-reality world; and

an LTP-UID field for containing three pieces of information respectively indicative of user'"'"'s login name, time stamp, and listening port at the client site.

16. The shared multiple-participant 3D virtual-reality system of claim 15, wherein the User Information field in the Initial PDU format includes:

a User ID field for containing a unique user identification number assigned by the virtual-reality environment when the user successfully logs in;

an IP Address field for containing the IP address of the associated client site; and

an Avatar Type field for containing user'"'"'s selected avatar type in the virtual-reality environment.

17. The shared multiple-participant 3D virtual-reality system of claim 14, wherein the Acknowledge PDU format further includes:

a User Information field for containing user information about the identity of the user participating in the virtual-reality world; and

an LTP-UID field for containing three pieces of information respectively indicative of user'"'"'s login name, time stamp, and listening port at the client site.

18. The shared multiple-participant 3D virtual-reality system of claim 17, wherein the User Information field in the Acknowledge PDU format includes:

a User ID field for containing a unique user identification number assigned by the virtual-reality environment when the user successfully logs in;

an IP Address field for containing the IP address of the associated client site; and

an Avatar Type field for containing user'"'"'s selected avatar type in the virtual-reality environment.

19. The shared multiple-participant 3D virtual-reality system of claim 14, wherein the Object-State PDU format further includes:

a Location field for storing the current location of the avatar of the associated client site;

a Linear Velocity field for storing the linearly velocity of the movement of the avatar of the associated client site;

a Orientation field for storing the current orientation of the avatar of the associated client site; and

a DR Parameter field for indicating a user-specified Dead Reckoning algorithm.

20. The shared multiple-participant 3D virtual-reality system of claim 11, wherein the CIMP module utilizes Unreliable Datagram Protocol for data transfer of each Acknowledge PDU and Object-State PDU to each client site participating in the shared multiple- participant 3D virtual-reality environment.