COLLABORATIVE AUGMENTED VIRTUALITY SYSTEM

• US 20090271715A1
• Filed: 01/29/2008
• Published: 10/29/2009
• Est. Priority Date: 01/29/2008
• Status: Abandoned Application

• Current Assignee: Ramakrishna J. Tumuluri
• Original Assignee: Ramakrishna J. Tumuluri
• Inventors: Tumuluri, Ramakrishna J.
• Application Number:
  US12/021,303
• Publication Number:
  US 20090271715A1
• Time in Patent Office: Days
• US Class Current: 715/757
• CPC Class Codes: A61B 2034/256 having a database of accessory information, e.g. including context sensitive help or scientific articles
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: G06T 17/005 Tree description, e.g. octree, quadtree
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 2210/61 Scene description
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system for use on a computer network 112 where multiple users can simultaneously experience “Virtual Worlds” 102 augmented with inputs from the real world via instruments such as Microscopes, Telescopes, 3D scanners etc. These “Collaborative Augmented Virtuality” systems can be made to be compliant with “laws of science” using “Science Engines” 108. Changes in the system can be persistent into local database(s) 160.

Claims

1. A computer-network based “

Collaborative Augmented Virtuality System”

that comprises standards compliant browser having plurality of objects and programming interfaces to interpret, render and/or provide interactivity to “

Virtual world”

, a remoting system on the network to enable packaging of events into network objects which is invoked from across a computer network and to communicate with the virtual world through the programming interface, an Engine interfaced to a SceneGraph through the programming interface and plurality of client-server systems across any of computer network.

2. The “

Collaborative Augmented Virtuality System”

as claimed in claim 1, wherein the system further comprises

a. an interactive, 3d representation of a given topic; and

b. an image and/or Video and/or “

3D model”

representation of said topic obtained from plurality of instruments which augments the “

virtual reality”

.

3. The “

Collaborative Augmented Virtuality System”

as claimed in claim 1, wherein the plurality of objects are abstracted into the SceneGraph structure from a group comprising objects from the “

Virtual World”

such as geometries, interpolators, sensors etc and that are augmented from the “

Real World”

.

4. The Collaborative Augmented Virtuality system as claimed in claim 1, wherein the engine is Science Engine further comprises Physics engine, Chemistry engine and biology engine.

5. The Collaborative Augmented Virtuality system as claimed in claim 4, wherein the physics engine implements laws of physics, the chemistry engine implements laws of chemistry;

the biology engine implements laws of biology and these science engines interpret directives predefined in their corresponding Markup Language specifications PhysicsML, ChemistryML and BiologyML respectively.

6. The Collaborative Augmented Virtuality system as claimed in claim 1, wherein the programming interface is an EAI in the Vrml97 standard and/or SAI in X3d standard and these interfaces are conceived in java environment.

7. The Collaborative Augmented Virtuality system as claimed in claims 1 and 6, wherein the programming interface provides access to the SceneGraph to carry out plurality of functions selected from a group such as changing color of geometry, changing size of the geometry and other related functions.

8. The Collaborative Augmented Virtuality system as claimed in claim 1, wherein the system further comprises general-purpose User-Interface to tie all other programs that are presented to end user where the end user uses the “

Collaborative Augmented Virtuality”

system.

9. The Collaborative Augmented Virtuality system as claimed in claim 1, wherein the plurality of client server systems are collaborative systems selected from a group comprising microscope client-server, telescope client-server, video client-server, scanner client-server and presentation client-server systems or a combination thereof.

10. The Collaborative Augmented Virtuality system as claimed in claim 9, wherein

a. the microscope client enables the end user to operate a remote-microscope across a computer network and to also accept and display any image produced by the digital microscope to which it is connected with help of said microscope server;

b. the telescope client to enables the end user to operate a remote-controlled telescope across a network and to also accept and display any image produced by the digital telescope to which it is connected with help of said telescope server;

c. the video client enables the end-user to play videos obtained from the video-server and to also enables the user to collaborate on the playing experience with buddies in his buddy list;

d. the scanner client enables the end-user to control a remote-controlled 3D scanner through the computer network using the scanner-server; and

e. the presentation client built on top of “

impress”

program to enable the end-user to play a presentation and to also enable the user to collaborate on the playing experience with buddies in his buddy list.

11. The Collaborative Augmented Virtuality system as claimed in claim 6, wherein the “

Science Engine”

is expressed using markup languages, enabling advanced “

Semantic Querying”

, comprising,

a. Specification of Scientific assertions in an XML language preferably RDF (Resource Description Framework),

b. Specification of an ontology of laws in an XML language preferably OWL (Web Ontology Language), and

c. Storage of the “

assertions” and

“

ontology”

in an XQuery enabled XML Database.

12. The Collaborative Augmented Virtuality system as claimed in claims 1 and 2, wherein the system enables changes made in the user'"'"'s environment to persist even after the system is shutoff, with the help of sub components provided in the system comprising

a. an XML database engine to store the SceneGraph that describes the “

Virtual Reality”

world;

b. said “

XML database”

has a replication feature such that parts of the representation/schema are automatically replicated with other database engines that are setup to participate in the replication arrangement; and

c. a user-interface component allowing the user to control the “

persistence mechanism”

such as ON or OFF.

13. The Collaborative Augmented Virtuality system as claimed in claim 12, wherein the changes made to the “

virtual world”

by the end-user and/or by his buddies is persisted to permanent storage and among other things, “

notes” and

such metadata are also persisted with the “

virtual reality”

world.

14. The Collaborative Augmented Virtuality system as claimed in claim 1, wherein the remoting system on the network is a JAVA-RMI enabled system.

15. A method for computer-network based Collaborative Augmented Virtuality system comprising

i. generating an end-user events using computer peripheral and/or from within SceneGraph of the “

Virtuality System”

;

ii. parsing generated events by operating system and thereby passing parsed events on to java virtual machine to prepare network objects preferably Java event objects;

iii. remoting the objects onto RMI subsystem and thereafter transferring the objects over network; and

iv. invoking transferred objects by a registered client across the computer network into his native computer to display the end-user events.