System and method for collaborative viewing of a four dimensional model requiring decision by the collaborators

• US 8,954,862 B1
• Filed: 10/01/2009
• Issued: 02/10/2015
• Est. Priority Date: 10/01/2008
• Status: Expired due to Fees

• Current Assignee: Valador, Inc.
• Original Assignee: Valador, Inc.
• Inventors: Mabie, Kevin T., Spiker, Fred, McArthur, Franklin T., Srey, Tate S., Bonilla, Dennis R.
• Primary Examiner(s): Abdul-Ali, Omar
• Assistant Examiner(s): Jiang, Haimei
• Application Number:
  US12/572,264
• Time in Patent Office: 1,958 Days
• Field of Search: 715751-759
• US Class Current: 715/751
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A method and system for documenting collaboration by a team analyzing telemetry data, where the data is used to generate a three dimensional visual display modeling the objects and events recorded by the telemetry data. One of the collaborating team members controls display of the model, and each collaborator is able to interact with the visual display and to employ a virtual camera to display and record operation of the model from a perspective selected by the member. Collaborating team members enter time-stamped notes which are displayed in sequential order for all collaborators on a common portion of a display screen upon replay of the simulation. Each team member is provided with a microphone and audio gear to collaborate by voice with other members of the team. The notes and virtual camera views coupled to the simulation provide decision makers on the team with an improved understanding of the problem modeled by the simulation, thereby facilitating an improved decision.

Claims

1. A method for documenting collaboration to resolve a problem disclosed by telemetry data in the operation of a three dimensional (3D) complex at a particular remote location, comprising:

generating from the telemetry data a 3D representation of the complex over a period of time defined by the telemetry data, the complex being comprised of one or more objects proximate to one another within the complex and the telemetry data being provided by one or more monitoring instruments recording events at the particular remote location serving as a locus for the three dimensional complex, said representation being a dynamic 3D representation showing interactions between and among said one or more objects during said period of time;

providing for each of a plurality of collaborators a 3D perspective chosen by each respective collaborator from which to view the 3D representation, each said chosen perspective being a directional orientation from a chosen location within the 3D representation, each collaborator having an expertise with respect to the problem being modeled in three spatial dimensions over time by the representation, each collaborator being able to change the chosen perspective and to move about within the 3D representation over said period of time;

enabling each collaborator to document said chosen perspective at a selected point in time during viewing of the 3D representation, said documentation including entry by the respective collaborator of notes pertaining to said problem at said selected point in time; and

displaying the entered notes in sequential order during a subsequent viewing of the 3D representation,

wherein decision makers informed by the notes of collaborators resolve the problem being modeled by the 3D representation.

2. The method of claim 1, further comprising designating one of said plurality of collaborators to control a display over time of the 3D representation.

3. The method of claim 2, further comprising provisioning each collaborator with a microphone and audio link enabling voice collaboration among the collaborators.

4. The method of claim 1, wherein additional notes are entered by a collaborator during a subsequent viewing of the 3D representation.

5. The method of claim 1, wherein the sequential order of notes is determined by a time stamp added to each note and referenced to a point in time within a duration of said telemetry data.

6. The method of claim 1, wherein the perspective from which a collaborator views the 3D representation is provided by a virtual camera.

7. The method of claim 1, wherein at least one collaborator is located remotely from another collaborator.

8. The method of claim 2, wherein control of said display over time includes one or more of:

stopping the display, restarting the display, restarting the display at a designated point in time, playing the display in reverse time sequence, and playing the display at speeds faster or slower than real time.

9. The method of claim 1, wherein generating the 3D representation from telemetry data further comprises:

parsing the telemetry data using an XML map;

generating from the parsed telemetry data successive keyframes; and

placing the successive keyframes in a video buffer.

10. A system for documenting collaboration to resolve a problem disclosed by telemetry data in the operation of a three dimensional (3D) complex at a particular remote location, comprising:

means for generating from the telemetry data a 3D representation of the complex over a period of time defined by the telemetry data, the complex being comprised of one or more objects proximate to one another within the complex and the telemetry data being provided by one or more monitoring instruments recording events at the particular remote location serving as a locus for the three dimensional complex, said representation being a dynamic 3D representation showing interactions between and among said one or more objects during said period of time;

means for providing for each of a plurality of collaborators a 3D perspective chosen by each respective collaborator from which to view the 3D representation, each said chosen perspective being a directional orientation from a chosen location within the 3D representation, each collaborator having an expertise with respect to the problem being modeled in three spatial dimensions over time by the representation, each collaborator being able to change the chosen perspective and to move about within the 3D representation over said period of time;

means for enabling each collaborator to document said chosen perspective at a selected point in time during viewing of the 3D representation, said documentation including entry by the respective collaborator of notes pertaining to said problem at said selected point in time; and

means for displaying the entered notes in sequential order during a subsequent viewing of the 3D representation,

wherein decision makers informed by the notes of collaborators resolve the problem being modeled by the 3D representation.

11. The system of claim 10, further comprising means for designating one of said plurality of collaborators to control a display over time of the 3D representation.

12. The system of claim 11, further comprising means for provisioning each collaborator with a microphone and audio link enabling voice collaboration among the collaborators.

13. The system of claim 10, wherein additional notes are entered by a collaborator during a subsequent viewing of the 3D representation.

14. The system of claim 10, wherein the sequential order of notes is determined by a time stamp added to each note and referenced to a point in time within a duration of said telemetry data.

15. The system of claim 10, wherein the perspective from which a collaborator views the 3D representation is provided by a virtual camera.

16. The system of claim 10, wherein at least one collaborator is located remotely from another collaborator.

17. The system of claim 11, wherein control of said display over time includes one or more of:

stopping the display, restarting the display, restarting the display at a designated point in time, playing the display in reverse time sequence, and playing the display at speeds faster or slower than real time.

18. The system of claim 10, wherein the means for generating the 3D representation from telemetry data further comprises:

means for parsing the telemetry data using an XML map;

means for generating from the parsed telemetry data successive keyframes; and

means for placing the successive keyframes in a video buffer.

27. The computer implemented system of claim 10, wherein first computer code for generating the 3D representation from telemetry data further comprises:

fifth computer code for parsing the telemetry data using an XML map;

sixth computer code for generating from the parsed telemetry data successive keyframes; and

seventh computer code for placing the successive keyframes in a video buffer.

19. A computer implemented system for documenting collaboration to resolve a problem disclosed by telemetry data in the operation of a three dimensional (3D) complex at a remote location, the system having a server with software modules stored thereon and a processor operable to execute the software modules, the software modules comprising:

first computer code for generating from the telemetry data a 3D representation of the complex over a period of time defined by the telemetry data, the complex being comprised of one or more objects proximate to one another within the complex and the telemetry data being provided by one or more monitoring instruments recording events at the particular remote location serving as a locus for the three dimensional complex, said representation being a dynamic 3D representation showing interactions between and among said one or more objects during said period of time;

second computer code for providing for each of a plurality of collaborators a 3D perspective chosen by each respective collaborator from which to view the 3D representation, each said chosen perspective being a directional orientation from a chosen location within the 3D representation, each collaborator having an expertise with respect to the problem being modeled in three spatial dimensions over time by the representation, each collaborator being able to change the chosen perspective and to move about within the 3D representation over said period of time;

third computer code for enabling each collaborator to document said chosen 3D perspective at a selected point in time during viewing of the representation, said documentation including entry by the respective collaborator of notes pertaining to said problem at said selected point in time; and

fourth computer code for displaying the entered notes in sequential order during a subsequent viewing of the 3D representation,

wherein decision makers informed by the notes of collaborators resolve the problem being modeled by the 3D representation.

20. The computer implemented system of claim 19, wherein one of said plurality of collaborators controls a display over time of the 3D representation.

21. The computer implemented system of claim 20, wherein each collaborator is provisioned with a microphone and audio link enabling voice collaboration among the collaborators.

22. The computer implemented system of claim 19, wherein additional notes are entered by a collaborator during a subsequent viewing of the 3D representation.

23. The computer implemented system of claim 19, wherein the sequential order of notes is determined by a time stamp added to each note and referenced to a point in time within a duration of said telemetry data.

24. The computer implemented system of claim 19, wherein the perspective from which a collaborator views the 3D representation is provided by a virtual camera.

25. The computer implemented system of claim 19, wherein at least one collaborator is located remotely from another collaborator.

26. The computer implemented system of claim 20, wherein control of said display over time includes one or more of:

stopping the display, restarting the display, restarting the display at a designated point in time, playing the display in reverse time sequence, and playing the display at speeds faster or slower than real time.