Real time three-dimensional multiple display imaging system

• US 6,803,912 B1
• Filed: 08/02/2001
• Issued: 10/12/2004
• Est. Priority Date: 08/02/2001
• Status: Expired due to Fees

• Current Assignee: Mark Resources LLC
• Original Assignee: Mark Resources LLC
• Inventors: Mark, David, Weichers, Brett C.
• Primary Examiner(s): Philogene, Haissa
• Assistant Examiner(s): MANCUSO, HUEDUNG XUAN CAO
• Application Number:
  US09/921,090
• Time in Patent Office: 1,167 Days
• Field of Search: 345/427, 345/473, 345/419, 345/629, 345/474, 345/472, 700/83
• US Class Current: 345/427
• CPC Class Codes: G02B 30/29 characterised by the geometry of the lenticular array, e.g. slanted arrays, irregular arrays or arrays of varying shape or size
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/307 using fly-eye lenses, e.g. arrangements of circular lenses
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A real time three dimensional multiple display imaging system has a central processing node and a plurality of remote, virtual camera processors. Each of the virtual cameras has its own predetermined viewpoint and is capable of displaying a scene into a virtual world from that viewpoint. The virtual world and the objects displayed in it are controlled by the central processing node. Geometric and textural data concerning the objects are stored in advance by memories associated with each one of the virtual cameras, thereby reducing the amount of communication bandwidth necessary for real-time animation.

Claims

1. A video display system having multiple display units comprising:

A memory including a world memory in which a world is spatially defined and including at least one object to be displayed, an image memory for storing graphical image data of said at least one object, and an animation memory for storing animation sequencing instructions on the positioning and movement of said at least one object within the world;

a rendering processor coupled to the memory and including a plurality of virtual camera nodes each driving at least one of the display units, each of the virtual camera nodes associated with a stored, user-definable viewpoint into the world which includes a plurality of orientation parameters, each viewpoint capable of being chosen as different from the other ones of the viewpoints; and

the rendering processor rendering images of said at least one object from the viewpoints of each of the virtual cameras according to the animation sequencing instructions, the rendering processor causing the rendered images to be displayed on respective ones of the display units.

2. The system of claim 1, wherein each viewpoint is defined by a plurality of user-selectable orientation parameters.

3. The system of claim 2, wherein the orientation parameters include an aspect ratio and a parallax setting.

4. The system of claim 2, wherein the orientation parameters include view position and viewpoint coordinate axes.

5. The system of claim 1, wherein the image memory stores a geometry file and a texture file for said at least one object.

6. The system of claim 1, wherein the rendering processor includes a general processor and a plurality of graphics processors coupled to the general processor, each graphics processor driving at least a respective one of the displays.

7. The system of claim 1, wherein the rendering processor is a portion of a rendering server connected to at least one client across a network, the rendering processor transmitting sequencing instructions to said at least one client imaging computer across the network.

8. The system of claim 1, wherein the rendering processor is a portion of a client imaging computer connected to a rendering server across a network, the rendering processor receiving sequencing instructions from the rendering server and rendering the images according to the received sequencing instructions.

9. The system of claim 1, wherein the image memory stores image data for a plurality of objects, the rendering processor rendering images of said objects.

10. The system of claim 1, whereon the memory includes a mass storage medium and an electronic random access memory.

11. The display system of claim 1, wherein the display units are contiguous to each other.

12. The display system of claim 1, wherein the rendering processor includes a general-purpose processor programmed by executable software instructions.

13. The apparatus of claim 11, wherein the rendering means includes server means for storing the animation sequencing instructions, and client means coupled to the server means for securing sequencing instructions from the server means, the client means rendering said at object as seen from the viewpoint of the virtual camera means, in response to the sequencing instructions.

14. The apparatus of claim 11, wherein the viewpoints are chosen to be parallel and spaced from each other.

15. The apparatus of claim 11, wherein the viewpoints are chosen to be spaced from each other and convergent.

16. The apparatus of claim 11, wherein the viewpoints are chosen to be spaced from each other and divergent.

17. The apparatus of claim 11, wherein each virtual camera means specifies a viewpoint by specifying an angle, a parallax value and a hither clipping plane.

18. The apparatus of claim 11, and further comprising memory means associated with the rendering means for storing geometric and textural data of said at least one object, the rendering means using the stored geometric and textural data to render said at least one object responsive to the sequencing instructions.

19. Apparatus for rendering animated images in a multiple display unit video system, comprising:

a plurality of virtual camera means, each associated with a respective one of a plurality of display units, each virtual camera means defining a viewpoint of a scene including at least one object to be rendered, means coupled to the virtual camera means for choosing the viewpoints by a user of the apparatus such that the viewpoints may be different from each other;

means for storing animation sequencing instructions;

rendering means, coupled to each of the virtual camera means and the means for storing animation sequencing instructions, for rendering said at least one object as seen from the viewpoint of the virtual camera means and responsive to the animation sequencing instructions; and

means for displaying the scene as including the rendered object on each of the display units.

20. The apparatus of claim 19, wherein each virtual camera means includes means for defining a viewpoint, the means for defining including means for specifying a viewpoint angle, parallax and hither clipping plane.

21. A method for rendering images in a multiple display unit video system, comprising the steps of:

for each of a plurality of virtual cameras each associated with respective ones of a plurality of display units, establishing a viewpoint of a scene, each of the plurality of virtual cameras depicting the same scene from its own viewpoint, the viewpoints capable of being chosen as different from each other;

for at least one object to be displayed in the scene, storing graphical image data;

for said at least one object, generating a plurality of sequencing instructions;

responsive to the sequencing instructions and using the graphical image data, rendering the object as seen from the viewpoint of each of the virtual cameras; and

displaying the scene as including the object on each of the display units.

22. The method of claim 21, wherein the viewpoints are chosen to be parallel to and spaced from each other.

23. The method of claim 21, wherein the viewpoints are chosen to be spaced from each other and convergent.

24. The method of claim 21, wherein the viewpoints are chosen to be spaced from each other and divergent.

25. The method of claim 21, and further comprising the step of defining a viewpoint by specifying an angle, a parallax value and a hither clipping plane.

26. The method of claim 21, and further comprising the step of defining the viewpoints by a user.

27. The method of claim 21, wherein the graphical image data include geometric and textural data.

28. An animation display system having multiple display units, comprising:

a plurality of imaging computers each having a processor, a memory, a communications link to at least one other of the imaging computers and at least one output for driving a respective video display unit;

the memory of each imaging computer storing graphical image data for at least one object to be displayed;

a three-dimensional scene which will be rendered by all of the imaging computers, said at least one object being displayed within the scene, and

a plurality of viewpoints of the scene from which the object is to be displayed, the viewpoints user-definable such that they can be different from each other, each display unit having a viewpoint assigned thereto;

wherein for each imaging computer and for each video display unit associated with the last said imaging computer, the processor renders the scene, as including said at least one object, using the viewpoint assigned to the display unit and the graphical image data.

29. The animation display system of claim 28, wherein one of the imaging computers is a server and the others of the imaging computers are clients of the server, the server storing animation sequencing instructions, the server transmitting to each of the clients the animation sequencing instructions, the processors rendering the scene according to the animation sequencing instructions.

30. The animation display system of claim 28, wherein the processor includes a main general purpose processor and, for the display unit driven by the imaging computer of that processor, a graphics processor coupled to the main processor.

31. The animation display system of claim 28, wherein a plurality of video display units are driven by each imaging computer, the processor of the imaging computer rendering the scene from each viewpoint assigned to the video display units.

32. The animation display system of claim 31, wherein the processor further includes a plurality of graphics processors driving respective ones of the display units, each graphics processor coupled to the main processor.

33. The display system of claim 28, wherein the memory of each imaging computer includes a mass storage medium and an electronic random access memory.

34. The display system of claim 28, wherein the video display units are contiguous to each other.

35. The display system of claim 28, wherein the processor includes a general-purpose processor programmed by executable software instructions.

36. An animated display system comprising:

a central node coupled to each of a plurality of remote nodes by at least one communications link;

an animation instruction memory of the central node storing instructions on the positioning and movement, in a virtual world, of a plurality of objects to be displayed;

each of the plurality of remote nodes having a rendering processor, a memory, and at least one output driving a respective display unit, the last said memory including a virtual world memory storing, prior to a first time, a scene, and an object data memory storing, prior to a first time, graphical image data for each of the objects to be displayed; and

each rendering processor rendering an image of the scene using selected ones of the object data and responsive to instructions received from the central node at the first time.

37. The animated display system of claim 36, wherein the central node further comprises a rendering processor, at least one output driving a respective display unit, a virtual world memory storing, prior to the first time, a scene, and an object data memory storing, prior to the first time, the graphical image data for each of the objects to be displayed, the rendering processor using the instructions in the animation instruction memory to render an image of the scene using selected ones of the object data.

38. The animated display system of claim 36, wherein each rendering processor includes a general purpose processor programmed by executable software instructions.

39. The animated display system of claim 36, wherein each rendering processor includes a central processor and, for driving the display unit, a graphics processor coupled to the central processor.

40. The animated display system of claim 36, wherein each remote node has a plurality of outputs driving respective display units, the rendering processor of the remote node rendering an image of the scene for each of the display units, the image rendered for any one of the display units controlled by the last said rendering processor capable of being preselected to be different from any other of the rendered images.

41. The animated display system of claim 40, wherein the rendering processor in each of the remote units comprises a central general purpose processor and, for each of the display units controlled by the rendering processor, a graphics processor coupled to the general purpose processor.

42. The animated display system of claim 36, wherein the scene is three-dimensional.

43. The animated display system of claim 36, wherein the graphical image data include geometric and textural data.

44. The animated display system of claim 36, wherein the animation instruction memory includes a mass storage medium.

45. The animated display system of claim 36, wherein each virtual world memory includes a mass storage medium.

46. Apparatus for rendering images in a multiple display unit video system, comprising:

means for storing animation sequencing instructions at a central location;

a plurality of remote locations in communication with the central location, each of the remote locations including means for storing, prior to a first time, graphical image data for each of a plurality of objects to be displayed, means for storing, prior to the first time, a scene in which the objects are to be depicted, image rendering means coupled to the means for storing, and at least one display unit driven by the image rendering means;

each remote location receiving, at the first time and from the central location, sequencing instructions, the image rendering means at each remote location rendering an image of the scene using selected elements of the graphical image data and the stored scene and responsive to the sequencing instructions, said at least one display displaying the image rendered by the image rendering means.

47. The apparatus of claim 46, wherein the central location also has said means for storing graphical image data, said means for storing the scene, an image rendering means, and at least one display unit, the display unit driven by the image rendering means, responsive to the sequencing instructions, and using the stored scene and selected elements of the graphical image.

48. The apparatus of claim 46, wherein each of the remote locations is coupled to a plurality of display units, the image rendering means of each of the remote locations rendering an image for each of the display units driven thereby, viewpoints of the images preselectable to be different from one another.

49. The apparatus of claim 48, wherein each of the remote locations includes memory means for storing a plurality of viewpoints of the scene, each viewpoint being linked to at least one station identity, each station identity associated with a display unit, the sequencing instructions received by each remote location including the station identities to be attributed to the display units associated with the remote location, the remote location establishing viewpoints for each of the display units according to the received station identities.

50. The apparatus of claim 46, wherein the graphical image data include geometric and textural data.

51. A multiple-panel animation and text data display system, comprising:

a server node having a processor and a memory, a first link of the central node coupled to a remote source of text data, a listen thread of the processor inspecting the first link for incoming text data to be displayed;

a plurality of client nodes each coupled to the server node and having a processor and a memory, at least one display coupled to each of the client nodes;

the server node and client nodes each storing, in memories associated with said nodes, scenes and object imaging data, the server node further storing animation sequencing instructions and transmitting said instructions to each of the client nodes, the server and the clients rendering animated scenes using the sequencing instructions and the stored scene and object imaging data;

the server node determining, according to stored instructions, a text overlay area on selected ones of the displays; and

the server node determining which text data should appear on which overlay area, the server node transmitting selected text data to corresponding ones of the client nodes such that the displays coupled to respective client nodes can display selected animation graphics and selected, overlaid text data.

52. The animation and text data display system of claim 51, wherein the server node further has an internet link permitting an administrator to remotely monitor and modify the displayed animation and text data.

53. The animation and text display system of claim 51, wherein said server node is one of a plurality of rendering nodes, the rendering nodes being coupled to each other, ones of said rendering nodes having world memories storing different spatial world definitions, each of the worlds being respective portions of a universe which is so defined that the worlds may share common data.