Method and system for providing images of a virtual world scene and method and system for processing the same

• US 8,854,391 B2
• Filed: 03/17/2011
• Issued: 10/07/2014
• Est. Priority Date: 03/18/2010
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lan, Dong Jun, Li, Qi Cheng, Wang, Jian, Wang, Yi Min, Zhu, Zi Yu
• Primary Examiner(s): Xiao, Ke
• Assistant Examiner(s): He, Weiming
• Application Number:
  US13/049,998
• Publication Number:
  US 20110227938A1
• Time in Patent Office: 1,300 Days
• Field of Search: 345/581, 345/419, 345/629, 345/633
• US Class Current: 345/581
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/20 Perspective computation

Abstract

A method and systems for providing and processing images of a virtual world scene. The method includes: rendering the scene of the virtual world to generate a plurality of rendering results, generating at least one image stream based on at least part of the plurality of rendering results, and sending the at least one image stream to the client. The system for providing the images includes: rendering means to generate a plurality of rendering results; image stream generation means for generating at least one image stream; and sending means for sending said at least one image stream to a client. After providing the images, the images are processed by receiving means for receiving, at a client, two image streams and merging means for merging the two image streams into a single image stream for playing.

Claims

1. A method, with a computer device, of providing images of a scene in a virtual world, comprising:

rendering the scene as viewed from a location and observation angle corresponding to a client'"'"'s avatar in the virtual world to generate a plurality of rendering results, wherein the location of the client'"'"'s avatar is not included in the scene, and wherein the rendering comprises;

identifying at least one fixed observation angle associated with a client'"'"'s avatar in the virtual world;

determining that at least one fixed observation angle is associated with a plurality of scene depths, wherein each of the plurality of scene depths comprises a set of objects;

rendering each of the plurality of scene depths and the set of objects within each of the plurality of scene depths, wherein, for a current scene depth in the plurality of scene depths, the rendering comprises generating at least one image comprising the set of objects in the current scene depth and at least a portion of each object in the set of objects for each subsequent scene depth in the plurality of scene depths as observed from the current scene depth, and wherein objects in a previously rendered scene depth are removed from the set of objects in a subsequently rendered scene depth,

wherein the plurality of rendering results comprises the at least one image that has been generated for each of the plurality of scene depths;

generating at least one image stream based on at least a part of the plurality of rendering results; and

sending the at least one image stream from the computer device to a client, wherein the at least one image stream comprises the scene in a pre-rendered form, and wherein the pre-rendered form is configured to present the scene to the client without rendering of the scene by the client.

2. The method according to claim 1, wherein the at least one fixed observation angle comprises a plurality of fixed observation angles, and the plurality of fixed observation angles is preset to be directed toward the scene from a plurality of points distributed in a peripheral space of the scene.

3. The method according to claim 2, further comprising:

selecting, from the plurality of fixed observation angles, at least one fixed observation angle that best approximates the observation angle associated with the client'"'"'s avatar; and

including rendering results generated from the at least one fixed observation angle as part of the plurality of rendering results.

4. The method according to claim 2, wherein the method further comprises:

selecting a second rendering result from the plurality of rendering results as the part of the rendering results, wherein the second rendering result is based on the location of a client'"'"'s avatar in the virtual world and has projection depth according to the location.

5. The method according to claim 1, wherein the rendering further comprises:

rendering changes in the scene corresponding to each of the plurality of scene depths.

6. The method according to claim 1, further comprising generating at least two image streams;

and

merging the at least two image streams into a single image stream for playing.

7. The method according to claim 6, wherein the merging further comprises:

synchronizing the at least two image streams in time;

converting at least two image frames of the at least two image streams into at least two converted image frames adapted to an observation angle of the client'"'"'s avatar; and

combining the at least two converted image frames into a play image frame in the single image stream.

8. The method according to claim 6, wherein the at least two image streams are generated based in part on the plurality of rendering results.

9. The method of claim 1, wherein the plurality of rendering results does not include a rendering of the client'"'"'s avatar.

19. A non-transitory computer readable storage medium tangibly embodying a computer readable program code having computer readable instructions which, when implemented, cause a computer to carry out the method of claim 1.

10. A system for providing images of a scene in a virtual world, comprising:

rendering means for rendering the scene as viewed from a location and observation angle corresponding to a client'"'"'s avatar in the virtual world to generate a plurality of rendering results;

wherein the rendering comprises;

identifying at least one fixed observation angle associated with a client'"'"'s avatar in the virtual world;

determining that at least one fixed observation angle is associated with a plurality of scene depths, wherein each of the plurality of scene depths comprises a set of objects;

rendering each of the plurality of scene depths and the set of objects within each of the plurality of scene depths, wherein, for a current scene depth in the plurality of scene depths, the rendering comprises generating at least one image comprising the set of objects in the current scene depth and at least a portion of each object in the set of objects for each subsequent scene depth in the plurality of scene depths as observed from the current scene depth, wherein objects in a previously rendered scene depth are removed from the set of objects in a subsequently rendered scene depth, and

wherein the plurality of rendering results comprises each of the plurality of scene depths that have been rendered and the set of objects within each of the plurality of scene depths;

image stream generation means for generating at least one image stream based on at least a part of the rendering results; and

sending means for sending the at least one image stream from a server to a client, wherein the at least one image stream comprises the scene in a pre-rendered form, and wherein the pre-rendered form is configured to present the scene to the client without rendering of the scene by the client.

11. The system according to claim 10, wherein the at least one fixed observation angle comprises a plurality of fixed observation angles, and the plurality of fixed observation angles are preset to be directed toward the scene from a plurality of points distributed in a peripheral space of the scene.

12. The system according to claim 10, further comprising:

observation angle selection means for

selecting, from a plurality of fixed observation angles, at least one fixed observation angle that best approximates the observation angle of the client'"'"'s avatar; and

including rendering results generated from the at least one fixed observation angle as part of the plurality of rendering results.

13. The system according to claim 10, wherein the system further comprises:

rendering result selection means for selecting a second rendering result from the plurality of rendering results, wherein the second rendering result is based on the location of the client'"'"'s avatar in the virtual world and has projection depth according to the location.

14. The system of claim 10, wherein the location of the client'"'"'s avatar is not included in the scene, and wherein the plurality of rendering results consists of only a rendering of the scene and not at all a rendering of the client'"'"'s avatar.

15. A system including at least one server for processing images of a virtual world, comprising:

rendering means, at the at least one server, for rendering the virtual world as viewed from a location and an observation angle corresponding to a client'"'"'s avatar in the virtual world to generate a plurality of rendering results, and wherein the rendering comprises;

identifying at least one fixed observation angle associated with a client'"'"'s avatar in the virtual world;

determining that at least one fixed observation angle is associated with a plurality of scene depths, wherein each of the plurality of scene depths comprises a set of objects;

rendering each of the plurality of scene depths and the set of objects within each of the plurality of scene depths, wherein, for a current scene depth in the plurality of scene depths, the rendering comprises generating at least one image comprising the set of objects in the current scene depth and at least a portion of each object in the set of objects for each subsequent scene depth in the plurality of scene depths as observed from the current scene depth, wherein objects in a previously rendered scene depth are removed from the set of objects in a subsequently rendered scene depth,

wherein the plurality of rendering results comprises each of the plurality of scene depths that have been rendered and the set of objects within each of the plurality of scene depths;

image stream generation means for generating at least two images streams based on at least two of the plurality of scene depths that have been rendered; and

sending means for sending the at least two image streams to a client, wherein the at least two image streams comprise a scene from the virtual world in a pre-rendered form, and wherein the pre-rendered form is configured to present the scene to the client without rendering of the scene by the client.

16. The system according to claim 15, further comprising at least one client, wherein the at least one client comprises:

receiving means for receiving the at least two image streams; and

merging means for merging the at least two image streams into a single image stream for playing,

wherein each of the at least two image streams includes at least one image frame, and wherein the merging means comprises;

conversion means for converting at least one image frame from each of the at least two image streams that are synchronized in time into respective at least two converted image frames adapted to the observation angle of the client'"'"'s avatar in the virtual world; and

combination means for combining the at least two converted image frames into a play image frame in the single image stream.

17. The system of claim 16, wherein the combination means includes:

synthesizing means for synthesizing two image frames of the at least two converted image frames to obtain a single synthesized image frame for playing.

18. The system of claim 15, wherein the client'"'"'s avatar is not included in the rendering results.