LOW LATENCY RENDERING OF OBJECTS

• US 20110210982A1
• Filed: 02/26/2010
• Published: 09/01/2011
• Est. Priority Date: 02/26/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Burton, Nicholas, Sylvan, Sebastian
• Granted Patent: US 9,400,695 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/203 Image generating hardware
• CPC Class Codes: A63F 2300/63 for controlling the execution of the game in time
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06F 2209/5014 Reservation
• CPC Class Codes: G06F 2209/5021 Priority
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06T 15/005 General purpose rendering architectures

Abstract

A system is disclosed for rendering low latency resource objects by providing the latest position data from a central processing unit for the low latency resource object right before a graphic processing unit is to render the low latency resource object.

Claims

1. A method of rendering objects in a video frame on a display, comprising:

a) rendering a first set of objects in the frame using input data for the first set of objects obtained at a first time; and

b) rendering a second set of objects together with the first set of objects in the same frame, the second set of objects rendered using input data obtained at a second time later than the first time.

2. The method of claim 1, said steps a) and b) of rendering objects using input data comprising the steps of rendering objects using pose information obtained from a camera capturing user position.

3. The method of claim 1, said steps a) and b) of rendering objects using input data comprising the steps of rendering objects using input data from a hand-actuated controller.

4. The method of claim 1, further comprising the step of pausing the rendering of the second set of objects in the event the input data for the second set of objects has not yet been provided for the second set of objects.

5. The method of claim 1, further comprising the step of including a lock command in data received by a graphics processor in performing the rendering steps a) and b), the lock pausing the rendering of the second set of objects in the event the input data for the second set of objects has not yet been provided for the second set of objects.

6. The method of claim 1, wherein said step a) comprises rendering the first set of objects using input data from a first frame, and said step b) comprises rendering the second set of objects with input data from a second frame which is between one to four frames more current than the first frame.

7. The method of claim 1, wherein said step a) comprises rendering the first set of objects using input data from a first frame, and said step b) comprises rendering the second set of objects with input data from a second frame which is two frames more current than the first frame.

8. The method of claim 1, wherein said step b) comprises a graphics processor rendering the second set of objects with the most recent input data available to a processor processing input data.

9. The method of claim 1, wherein said step b) comprises the step of rendering an avatar mimicking the movements of a user.

10. In a system comprising a computing environment receiving pose data from a capture device, a method of the computing environment rendering objects in a video frame on a display associated with the computing environment, the method comprising:

a) generating a thread for a graphics processor to render the objects in the frame, the thread including;

i) render commands and pose information for a first set of objects, ii) render commands and a buffer for receipt of pose information for an object of a second set of objects, and iii) a lock command corresponding to the object of the second set of objects;

b) rendering objects from the first set of objects;

c) inserting pose information into the buffer for the object of the second set of objects, the pose information indicating a position of the object of the second set of objects; and

d) pausing rendering of objects in the event the lock command is encountered before the pose information is inserted into the buffer in said step c).

11. The method of claim 10, further comprising the step e) of rendering the object from the second set of objects after said step c) of inserting pose information into the buffer for the object of the second set of objects.

12. The method of claim 11, wherein said step e) comprises rendering the object from the second set of objects using pose information that is more current than the pose information used to render the first set of objects.

13. The method of claim 12, wherein objects rendered in said step e) use pose information that is one to four frames more recent than the pose information used in said step b) of rendering objects from the first set of objects.

14. The method of claim 11, wherein said step e) comprises rendering an avatar mimicking movements of a user.

15. The method of claim 10, further comprising the step of generating the pose information in said step c) from a camera capturing image data relating to the position of the object.

16. A system for rendering three-dimensional objects on a display, comprising:

a capture device for capturing image data relating to an object within a field of view of the capture device; and

a computing environment, the computing environment including;

a first processor for generating i) pose information for rendering objects in a given position, ii) render commands defining appearance aspects of the objects rendered per the pose information, and iii) a lock command associated with a low latency resource object for preventing rendering of the low latency resource object until the object has been updated with pose information,

a second processor for rendering a set of non-low latency resource objects and the low latency resource object in a frame, the non-low latency resource objects being rendered in the frame with pose information that is older than pose information for rendering the low latency resource objects in the frame.

17. The system of claim 16, wherein the non-low latency resource objects are rendered before the low latency resource objects.

18. The system of claim 16, the first processor further generating a buffer associated with a low latency resource object, the second processor obtaining current pose information from the first processor for insertion into the buffer just prior to the second processor rendering the low latency resource object.

19. The system of claim 18, the lock command preventing the second processor from rendering the low latency resource object until the second processor has obtained the current pose information.

20. The system of claim 16, wherein the low latency resource object relates to at least one of a user within the field of view of the capture device and a virtual object with which a user interacts in an application running on the computing environment.