Low latency rendering of objects

• US 9,400,695 B2
• Filed: 02/26/2010
• Issued: 07/26/2016
• Est. Priority Date: 02/26/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Sylvan, Sebastian, Burton, Nicholas
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Chin, Michelle
• Application Number:
  US12/713,442
• Publication Number:
  US 20110210982A1
• Time in Patent Office: 2,342 Days
• US Class Current: 1/1
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/203 Image generating hardware
• CPC Class Codes: A63F 2300/63 for controlling the execution of the game in time
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06F 2209/5014 Reservation
• CPC Class Codes: G06F 2209/5021 Priority
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06T 15/005 General purpose rendering architectures

Abstract

A system is disclosed for rendering low latency resource objects by providing the latest position data from a central processing unit for the low latency resource object right before a graphic processing unit is to render the low latency resource object.

Claims

1. In a system comprising a computing environment receiving pose data from a capture device, a method of the computing environment rendering objects in a video frame on a display associated with the computing environment, the method comprising:

a) capturing pose information for first and second objects at a first time;

b) generating a thread at a second time after the first time for a graphics processor to render the first and second objects in the frame, the thread including;

i) render commands and pose information for the first object obtained at the first time, ii) render commands and a buffer for receipt of pose information for the second object;

c) rendering the first object in the frame at a third time after the second time using the pose information for the first object obtained at the first time;

d) inserting pose information into the buffer for the second object, the pose information indicating a position of the second object at a time after the first time; and

e) rendering the second object in the frame at the third time using the pose information for the second object obtained in said step d).

2. The method of claim 1, said step a) comprising the step of using pose information obtained from a camera capturing user position.

3. The method of claim 1, said step a) comprising the step of using input data from a hand-actuated controller.

4. The method of claim 1, further comprising the step of pausing the rendering of the second object in the event the pose information for the second object has not yet been provided for the second object at the third time.

5. The method of claim 1, further comprising the step of including a lock command in data received by a graphics processor in performing the rendering steps c) and e), the lock pausing the rendering of the second object in the event the pose information for the second object has not yet been provided for the second object at the third time.

6. The method of claim 1, wherein said step e) comprises a graphics processor rendering the second object with the most recent pose information available to a processor receiving the pose information.

7. The method of claim 1, wherein second object rendered in said step e) use pose information that is one to four frames more recent than the pose information used in said step c) of rendering the first object.

8. The method of claim 1, wherein said step e) comprises rendering an avatar mimicking movements of a user.

9. A method of rendering objects in a video frame on a display, comprising:

a) capturing pose information for an object at a first time;

b) processing the pose information for the object at a second time later than the first time in the frame;

c) determining whether the object is designated as a low latency object;

d) rendering image data for the object at a third time after the second time, using the pose information captured at the first time, where it is determined in said step c) that the object is not a low latency object;

e) capturing updated pose information for the object at a fourth time later than the second time where it is determined in said step c) that the object is a low latency object; and

f) rendering image data for the object at the third time, using the pose information captured at the fourth time, where it is determined in said step c) that the object is a low latency object.

10. The method of claim 9, said step a) comprising the step of using pose information obtained from a camera capturing user position.

11. The method of claim 9, said step a) comprising the step of using input data from a hand-actuated controller.

12. The method of claim 9, further comprising the step of pausing the rendering of the second object in the event the pose information for the second object has not yet been provided for the second object at the third time.

13. The method of claim 9, further comprising the step of including a lock command in data received by a graphics processor in performing the rendering steps c) and d), the lock pausing the rendering of the second object in the event the pose information for the second object has not yet been provided for the second object at the third time.

14. The method of claim 9, wherein said step d) comprises a graphics processor rendering the second object with the most recent pose information available to a processor receiving the pose information.

15. A computing system, comprising:

a central processor operable to;

a) receive pose information for an object at a first time,

b) process the pose information for the object at a second time later than the first time in the frame,

c) determine whether the object is designated as a low latency object, and

d) receive updated pose information for the object at a fourth time later than the second time where it is determined in said step c) that the object is a low latency object; and

a graphics processor operable to;

e) render image data for the object at a third time after the second time, using the pose information captured at the first time, where it is determined in said step c) that the object is not a low latency object, and

f) render image data for the object at the third time, using the pose information captured at the fourth time, where it is determined in said step c) that the object is a low latency object.

16. The computing system of claim 15, further comprising a camera for capturing user position and providing the pose information in said step a).

17. The computing system of claim 15, further comprising a hand-actuated controller for providing input data used by the central processor to process pose information.

18. The computing system of claim 15, the central processor pausing the rendering of the second object in the event the pose information for the second object has not yet been provided for the second object at the third time.

19. The computing system of claim 15, the central processor generating a lock command in data received by the graphics processor in performing the rendering steps e) and f), the lock pausing the rendering of the second object in the event the pose information for the second object has not yet been provided for the second object at the third time.