Framework for graphics animation and compositing operations

• US 9,852,535 B2
• Filed: 02/09/2017
• Issued: 12/26/2017
• Est. Priority Date: 08/04/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Brunner, Ralph, Harper, John, Graffagnino, Peter
• Primary Examiner(s): Chu, David H
• Application Number:
  US15/428,718
• Publication Number:
  US 20170309054A1
• Time in Patent Office: 320 Days
• Field of Search: None
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

A graphics animation and compositing operations framework has a layer tree for interfacing with the application and a render tree for interfacing with a render engine. Layers in the layer tree can be content, windows, views, video, images, text, media or other type of objects for an application'"'"'s user interface. The application commits state changes of the layers of the layer tree. The application does not need to include explicit code for animating the changes to the layers. Instead, after a synchronization threshold has been met, an animation is determined for animating the change in state by the framework which can define a set of predetermined animations based on motion, visibility and transition. The determined animation is explicitly applied to the affected layers in the render tree. A render engine renders from the render tree into a frame buffer, synchronized with the display. Portions of the render tree changing relative to prior versions can be tracked to improve resource management.

Claims

1. A method of rendering a user interface of an application on a computer system, comprising:

receiving, from an application, a notification of a change to at least one first object, the at least one first object being associated with a user interface of the application;

changing at least one second object of a render tree structure responsive to the changing of at least one first property, the at least one second object being associated with the at least one first object;

determining at least one implicit animation from a plurality of implicit animations for animating the at least one second object, wherein the at least one implicit animation is automatically determined independent of the application;

receiving, from the application, a notification of an explicit transaction changing at least one third object, the at least one third object being associated with a user interface of the application;

changing at least one fourth object of the render tree structure responsive to the changing of at least one second property, the at least one fourth object associated with the at least one third object;

rendering the at least one second object from the render tree structure on a display of a computer system, wherein the rendering of the at least one second object occurs independently of the application; and

rendering the at least one fourth object from the render tree structure, wherein the rendering of the at least one fourth object is based on a notification committing the explicit transaction.

2. The method of claim 1, further comprising receiving the notification committing the explicit transaction from the application.

3. The method of claim 1, further comprising receiving, from the application, a notification to flush pending implicit transactions, the pending implicit transactions comprising the at least one implicit animation, and wherein the changing the at least one second object is based on the notification to flush.

4. The method of claim 3, wherein:

the notification of the change to the at least one first object is received prior to the receiving the notification of the explicit transaction, and

the at least one fourth object is changed prior to the changing the at least one second object.

5. The method of claim 1, wherein the explicit transaction overrides one or more implicit animations.

6. The method of claim 1, wherein each of the at least one first object, the at least one second object, the at least one third object, and the at least one fourth object comprise layer objects selected from the group consisting of an image layer object, a graphic layer object, a text layer object, a vector layer object, and a media layer object.

7. The method of claim 6, further comprising updating the render tree structure by adding an animation object that includes the determined at least one implicit animation to the render tree structure, wherein the render tree structure and a layer tree structure are structurally similar.

8. The method of claim 6, wherein the at least one property comprises visibility, wherein the change to the at least one first object comprises an addition of an object to the layer tree structure or a deletion of an object from the layer tree structure, and wherein determining the at least one implicit animation comprises selecting a visibility-based animation for animating an addition or a deletion of the at least one second object associated with the at least one first object.

9. The method of claim 1, wherein the rendering from the render tree structure comprises traversing the render tree structure.

10. The method of claim 1, wherein the at least one property comprises position, wherein:

the change to the at least one first object comprises a change of the at least one first object from a first position to a second position for display, and;

wherein determining the at least one implicit animation comprises selecting a motion-based animation for animating a change of the at least one second object from the first position to the second position.

11. A computer system, comprising:

a display device;

a memory storing instructions of an application programming interface for rendering a user interface of an application; and

a processor operatively coupled to the memory and the display device and adapted to execute the instructions stored in the memory to cause the processor to;

receive, from the application, a notification of a change to at least one first object, the at least one first object being associated with a user interface of the application;

change at least one second object of a render tree structure responsive to the changing of at least one first property, the at least one second object being associated with the at least one first object;

determine at least one implicit animation from a plurality of implicit animations for animating the at least one second object, wherein the at least one implicit animation is automatically determined independent of the application;

receive, from the application, a notification of an explicit transaction changing at least one third object, the at least one third object being associated with a user interface of the application;

change at least one fourth object of the render tree structure responsive to the changing of at least one second property, the at least one fourth object associated with the at least one third object;

render the at least one second object from the render tree structure on a display of a computer system, wherein the rendering of the at least one second object occurs independently of the application; and

render the at least one fourth object from the render tree structure, wherein the rendering of the at least one fourth object is based on a notification committing the explicit transaction.

12. The system of claim 11, further comprising instructions to cause the processor to receive the notification committing the explicit transaction from the application.

13. The system of claim 11, further comprising instructions to cause the processor to receive, from the application, a notification to flush pending implicit transactions, the pending implicit transactions comprising the at least one implicit animation, and wherein the instructions to cause the processor to change the at least one second object are based on the notification to flush.

14. The system of claim 13, wherein:

the notification of the change to the at least one first object is received prior to the receiving the notification of the explicit transaction, and

the at least one fourth object is changed prior to the changing the at least one second object.

15. The system of claim 11, wherein the explicit transaction overrides one or more implicit animations.

16. The system of claim 11, wherein each of the at least one first object, the at least one second object, the at least one third object, and the at least one fourth object comprise layer objects selected from the group consisting of an image layer object, a graphic layer object, a text layer object, a vector layer object, and a media layer object.

17. The system of claim 16, further comprising instructions to cause the processor to update the render tree structure by adding an animation object that includes the determined at least one implicit animation to the render tree structure, wherein the render tree structure and a layer tree structure are structurally similar.

18. The system of claim 16, wherein the at least one property comprises visibility, wherein the change to the at least one first object comprises an addition of an object to the layer tree structure or a deletion of an object from the layer tree structure, and wherein the instructions to cause the processor to determine the at least one implicit animation by selecting a visibility-based animation for animating an addition or a deletion of the at least one second object associated with the at least one first object.

19. The system of claim 11, wherein the instructions to cause the processor to render from the render tree structure comprises instructions to cause the processor to transverse the render tree structure.

20. A non-transitory computer-readable storage medium storing instructions for rendering a user interface of an application by one or more processors, wherein the instructions, when executed, cause the one or more processors to:

receive, from the application, a notification of a change to at least one first object, the at least one first object being associated with a user interface of the application;

change at least one second object of a render tree structure responsive to the changing of at least one first property, the at least one second object being associated with the at least one first object;

determine at least one implicit animation from a plurality of implicit animations for animating the at least one second object, wherein the at least one implicit animation is automatically determined independent of the application;

receive, from the application, a notification of an explicit transaction changing at least one third object, the at least one third object being associated with a user interface of the application;

change at least one fourth object of the render tree structure responsive to the changing of at least one second property, the at least one fourth object associated with the at least one third object;

render the at least one second object from the render tree structure on a display of a computer system, wherein the rendering of the at least one second object occurs independently of the application; and

render the at least one fourth object from the render tree structure, wherein the rendering of the at least one fourth object is based on a notification committing the explicit transaction.