Conversion of 2D diagrams to 3D rich immersive content

• US 10,643,366 B1
• Filed: 12/03/2019
• Issued: 05/05/2020
• Est. Priority Date: 07/21/2017
• Status: Active Grant

• Current Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Original Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Inventors: Short, Matthew Thomas, Dooley, Robert, Cheng, Grace T., Webb, Sunny, Hamilton, Mary Elizabeth
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US16/701,969
• Publication Number:
  US 20200118323A1
• Time in Patent Office: 154 Days
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06V 20/42 of sport video content

Abstract

Implementations are directed to methods, systems, apparatus, and computer programs for generation of a three-dimensional (3D) animation by receiving a user input defining a two-dimensional (2D) representation of a plurality of elements, processing, by the one or more processors, the 2D representation to classify the plurality of elements in symbolic elements and action elements, generating, by the one or more processors, based on the symbolic elements, the action elements, and a set of rules a 3D animation corresponding to the 2D representation, and transmitting, by the one or more processors, the 3D animation to an extended reality device for display.

Claims

1. A computer-implemented method comprising:

receiving a user input of a 2D representation of (i) one or more symbolic elements that are to be visualized as one or more objects in a desired 3D animation, and (ii) one or more action elements that each represent a respective trajectory of one or more of the objects in the desired 3D animation, and that are to not be visualized as an object in the desired 3D animation;

determining that a particular trajectory associated with a particular action element would cause two or more particular objects to enter a prohibited zone in the desired 3D animation;

in response to determining that the particular trajectory associated with a particular action element would cause two or more particular objects to enter the prohibited zone in the desired 3D animation, determining an alternative trajectory that will cause the two or more particular objects to avoid the prohibited zone in the desired 3D animation; and

generating the desired 3D animation based on the 2D representation, comprising animating the two or more particular objects based on the alternative trajectory in lieu of the particular trajectory that is associated with the particular action element in the 2D representation.

2. The method of claim 1, comprising classifying the elements in the 2D representation as either symbolic element or action elements.

3. The method of claim 1, comprising obtaining animation characteristics for each of the symbolic elements.

4. The method of claim 1, wherein each of the action elements comprises a vector that indicates a direction and speed of displacement of an associated object.

5. The method of claim 1, comprising transmitting the generated 3D animation to an extended reality device, for output.

6. The method of claim 1, comprising adjusting a visual perspective associated with the generated 3D animation based on a user input at an extended reality device.

7. The method of claim 1, wherein the two-dimensional representation comprises a sketch overlaid on a sports playing field, including a sketched objects of a particular shape that each correspond to a symbolic element, and arrows emanating from the sketched objects that each correspond to an action element.

8. A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving a user input of a 2D representation of (i) one or more symbolic elements that are to be visualized as one or more objects in a desired 3D animation, and (ii) one or more action elements that each represent a respective trajectory of one or more of the objects in the desired 3D animation, and that are to not be visualized as an object in the desired 3D animation;

determining that a particular trajectory associated with a particular action element would cause two or more particular objects to enter a prohibited zone in the desired 3D animation;

in response to determining that the particular trajectory associated with a particular action element would cause two or more particular objects to enter the prohibited zone in the desired 3D animation, determining an alternative trajectory that will cause the two or more particular objects to avoid the prohibited zone in the desired 3D animation; and

generating the desired 3D animation based on the 2D representation, comprising animating the two or more particular objects based on the alternative trajectory in lieu of the particular trajectory that is associated with the particular action element in the 2D representation.

9. The medium of claim 8, wherein the operations comprise classifying the elements in the 2D representation as either symbolic element or action elements.

10. The medium of claim 8, wherein the operations comprise obtaining animation characteristics for each of the symbolic elements.

11. The medium of claim 8, wherein each of the action elements comprises a vector that indicates a direction and speed of displacement of an associated object.

12. The medium of claim 8, wherein the operations comprise transmitting the generated 3D animation to an extended reality device, for output.

13. The medium of claim 8, wherein the operations comprise adjusting a visual perspective associated with the generated 3D animation based on a user input at an extended reality device.

14. The medium of claim 8, wherein the two-dimensional representation comprises a sketch overlaid on a sports playing field, including a sketched objects of a particular shape that each correspond to a symbolic element, and arrows emanating from the sketched objects that each correspond to an action element.

15. A system comprising:

one or more processors; and

a computer-readable storage device coupled to the one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising;

receiving a user input of a 2D representation of (i) one or more symbolic elements that are to be visualized as one or more objects in a desired 3D animation, and (ii) one or more action elements that each represent a respective trajectory of one or more of the objects in the desired 3D animation, and that are to not be visualized as an object in the desired 3D animation;

determining that a particular trajectory associated with a particular action element would cause two or more particular objects to enter a prohibited zone in the desired 3D animation;

in response to determining that the particular trajectory associated with a particular action element would cause two or more particular objects to enter the prohibited zone in the desired 3D animation, determining an alternative trajectory that will cause the two or more particular objects to avoid the prohibited zone in the desired 3D animation; and

generating the desired 3D animation based on the 2D representation, comprising animating the two or more particular objects based on the alternative trajectory in lieu of the particular trajectory that is associated with the particular action element in the 2D representation.

16. The system of claim 15, wherein the operations comprise classifying the elements in the 2D representation as either symbolic element or action elements.

17. The system of claim 15, wherein the operations comprise obtaining animation characteristics for each of the symbolic elements.

18. The system of claim 15, wherein each of the action elements comprises a vector that indicates a direction and speed of displacement of an associated object.

19. The system of claim 15, wherein the operations comprise transmitting the generated 3D animation to an extended reality device, for output.

20. The system of claim 15, wherein the operations comprise adjusting a visual perspective associated with the generated 3D animation based on a user input at an extended reality device.