Maintaining connection to embedded content using graphical elements

• US 8,902,219 B1
• Filed: 09/21/2011
• Issued: 12/02/2014
• Est. Priority Date: 09/22/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Trimble Navigation Limited (Trimble Inc.)
• Inventors: Hauswirth, Jeffrey, Jackson, Preston, Lacz, Patrick, McLean, Paul, Brown, Brian
• Primary Examiner(s): Hoang, Phi
• Assistant Examiner(s): Akhavannik, Mohammad H
• Application Number:
  US13/238,768
• Time in Patent Office: 1,168 Days
• Field of Search: None
• US Class Current: 345/419
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06T 2219/012 Dimensioning, tolerancing

Abstract

A system and method for dynamically linking or connecting annotations to embedded content, such as a 3D model, using graphical elements within a two-dimensional space is provided. Such connection is maintained as the annotation is rendered with the 3D model, thereby enabling the annotations to intelligently update themselves using 3D information from the embedded content. Further, the capability, as provided herein, to manipulate viewing positions and perspective effects of an embedded 3D model without disrupting the annotations in the two-dimensional page layout provides a greater degree of flexibility and forgiveness.

Claims

1. A computer-implemented method for maintaining a connection to embedded content using a graphical element comprising:

enabling a user to add via user input an annotation object to an embedded three-dimensional graphical model within a two-dimensional viewport space, wherein the embedded three-dimensional model includes a first plurality of graphical elements including a first graphical element and the annotation object includes a second plurality of graphical elements including a second graphical element;

detecting the user input corresponding to the embedded three-dimensional graphical model within the two-dimensional viewport space based on the enabling;

determining a first position of the second graphical element of the annotation object in the two-dimensional viewport space based on the detected user input;

determining a second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional space based on the determined first position;

dynamically linking the first position of the second graphical element of the annotation object in the two-dimensional viewport space to the second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional space based on the detected user input;

storing connection information in association with the annotation object in memory based on the linking, the connection information corresponding to the linked first position of the second graphical element of the embedded three-dimensional graphical model within the two-dimensional viewport space; and

rendering the annotation object with the embedded three-dimensional graphical model within the two-dimensional viewport space based on the stored connection information, wherein positions of the second plurality of graphical elements of the annotation object are dynamically changed within the two-dimensional viewport space as the annotation object is rendered with the embedded three-dimensional graphical model so as to reflect any changes that are made by the user to positions of the first plurality of graphical elements of the embedded three-dimensional graphical model within three-dimensional space,

wherein the enabling, the dynamically linking, the storing, and the rendering are performed by one or more computing devices.

2. The method of claim 1, wherein the annotation object is a dimension object having a dimension value corresponding to a length of a portion of the embedded three-dimensional graphical model.

3. The method of claim 2, wherein the rendering further comprises:

rendering an orthographic view of the embedded three-dimensional graphical model within the two-dimensional viewport space; and

determining the dimension value for the dimension object based on a scale associated with the embedded three-dimensional graphical model in the rendered orthographic view.

4. The method of claim 2, further comprising:

dynamically linking the dimension object to a first point and a second point corresponding to the portion of the embedded three-dimensional graphical model;

calculating a displacement value between the first and second points in the three-dimensional space; and

updating the dimension value for the dimension object based on the calculated displacement value.

5. The method of claim 4, wherein the dimension value of the dimension object is dynamically updated as it is rendered with the embedded three-dimensional graphical model within the two-dimensional viewport space so as to match any changes that are made by the user to the embedded three-dimensional graphical model within the three-dimensional space.

6. The method of claim 1, further comprising:

enabling the user to modify attributes of the second plurality of graphical elements of the annotation object within the two-dimensional viewport space.

7. The method of claim 1, wherein the changes that are made to the embedded three-dimensional graphical model include changes in scale of graphical model within the two-dimensional viewport space.

8. The method of claim 1, wherein the changes that are made to the embedded three-dimensional graphical model include changes to a position and an orientation of the embedded three-dimensional graphical model within the three-dimensional space.

9. The method of claim 8, further comprising:

enabling the user to change the position and the orientation of the embedded three-dimensional graphical model within the three-dimensional space; and

rendering the changed embedded three-dimensional graphical model within the two-dimensional viewport space based on the enabling.

10. The method of claim 9, wherein the enabling the user to change the position and the orientation comprises:

enabling the user to change a perspective of a virtual camera corresponding to the embedded three-dimensional graphical model within the two-dimensional viewport space, and

wherein the rendering the changed embedded three-dimensional graphical model comprises;

rendering the embedded three-dimensional graphical model within the two-dimensional viewport space according to the changed perspective of the virtual camera based on the enabling.

11. The method of claim 1, further comprising:

detecting the changes made by the user to the positions of the first plurality of graphical elements of the embedded three-dimensional graphical model within the three-dimensional space; and

updating the positions of the second plurality of graphical elements of the annotated object within the two-dimensional viewport space based on the detected changes made to the positions of the first plurality of graphical elements.

12. The method of claim 1, wherein the three-dimensional graphic model is provided from a three-dimensional modeling application separate from the two-dimensional page layout application.

13. The method of claim 1, wherein the dynamically linking further comprises determining a location in the three-dimensional world space of the embedded three-dimensional model corresponding to a two-dimensional location of the annotation object in the two-dimensional viewport space;

and

wherein the rendering the annotation object with the embedded three-dimensional graphical model within the two-dimensional viewport space based on the stored connection information further comprises determining a location in the two-dimensional viewport space in which to render the annotation object based on the connection information.

14. The method of claim 1, further comprising:

receiving the three-dimensional graphic model having the three-dimensional world space;

embedding the three-dimensional graphic model within the two-dimensional viewport space of a two-dimensional page layout application; and

displaying a two-dimensional representation of the three-dimensional graphical model in the two-dimensional viewport space of the two-dimensional page layout application.

15. A computer-implemented method for maintaining a connection to embedded content using a graphical element comprising:

receiving a three-dimensional graphic model having a three-dimensional world space;

embedding the three-dimensional graphic model within a two-dimensional viewport space of a two-dimensional page layout application;

displaying a two-dimensional representation of the three-dimensional graphical model in the two-dimensional viewport space of the two-dimensional page layout application;

enabling a user to add via user input an annotation object in association with the embedded three-dimensional graphical model within the two-dimensional viewport space, wherein the embedded three-dimensional model includes a first plurality of graphical elements including a first graphical element and the annotation object includes a second plurality of graphical elements including a second graphical element;

determining a first position of the second graphical element of the annotation object in the two-dimensional viewport space based on a detected user input;

determining a second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional world space based on the determined first position;

dynamically linking the first position of the second graphical element of the annotation object in the two-dimensional viewport space to the second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional world space;

storing connection information in association with the annotation object in memory based on the linking, wherein positions of the second plurality of graphical elements of the annotation object are automatically changed within the two-dimensional viewport space as the annotation object is rendered with the embedded three-dimensional graphical model within the two-dimensional viewport space so as to match any changes that are made by the user to positions of the first plurality of graphical elements of the embedded three-dimensional graphical model within three-dimensional world space; and

rendering the annotation object with the embedded three-dimensional graphical model within the two-dimensional viewport space, wherein the enabling, the dynamically linking, the storing, and the rendering are performed by one or more computing devices.

16. A system for maintaining a connection to embedded content using a graphical element comprising:

a processing device, including;

a processor; and

memory, wherein one or more managers are stored in the memory and executed by the processor, the managers including;

a three-dimensional model manager to embed a three-dimensional graphical model within a two-dimensional viewport space;

a graphical user interface (GUI) manager to enable a user to add via user input an annotation object to the embedded three-dimensional graphical model within the two-dimensional viewport space, and to detect the user input corresponding to the embedded three-dimensional graphical model within the two-dimensional viewport space, wherein the embedded three-dimensional model includes a first plurality of graphical elements including a first graphical element and the annotation object includes a second plurality of graphical elements including a second graphical element; and

an annotation manager to determine a first position of the second graphical element of the annotation object in the two-dimensional viewport space based on the detected user input, to determine a second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional space based on the determined first position, to dynamically link the first position of the second graphical element of the annotation object in the two-dimensional viewport space to the second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional space, to store connection information in association with the annotation object in memory based on the link, the connection information corresponding to one or more points associated with the second position of the first graphical element of the embedded three-dimensional model within the two-dimensional viewport space, and to render the annotation object with the embedded three-dimensional graphical model within the two-dimensional viewport space based on the stored connection information, wherein positions of the second plurality of graphical elements of the annotation object are dynamically changed within the two-dimensional viewport space as the annotation object is rendered with the embedded three-dimensional graphical model so as to reflect any changes that are made by the user to positions of the first plurality of graphical elements of the embedded three-dimensional graphical model within three-dimensional space.

17. The system of claim 16, wherein the annotation object is a dimension object having a dimension value corresponding to a length of a portion of the embedded three-dimensional graphical model.

18. The system of claim 17, wherein the annotation manager is further configured to render an orthographic view of the embedded three-dimensional graphical model within the two-dimensional viewport space, and to determine the dimension value for the dimension object based on a scale associated with the embedded three-dimensional graphical model in the rendered orthographic view.

19. The system of claim 17, wherein the annotation manager is configured to dynamically link the dimension object to a first point and a second point corresponding to the portion of the embedded three-dimensional graphical model, and to render the annotation object with the embedded three-dimensional graphical model within the two-dimensional viewport space based on the stored connection information by calculating a displacement value between the first and second points in the three-dimensional space and updating the dimension value for the dimension object based on the calculated displacement value.

20. The system of claim 19, wherein the annotation manager is further configured to dynamically update the dimension value of the dimension object as it is rendered with the embedded three-dimensional graphical model within the two-dimensional viewport space so as to match any changes that are made by the user to the position or the orientation of the embedded three-dimensional graphical model within the three-dimensional space.

21. The system of claim 16, wherein the three-dimensional model manager receives the three-dimensional graphic model having the three-dimensional space and embeds the three-dimensional graphical model within a two-dimensional viewport space of a two-dimensional page layout application;

and

wherein the GUI manager displays the two-dimensional representation of the three-dimensional graphical model in the two-dimensional viewport space of the two-dimensional page layout application.

22. A computer readable storage device having control logic recorded thereon that if executed by a processor, causes the processor to perform operations to maintain a connection to embedded content using a graphical element, the operations comprising:

enabling a user to add via user input an annotation object to an embedded three-dimensional graphical model within a two-dimensional viewport space, wherein the embedded three-dimensional model includes a first plurality of graphical elements including a first graphical element and the annotation object includes a second plurality of graphical elements including a second graphical element;

detecting the user input corresponding to the embedded three-dimensional graphical model within the two-dimensional viewport space based on the enabling;

determining a first position of the second graphical element of the annotation object in the two-dimensional viewport space based on the detected user input;

determining a second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional space based on the determined first position;

dynamically linking the first position of the second graphical element of the annotation object in the two-dimensional viewport space to the second position of the first graphical element of the embedded three-dimensional graphical model in the three-dimensional space based on the detected user input;

storing connection information in association with the annotation object in memory based on the linking, the connection information corresponding to the linked second position of the first graphical element of the embedded three-dimensional graphical model within the two-dimensional viewport space; and

rendering the annotation object with the embedded three-dimensional graphical model within the two-dimensional viewport space based on the stored connection information, wherein positions of the second plurality of graphical elements of the annotation object are dynamically changed within the two-dimensional viewport space as the annotation object is rendered with the embedded three-dimensional graphical model so as to reflect any changes that are made by the user to positions of the first plurality of graphical elements of the embedded three-dimensional graphical model within three-dimensional space, and the enabling, the dynamically linking, the storing, and the rendering are performed by one or more computing devices.

23. The computer readable storage device of claim 22, further comprising:

receiving the three-dimensional graphic model having the three-dimensional world space;

embedding the three-dimensional graphic model within the two-dimensional viewport space of a two-dimensional page layout application; and

displaying the two-dimensional representation of the three-dimensional graphical model in the two-dimensional viewport space of the two-dimensional page layout application.