Method for forming walls to align 3D objects in 2D environment

• US 10,678,960 B2
• Filed: 04/09/2018
• Issued: 06/09/2020
• Est. Priority Date: 05/13/2014
• Status: Active Grant

• Current Assignee: West Texas Technology Partners LLC
• Original Assignee: Atheer, Inc.
• Inventors: Jovanovic, Milos
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Application Number:
  US15/948,901
• Publication Number:
  US 20180225393A1
• Time in Patent Office: 792 Days
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/12 Shadow map, environment map
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06T 2219/008 Cut plane or projection plane definition
• CPC Class Codes: G06T 2219/012 Dimensioning, tolerancing
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 2219/2008 Assembling, disassembling
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2016 : Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2024 : Style variation

Abstract

Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include capturing the 2D environment and adding scale and perspective to the 2D environment. Further, a user may select intersection points on a ground plane of the 2D environment to form walls, thereby converting the 2D environment into a 3D space. The user may further add 3D models of objects on the wall plane such that the objects may remain flush with the wall plane.

Claims

1. A method for visualizing a three-dimensional model of an object in a two-dimensional environment, the method comprising:

receiving, with a processor via a user interface, from a user, a ground plane input comprising a plurality of ground plane points selected by the user to define a ground plane corresponding to a horizontal plane of the two-dimensional environment;

automatically generating, with the processor, and displaying, via a display unit, a three-dimensional environment for the two-dimensional environment based on the ground plane input;

automatically generating, with the processor, and displaying, via the display unit, a wall plane, representing a vertical plane of the two-dimensional environment orthogonal to the horizontal plane, in the three-dimensional environment positioned at at least two wall-floor intersection points selected by the user; and

superimposing, with the processor, and displaying, via the display unit, the three-dimensional model of the object on the three-dimensional environment for the two-dimensional environment based on the ground plane input and the wall-floor intersection points.

2. The method of claim 1, further comprising:

receiving, with the processor via the user interface, from the user, input comprising a selection of a wall-hidden surface intersection point on the two-dimensional environment, the wall-hidden surface intersection point indicating a second plane behind the wall plane;

automatically generating, with the processor, a wall-hidden surface intersection line between the wall-hidden surface intersection point and the wall plane; and

automatically generating, with the processor, a hidden surface space located behind the wall plane based upon the wall-hidden surface intersection point and the wall-hidden surface intersection line.

3. The method of claim 2, wherein superimposing the three-dimensional model of the object includes positioning the object within the hidden surface space.

4. The method of claim 1, further comprising receiving, with the processor via the user interface, from the user, a plurality of inputs, each of the plurality of inputs indicating the wall-floor intersection point on the two-dimensional environment and generating the wall plane for each pair of the plurality of wall-floor intersection points in the three-dimensional environment based on the plurality of wall-floor intersection points, wherein each pair of wall-floor intersections points is located at a wall-floor intersection of a same wall.

5. The method of claim 1, further comprising receiving, with the processor via the user interface, from the user, an input indicating a ceiling plane.

6. The method of claim 1, further comprising receiving, with the processor via the user interface, from the user, an input indicating a wall-floor intersection line on the two-dimensional environment.

7. The method of claim 6, further comprising displaying, via the display unit, a wall-floor line selection interface including a curve line selection object and a straight line selection object, wherein upon execution of the curve line selection object, the received input of the wall-floor intersection line is formatted as a curved line between selected wall-floor intersection points, and wherein upon execution of the straight line selection object, the received input of the wall-floor intersection line is formatted as a straight line between selected wall-floor intersection points.

8. The method of claim 1, further comprising generating, with the processor, the wall plane in the three-dimensional environment based upon a wall-floor intersection line.

9. The method of claim 1, further comprising receiving, with the processor via the user interface, from the user, an input indicating a ceiling height within the two-dimensional environment.

10. A system for visualizing a three-dimensional model of an object in a two-dimensional environment, the system comprising:

a processor; and

a storage device, the storage device containing instructions executable by the processor comprising;

a visualization module configured to automatically generate and display a three-dimensional environment for the two-dimensional environment based on a ground plane input from a user, the ground plane input comprising a plurality of ground plane points identified by the user to define a ground plane in the three-dimensional environment corresponding to a horizontal plane of the two-dimensional environment, and automatically generate a wall plane in the three-dimensional environment corresponding to a vertical plane of the two-dimensional environment based on two or more wall-floor intersection points, wherein at least two of the two or more wall-floor intersection points are located at a wall-floor intersection of a same wall with the ground plane;

a superimposing module configured to superimpose the three-dimensional model of the object onto the two-dimensional background according to three-dimensional environment.

11. The system of claim 10, wherein superimposing the three-dimensional model of the object includes positioning the three-dimensional model of the object on the wall plane.

12. The system of claim 10, wherein the storage device further contains instructions executable by the processor comprising a receiving module configured to receive, from the user, a plurality of inputs, each of the plurality of inputs indicating a wall-floor intersection point on the two-dimensional environment.

13. The system of claim 12, wherein the visualization module is further configured to generate the wall plane for each pair of the plurality of wall-floor intersection points in the three-dimensional environment based on the plurality of wall-floor intersection points, wherein each pair of the plurality of wall-floor intersection points is located at a wall-floor intersection of a same wall.

14. The system of claim 12, wherein the receiving module is further configured to receive one or more inputs from a user, the inputs including one or more of an import request, a scale data request, a superimposing request, an input indicating a wall-floor intersection point, an input indicating a ground plane, and an input indicating a ceiling plane.

15. The system of claim 12, wherein the receiving module is further configured to receive, from the user, an input of a wall-floor intersection line on the two-dimensional environment.

16. The system of claim 15, wherein the visualization module is further configured to display a wall-floor line selection interface including a curve line selection object and a straight line selection object, wherein upon execution of the curve line selection object, a received input of the wall-floor intersection line is formatted as a curved line between selected wall-floor intersection points, and wherein upon execution of the straight line selection object, the received input of the wall-floor intersection line is formatted as a straight line between selected wall-floor intersection points.

17. The system of claim 12, wherein the receiving module is further configured to receive, from the user, input indicating a ceiling height within the two-dimensional environment.

18. A system for visualizing a three-dimensional model of an object in a two-dimensional environment, the system comprising:

a processor; and

a storage device, the storage device containing instructions executable by the processor comprising;

a visualization module configured to automatically generate and display a three-dimensional environment for the two-dimensional environment based on a ground plane input from the user, the ground plane input comprising a plurality of ground plane points corresponding to a horizontal plane in the two-dimensional environment, that define a ground plane of the three-dimensional environment corresponding to the horizontal plane of the two-dimensional environment, and automatically generate a wall plane in the three-dimensional environment based on two or more wall-floor intersection points, wherein at least two of the two or more wall-floor intersection points are located at a wall-floor intersection of a same wall with the ground plane;

a superimposing module configured to superimpose the three-dimensional model of the object onto one of the ground plane and the wall plane in the three-dimensional environment; and

a saving module configured to save a resulting image comprising the three-dimensional model of the object superimposed onto the three-dimensional environment.

19. The system of claim 18, wherein the visualization module is further configured to display a wall-floor line selection interface including a curve line selection object and a straight line selection object, wherein upon execution of the curve line selection object, a received input of the wall-floor intersection line is formatted as a curved line between selected wall-floor intersection points, and wherein upon execution of the straight line selection object, the received input of the wall-floor intersection line is formatted as a straight line between selected wall-floor intersection points.

20. The system of claim 18, wherein the visualization module is further configured to display a wall-hidden surface intersection line, the wall-hidden surface intersection line connecting the wall plane to a second plane located behind a surface of the wall plane.