Augmented reality method and system for design

• US 10,580,207 B2
• Filed: 11/24/2017
• Issued: 03/03/2020
• Est. Priority Date: 11/24/2017
• Status: Active Grant

• Current Assignee: Frederic Bavastro
• Original Assignee: Frederic Bavastro
• Inventors: Pejic, Petar, Bavastro, Frederic
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US15/822,070
• Publication Number:
  US 20190164340A1
• Time in Patent Office: 830 Days
• CPC Class Codes: G06F 2111/18 using virtual or augmented reality
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2024 Style variation
• CPC Class Codes: G06T 7/543 from line drawings
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps

Abstract

A system for generating formal premises designs is discussed. The system begins by inputting an informal two-dimensional rendering of the premises. The system continues by analyzing the informal two-dimensional rendering and determining features found on the premises depicted by the two-dimensional rendering. The system then generates a three-dimensional model of the premises and populates it with interactive objects. Finally, the system provides multiple views of the three-dimensional rendering containing interactive objects.

Claims

1. A system for generating formal premises designs comprising:

inputting into the system an informal two-dimensional rendering of the premises by only by photographing an informal two-dimensional sketch of the premises and not by entering information about the premises directly in the system;

analyzing said informal two-dimensional rendering and converting said informal two-dimensional rendering into a numerical matrix;

determining features, wherein said features comprise determining layout of walls, locations of doors along with windows, found on the premises depicted by the two-dimensional rendering further automatically assigning names to each room detected in the premises wherein said determining features step comprises the system calculating an area of each room and wherein said names reflect a type of room detected by the system based on calculated room size and expected room sizes of possible rooms and wherein said determining features uses only the informal drawing as input;

generating a three-dimensional model of the premises;

populating said three-dimensional rendering with interactive objects; and

providing multiple views of the three-dimensional rendering containing interactive objects.

2. The system of claim 1 wherein said inputting into the system comprises taking a photograph of a two-dimensional hand drawn sketch of the premises.

3. The system of claim 1 wherein said analysis occurs in a distributed computing platform.

4. The system of claim 1 wherein said analysis further comprises an augmented reality preview of the three dimensional model.

5. The system of claim 1 wherein said interactive objects comprise virtual versions of furniture, household fixtures, and decorative items.

6. The system of claim 1 wherein said three-dimensional rendering comprises defining windows and doors in the three-dimensional model wherein said rendering is shown in an augmented reality presentation.

7. A system for generating formal premises designs comprising:

reading initial data into the system;

inputting into the system data to represent one or more premises;

wherein said inputting step comprises only photographing of an informal sketch of the premises and not entering information about the premises directly in the system;

converting said input data into a numerical matrix;

analyzing said numerical matrix to generate a three-dimensional model;

modifying the three-dimensional model using augmented reality;

determining features found on the premises wherein said features comprise determining layout of walls, locations of doors along with windows, along with automatically assigning names to each room detected in the premises;

wherein said determining features step comprises the system calculating an area of each room and wherein said names reflect a type of room detected by the system based on calculated room size and expected room sizes of possible rooms and wherein said determining features uses only the informal drawing as input;

generating a final three-dimensional model of the premises;

generating a photorealistic visualization of the premises; and

previewing the photorealistic visualization of the premises.

8. The system of claim 7 wherein said inputting step comprises providing the system a video of a 2-dimensional sketch on paper.

9. The system of claim 7 wherein said inputting step further comprises reading an existing three-dimensional model as a baseline.

10. The system of claim 7 wherein said inputting step comprises importing a completed three-dimensional model.

11. The system of claim 7 wherein said modification of input step further comprises use of artificial intelligence to generate the three-dimensional model.

12. The system of claim 7 wherein said final three-dimensional model is populated by one or more interactive objects.

13. The system of claim 12 wherein said interactive objects comprise furniture and surface finishes to be customized by an end user of the system.

14. The system of claim 7 wherein said previewing of the photorealistic visualization occurs using augmented reality.

15. The system of claim 7 wherein said previewing of the photorealistic visualization occurs using virtual reality.

16. The system of claim 7 wherein said analysis of input determines the type of each room depicted on the premises.

17. The system of claim 7 wherein said analysis of input confirms that each room depicted in the premises is a valid room.

18. The system of claim 7 wherein said analysis step requests user input to ensure proper detection of rooms within depicted premises.

19. The system of claim 7 wherein said analysis step comprises detection of doors and windows within the input design.