Constructing three dimensional model using user equipment

• US 9,589,078 B2
• Filed: 12/28/2012
• Issued: 03/07/2017
• Est. Priority Date: 09/27/2012
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Chen, Yunxia, Xu, Sheng
• Primary Examiner(s): Chad, Aniss
• Assistant Examiner(s): Rogers, David M
• Application Number:
  US13/729,695
• Publication Number:
  US 20140088928A1
• Time in Patent Office: 1,530 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G01B 11/02 for measuring length, width or thickness G01B11/08 takes precedence
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2210/04 Architectural design, interior design

Abstract

A user equipment (UE) comprising a display, a visual input configured to capture motion or stop photography as visual data, a memory comprising instructions, and a processor coupled to the display, the input device, and the memory and configured to execute the instructions by receiving visual data from the visual input, determining a position of the feature relative to the UE if the visual data comprises a feature of a first area of a location, and generating a model of the first area of the location based on the position of the feature. The disclosure also includes a method comprising receiving data indicating a position of a feature of a location relative to a UE, and generating a model of the location based on the position of the feature.

Claims

1. A user equipment (UE) comprising:

a display;

a visual input configured to capture motion or stop photography of a first room as visual data;

a memory comprising instructions; and

a processor coupled to the display, the visual input, and the memory and configured to execute the instructions by;

receiving the visual data from the visual input, wherein the visual data comprises images of features inside of the first room, and wherein the images of the features are captured from inside of the first room;

overlaying a graphical item on the visual data;

causing the visual data with the graphical item to be displayed on the display;

receiving user input indicating when the features of the first room are aligned with the graphical item;

determining positions of the features relative to the UE upon receiving the user input indicating when each feature of the first room is aligned with the graphical item; and

employing the determined positions of the features inside of the first room to generate a model of the first room.

2. The UE of claim 1, wherein determining the positions of the features comprises determining a distance between the UE and one of the features based on a height of the UE above a lower surface of the first room and an angle α

, and wherein the angle α

is an angle between a first line extending from the UE to the one feature and a second line extending between the UE and the one feature in a lateral plane.

3. The UE of claim 2, further comprising an input device, wherein the height is received from a user as user input via the input device.

4. The UE of claim 2, further comprising a position sensor coupled to the processor, wherein the height of the UE is determined based on data from the position sensor.

5. The UE of claim 2, further comprising a position sensor coupled to the processor, wherein the position sensor is configured to transmit field of view data to the processor, and wherein the processor is further configured to execute the instructions by determining the angle α

based on the field of view data.

6. The UE of claim 5, wherein the position sensor comprises a gyroscope or an accelerometer, and wherein the field of view data comprises an angle of a vertical facing of the UE measured by the gyroscope or the accelerometer at a specified time.

7. The UE of claim 5, further comprising an input device coupled to the processor and configured to receive the user input from a user, wherein the processor is further configured to execute the instructions by determining the angle α

based on the field of view data received when the user input indicates the one feature is aligned with the graphical item.

8. The UE of claim 1, wherein a position of each feature is further determined based on a geographical facing of the UE at a specified time.

9. The UE of claim 8, further comprising a magnetometer coupled to the processor, wherein the geographical facing of the UE is determined based on data from the magnetometer.

10. The UE of claim 1, wherein the processor is further configured to execute the instructions by:

generating a model of a second room by determining positions of features inside of the second room relative to the UE upon receiving user input indicating when each feature of the second room is aligned with the graphical item; and

generating a model of a building comprising the model of the first room and the model of the second room.

11. The UE of claim 10, wherein the model of the building is generated by spatially connecting the model of the first room and the model of the second room.

12. The UE of claim 11, further comprising position sensors coupled to the processor, wherein the processor is further configured to execute the instructions by spatially connecting the model of the first room and the model of the second room based on position data received from the position sensors.

13. The UE of claim 12, wherein the position sensors comprise a global positioning system (GPS) sensor, and wherein the model of the first room and the model of the second room are spatially connected based on a global position of each room indicated by the GPS sensor.

14. The UE of claim 11, wherein the processor is further configured to execute the instructions by spatially connecting the model of the first room and the model of the second room based on user input.

15. A method implemented in a user equipment (UE), the method comprising:

receiving, from a visual input of the UE, visual data comprising images of features inside of a room, wherein the images of the features are captured from inside of the room;

overlaying, by a processor of the UE, a graphical item on the visual data;

displaying, by a display of the UE, the visual data with the graphical item;

receiving, via a user input device of the UE, user input indicating when the features of the room are aligned with the graphical item;

determining, by the processor, positions of the features of the room relative to the UE upon receiving the user input indicating when each feature of the room is aligned with the graphical item; and

employing, by the processor, the determined positions of the features inside of the room to generate a model of the room.

16. The method of claim 15, further comprising:

receiving data indicating a height of the UE relative to a floor of the room; and

determining a scale of the model based on the height of the UE relative to the floor of the room.

17. The method of claim 16, wherein determining the positions of the features comprises determining a distance between the UE and the feature based on the height of the UE above the floor of the room and an angle α

, and wherein the angle α

is an angle between a first line extending from the UE to the feature and a second line extending between the UE and the feature in a lateral plane.

18. The method of claim 17, wherein a position of each feature is further determined based on a geographical facing of the UE at a specified time.

19. The method of claim 15, wherein a position of each feature is further determined based on a vertical facing of the UE at a specified time.