Virtual model viewing methods and apparatus

• US 9,589,354 B2
• Filed: 06/17/2014
• Issued: 03/07/2017
• Est. Priority Date: 06/17/2014
• Status: Active Grant

• Current Assignee: Chief Architect Incorporated
• Original Assignee: Chief Architect Incorporated
• Inventors: Wells, Greg, Tenbrink, Chris, Wieland, Carl, DeBroeck, Dan
• Primary Examiner(s): ZALALEE, SULTANA MARCIA
• Application Number:
  US14/307,183
• Publication Number:
  US 20150363966A1
• Time in Patent Office: 994 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/344 involving models
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

Virtual model viewing methods and apparatus are described. According to one aspect, a virtual model viewing method includes using a user device, accessing model data which may be used to generate a plurality of views of a virtual model, using a camera of the user device, generating image data of content of the physical world, and using the model data and the image data, creating one of the views of the virtual model which comprises at least some of the content of the physical world, and displaying the one view of the virtual model using a display screen of the user device.

Claims

1. A virtual model viewing method comprising:

using a user device, accessing model data which may be used to generate a plurality of views of a virtual model which comprises a structure;

using a camera of the user device, generating image data of content of the physical world;

using the model data and the image data, creating one of the views of the virtual model which comprises at least some of the content of the physical world;

displaying the one view of the virtual model using a display screen of the user device;

wherein the creating the one view of the virtual model comprises creating using a virtual camera positioned at a view point which is located within an interior of the structure of the virtual model;

wherein the displayed one view of the virtual model includes an interior portion of the structure of the virtual model; and

wherein the at least some of the content of the physical world is visible within an area of the displayed one view of the virtual model which is defined by the interior portion of the structure of the virtual model.

2. The method of claim 1 wherein the camera of the user device has a field of view, and further comprising configuring the virtual camera to have a field of view which corresponds to a field of view of the camera of the user device.

3. The method of claim 1 further comprising:

obtaining information regarding the field of view of the camera of the user device; and

configuring a field of view of the virtual camera using the obtained information.

4. The method of claim 3 wherein the configuring comprises configuring the virtual camera to have a field of view which corresponds to the field of view of the camera of the user device.

5. The method of claim 4 wherein the configuring comprises configuring the virtual camera to have a field of view which is the same as the field of view of the camera of the user device.

6. The method of claim 4 wherein the obtaining comprises obtaining the information regarding the field of view from the user device.

7. The method of claim 1 further comprising controlling a view direction of the virtual camera using a view direction of the user device in the physical world.

8. The method of claim 7 wherein the controlling comprises controlling the view direction of the virtual camera to correspond to the view direction of the user device.

9. The method of claim 7 wherein the view direction of the user device is in a direction which is orthogonal to a plane which includes the display screen of the user device.

10. The method of claim 9 wherein the view direction of the user device is the same as a view direction of the camera of the user device.

11. The method of claim 10 further comprising aligning a scene coordinate reference frame of the virtual model with a global coordinate reference frame of the physical world.

12. The method of claim 11 wherein the controlling comprises controlling the view direction of the virtual camera in the scene coordinate reference frame to be the same as the view direction of the user device in the global coordinate reference frame.

13. The method of claim 11 wherein the aligning comprises aligning using a user input.

14. The method of claim 1 wherein the area of the displayed one view of the virtual model is a translucent surface.

15. The method of claim 14 wherein the at least some of the content of the physical world is shown as a backdrop within the one view.

16. The method of claim 14 wherein the image data is shown as a backdrop within the one view.

17. The method of claim 14 wherein the at least some of the content of the physical world is visible within the area of the one view as a result of the translucent surface being located at an outermost boundary of the virtual model.

18. The method of claim 1 wherein the at least some of the content of the physical world which is visible in the area is outside of the virtual model.

19. The method of claim 1 wherein the structure of the virtual model is an architectural structure and the area corresponds to a window within the interior portion of the structure which is an interior wall.

20. The method of claim 1 wherein the interior portion of the structure of the virtual model surrounds an entirety of the area which includes the at least some of the content of the physical world.

21. The method of claim 1 wherein the virtual model includes a translucent surface which corresponds to the area, the content of the physical world is used as a backdrop, and the virtual model is overlaid upon the backdrop.

22. An article of manufacture comprising non-transitory storage media storing programming instructions configured to cause processing circuitry to perform the method of claim 1.

23. A computing system configured to perform the method of claim 1.