Virtual model navigation methods and apparatus

• US 9,595,130 B2
• Filed: 06/17/2014
• Issued: 03/14/2017
• Est. Priority Date: 06/17/2014
• Status: Active Grant

• Current Assignee: Chief Architect Incorporated
• Original Assignee: Chief Architect Incorporated
• Inventors: Wells, Greg, Tenbrink, Chris, Wieland, Carl
• Primary Examiner(s): ZALALEE, SULTANA MARCIA
• Application Number:
  US14/307,242
• Publication Number:
  US 20150363967A1
• Time in Patent Office: 1,001 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

Virtual model navigation methods and apparatus are described. According to one aspect, a user device includes a display screen configured to depict visual images for observation by a user, and processing circuitry configured to control the display device to generate a plurality of views of a virtual scene of the virtual model at a plurality of different moments in time, wherein the processing circuitry is configured to control generation of a first of the views as viewed using the virtual camera at a first orientation within the virtual scene at a first moment in time, to detect a change in orientation of the user device in the physical world, to control generation of a second of the views as viewed using the virtual camera at a second orientation within the virtual scene at a second moment in time as a result of the detected change in orientation of the user device in the physical world, and to control generation of a third of the views as viewed using the virtual camera positioned at a first view point at a third moment in time which is different than a second view point where the virtual camera was positioned during at least one of the first and second moments in time.

Claims

1. A user device comprising:

a display screen configured to depict visual images for observation by a user;

processing circuitry configured to control the display device to generate a plurality of views of a virtual scene of the virtual model at a plurality of different moments in time, wherein the processing circuitry is configured to control generation of a first of the views as viewed using a virtual camera at a first orientation within the virtual scene at a first moment in time, to detect a change in orientation of the user device in the physical world, and to control generation of a second of the views as viewed using the virtual camera at a second orientation within the virtual scene at a second moment in time as a result of the detected change in orientation of the user device in the physical world; and

wherein the processing circuitry is configured to combine an inverse of an initial orientation of the user device with a current orientation of the user device to determine an offset and to use the offset to provide the virtual camera at the second orientation at the second moment in time.

2. The device of claim 1 wherein the processing circuitry uses data regarding the change in orientation of the user device in the physical world to provide the virtual camera at the second orientation.

3. The device of claim 1 wherein the processing circuitry is configured to control the orientation of the virtual camera using the orientation of the user device in the physical world.

4. The device of claim 3 wherein the orientation of the virtual camera is defined to be at an orientation within a coordinate system of the virtual model which is the same as an orientation of the user device in a coordinate system of the physical world.

5. The device of claim 1 further comprising a plurality of gyroscope sensors and wherein the processing circuitry is configured to process data from the gyroscope sensors resulting from the change in orientation of the user device to provide the virtual camera at the second orientation.

6. The device of claim 1 wherein the orientations of the virtual camera in the first and second views correspond to respective orientations of the user device in the physical world.

7. The device of claim 6 wherein the processing circuitry is configured to use the change in orientation of the user device in a global coordinate reference frame to determine the offset.

8. The device of claim 7 wherein the offset provides an orientation of the virtual camera in a scene coordinate reference frame which is the same as an orientation of the user device in the global coordinate reference frame.

9. The device of claim 1 wherein the orientation of the virtual camera defines a view direction of the virtual camera, and the processing circuitry is configured to control the orientation of the virtual camera at the first and second orientations within the virtual scene corresponding to a view direction of the user device in the physical world.

10. The device of claim 9 wherein the view direction of the user device is a vector which is normal to a plane defined by the display screen.

11. The device of claim 1 wherein the processing circuitry controls a view direction of the virtual camera using the offset.

12. The device of claim 1 wherein the processing circuitry is configured to control generation of a third of the views as viewed using the virtual camera positioned at a first view point at a third moment in time which is different than a second view point where the virtual camera was positioned during at least one of the first and second moments in time.

13. The device of claim 12 wherein the virtual camera is positioned at different elevations within the virtual scene at the first and second view points.

14. The device of claim 13 wherein the processing circuitry is configured to access an input from a user control of the user device, and to move the virtual camera from the second view point to the first view point as a result of the accessed input.

15. The device of claim 13 wherein the processing circuitry is configured to detect translation movement of the user device in the physical world and to move the virtual camera from the second view point to the first view point as a result of the detection of the translation movement.

16. The device of claim 15 wherein the processing circuitry is configured to detect a step of the user with the user device to detect the translation movement of the user device.

17. The device of claim 15 wherein a location of the second view point corresponds to the translation movement of the user device in the physical world.

18. The device of claim 15 wherein a distance between the first and second view points corresponds to a distance the user device is moved in the physical world.

19. The device of claim 15 wherein the processing circuitry is configured to move the virtual camera from the second view point to the first view point in a view direction of the user device.

20. The device of claim 1 wherein the azimuth, elevation and twist of the virtual camera within the virtual scene are controlled in the first and second views using azimuth, elevation and twist of the user device in the physical world.

21. The device of claim 20 wherein the azimuth of the virtual camera of an initial view of the virtual model does not correspond to the azimuth of the user device at a corresponding moment in time while the elevation and the twist of the virtual camera of the initial view correspond to the elevation and the twist of the user device.

22. The device of claim 1 further comprising a user control, and wherein the processing circuitry is configured to control generation of a third of the views of the virtual scene of the virtual model as viewed using the virtual camera positioned at a view point as a result of a user input entered via the user control.

23. The device of claim 1 wherein the processing circuitry is configured to apply the offset to an initial orientation of the virtual camera to provide the virtual camera at the second orientation.

24. A virtual model navigation method comprising:

using a display screen of a user device, displaying a plurality of views of a virtual model, wherein individual ones of the views include different virtual content of the virtual model;

accessing information regarding a rotational movement of the user device in the physical world;

wherein the displaying comprises changing orientation of a first of the views of the virtual model compared with a second of the views of the virtual model using the accessed information; and

wherein the changing orientation comprises;

combining an inverse of an initial orientation of the user device with a current orientation of the user device to determine an offset; and

using the offset to provide the changed orientation of the first of the views of the virtual model compared with the second of the views of the virtual model.