Virtual model navigation methods and apparatus

• US 9,575,564 B2
• Filed: 06/17/2014
• Issued: 02/21/2017
• Est. Priority Date: 06/17/2014
• Status: Active Grant

• Current Assignee: Chief Architect Incorporated
• Original Assignee: Chief Architect Incorporated
• Inventors: Wells, Greg, Tenbrink, Chris, Wieland, Carl, DeBroeck, Dan
• Primary Examiner(s): ZALALEE, SULTANA MARCIA
• Application Number:
  US14/307,117
• Publication Number:
  US 20150363965A1
• Time in Patent Office: 980 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2210/04 Architectural design, interior design

Abstract

Virtual model navigation methods and apparatus are described. According to one aspect, a virtual model navigation method includes using a display screen of a user device, displaying a plurality of views of a virtual model in a plurality of frames, wherein the displaying comprises displaying one of the views in one of the frames with the virtual camera positioned at a first view point within a virtual scene of the virtual model, after the displaying the one of the views, detecting movement of the user device from a first location in the physical world at the first moment in time to a second location in the physical world at a second moment in time, and wherein the displaying comprises displaying another of the views in another of the frames with the virtual camera positioned at a second view point within the virtual scene as a result of the detection of the movement of the user device.

Claims

1. A virtual model navigation method comprising:

using a display screen of a user device, displaying a plurality of views of a virtual model in a plurality of frames;

wherein the displaying comprises displaying one of the views in one of the frames with a virtual camera positioned at a first view point within a virtual scene of the virtual model;

after the displaying the one of the views, detecting movement of the user device from a first location in the physical world at the first moment in time to a second location in the physical world at a second moment in time;

wherein the displaying comprises displaying another of the views in another of the frames with the virtual camera positioned at a second view point within the virtual scene as a result of the detection of the movement of the user device;

wherein the detecting comprises detecting a presence of a footstep of a user while the user is walking with the user device and during the display of the one view of the virtual scene in the one frame; and

using an attenuation function to ensure the virtual camera moves within the virtual scene while the user is walking and the virtual camera stops moving within the virtual scene if another footstep of the user is not detected after a predefined amount time.

2. The method of claim 1 further comprising moving the virtual camera from the first view point to the second view point within the virtual scene as a result of the detection of the movement.

3. The method of claim 2 wherein the moving the virtual camera comprises maintaining a substantially constant elevation of the virtual camera within the virtual scene.

4. The method of claim 2 wherein a location of the second view point corresponds to the movement of the user device in the physical world from the first location to the second location.

5. The method of claim 4 wherein a distance between the first and second view points corresponds to a distance the user device is moved in the physical world during the moving.

6. The method of claim 5 further comprising determining the distance the user device is moved without use of any signals which were originally transmitted externally of the user device and received by the user device.

7. The method of claim 5 further comprising determining the distance the user device is moved without processing of image data.

8. The method of claim 5 wherein the location of the second view point within the virtual scene is controlled by an orientation of the user device in the physical world.

9. The method of claim 1 wherein the detecting movement comprises detecting using an accelerometer sensor of the user device which is aligned with one axis of a device coordinate reference frame of the user device.

10. The method of claim 1 further comprising:

detecting a change in orientation of the user device in the physical world; and

changing an orientation of the virtual camera in the virtual scene as a result of the detecting.

11. The method of claim 10 wherein the changing the orientation of the virtual camera corresponds to the detected change in orientation of the user device in the physical world.

12. The method of claim 11 wherein the change in orientation of the user device comprises a rotation of the user device about at least one axis in a global coordinate reference frame of the physical world and the change in orientation of the virtual camera comprises a corresponding rotation of the virtual camera about at least one axis in a scene coordinate reference frame of the virtual model.

13. The method of claim 11 wherein the orientation of the user device in the physical world defines a direction of translation of the virtual camera in the virtual scene.

14. The method of claim 11 wherein the user device defines a view direction in the physical world which defines a view direction of the virtual camera in the virtual scene.

15. The method of claim 14 wherein the view direction of the user device is a vector which is normal to a plane defined by the display screen.

16. The method of claim 14 wherein the first view point and an initial view direction of the virtual camera is defined by user input.

17. The method of claim 1 wherein the detecting comprises:

detecting using accelerometer data from an accelerometer sensor configured to detect forces along an axis of the user device of a device coordinate reference frame; and

transforming the accelerometer data to accelerometer data of a global coordinate reference frame.

18. The method of claim 1 further comprising moving the virtual camera from the first view point to the second view point as a result of the detecting the presence of the footstep.

19. The method of claim 18 wherein the detecting comprises detecting during the execution of a first loop by the processing circuitry and the moving comprises moving during the execution of a second loop by the processing circuitry which is independent of the first loop.

20. The method of claim 1 wherein a frequency of execution of the first loop is greater than a frequency of execution of the second loop.

21. The method of claim 18 wherein the moving comprises moving the virtual camera instantly upon the detecting the presence of the footstep, and reducing a velocity of the virtual camera as time elapses in the absence of detection of the another footstep.

22. The method of claim 18 wherein the moving comprises moving the virtual camera at a velocity which corresponds to a frequency of footsteps of the user during walking with the user device.

23. The method of claim 1 further comprising determining a distance in the virtual scene which corresponds to the footstep of the user walking with the user device, and the second view point is spaced the determined distance from the first view point.

24. The method of claim 23 wherein the determining comprises determining the distance in the virtual scene using a time between the one frame and the another frame, a frequency of footsteps of the user during walking with the user device, and a length of one of the footsteps of the user.

25. The method of claim 24 further comprising determining the length of one of the footsteps of the user by detecting a number of the footsteps of the user over a measured distance.

26. The method of claim 25 wherein the determining further comprises dividing the measured distance by the detected number of footsteps.

27. The method of claim 25 further comprising determining the measured distance using information from a location sensor.

28. The method of claim 24 further comprising determining the frequency of footsteps of the user using accelerometer data of the user device.

29. The method of claim 1 wherein the attenuation function is defined by:

30. The method of claim 1 wherein the virtual camera is positioned at different elevations within the virtual scene at the first and second view points.

31. The method of claim 1 wherein a view direction of the user device during the detecting the presence of the footstep defines a direction of translation of the virtual camera within the virtual scene.

32. The method of claim 1 further comprising moving the virtual camera from the first view point to the second view point within the virtual scene as a result of the detection of the footstep comprising a single footstep.

33. The method of claim 1 wherein the virtual camera is positioned at different elevations within the virtual scene at the first and second view points.

34. The method of claim 1 wherein a view direction of the user device in the physical world during the movement of the user device defines a direction of translation of the virtual camera within the virtual scene.

35. The method of claim 34 wherein the view direction of the user device is a vector which is normal to a plane defined by the display screen.

36. The method of claim 34 wherein the view direction of the user device in the physical world controls a view direction of the virtual camera within the virtual scene.

37. A virtual model navigation method comprising:

using a display screen of a user device, displaying a plurality of views of a virtual model;

detecting a translation movement of the user device in the physical world during the displaying;

wherein the displaying comprises displaying different portions of the virtual model in different ones of the views as a result of the detecting the translation movement of the user device in the physical world;

wherein the detecting comprises detecting a presence of a footstep of a user while the user is walking with the user device and during the display of one of the views of the virtual model; and

using an attenuation function to ensure a virtual camera moves while the user is walking and the virtual camera stops moving if another footstep of the user is not detected after a predefined amount time.

38. The method of claim 37 further comprising providing the virtual camera at different view points within a virtual scene of the virtual model to generate the different ones of the views as a result of the detected translation movement.