3D NAVIGATION MODE

• US 20170293350A1
• Filed: 12/19/2014
• Published: 10/12/2017
• Est. Priority Date: 12/19/2014
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: HSIAO, CHIH PIN, COOK, GREGORY WILLIAM, WEI, JISHANG, VANKIPURAM, MITHRA, CHANG, NELSON L.
• Granted Patent: US 10,809,794 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]

Abstract

An example method is provided in according with one implementation of the present disclosure. The method includes identifying an intention of a user of a system in relation to a three-dimensional (3D) virtual object and selecting a 3D navigation mode from a plurality of 3D navigation modes based on the identified user intention. The plurality of 3D navigation modes includes at least a model navigation mode, a simple navigation mode, a driving navigation mode, a reaching navigation mode, and a multi-touch navigation mode. The method further includes transitioning the system to the selected 3D navigation mode.

Claims

1. A method comprising, by at least one processor:

identifying an intention of a user of a system in relation to a three-dimensional (3D) virtual object;

selecting a 3D navigation mode from, a plurality of 3D navigation modes based on the identified user intention, wherein the plurality of 3D navigation modes includes at least a model navigation mode, a simple navigation mode, a driving navigation mode, a reaching navigation mode, and a multi-touch navigation mode; and

transitioning the system to the selected 3D navigation mode.

2. The method of claim 1, wherein the system comprises a 3D display displaying at least one 3D virtual object, a computing device having a touch panel;

and a plurality of sensors connected to the computing device, and wherein identifying the intention of a user in relation to the (3D) virtual object includes;

identifying an attention engagement level of the user,

identifying a pose of the user in relation to the computing device, and

determining the intention of the user in relation to the 3D virtual object based on the user'"'"'s attention engagement level and the user'"'"'s pose.

3. The method of claim 1, further comprising implementing a navigation action with the 3D virtual object based on at least one of the selected 3D navigation mode and an identified user gesture.

4. The method of claim 3, further comprising:

automatically rotating the 3D virtual object according to an angular rate of rotation on the computing device, when the system is in a model navigation mode.

5. The method of claim 3, further comprising:

detecting an initial rotational movement by the computing device and automatically rotating the 3D virtual object according to an angular rotational velocity of the computing device until the 3D virtual object comes to a natural position, when the system is in a simple navigation mode.

6. The method of claim 3, further comprising:

rotating the 3D virtual object according to a function of a rotation angle of the computing device, when the system is in a driving navigation mode.

7. Thee method of claim 3, further comprising:

automatically adjusting at least one of a view point of the 3D virtual object and the 3D virtual object, when a reaching gesture is detected and the system is in a reaching navigation mode.

8. The method of claim 3, further comprising:

moving the 3D virtual object in a direction corresponding to the direction of a moving touch gesture, when a moving touch gesture is detected on the touch panel and the system is in a multi-touch navigation mode.

9. A system comprising:

(this claim relates to the proposed system)

a 3D display displaying at least one 3D visualization;

a computing device including a touch display and a plurality of sensors;

a behavior analysis engine to perform a behavior analysis of a user by using data from the plurality of sensors, the behavior analysis engine to;

determine an attention engagement level of the user, and

determine a pose of the user in relation to the auxiliary computing device;

an intention analysis engine to determine an intention of the user in relation to the at least one 3D visualization based on the user'"'"'s attention engagement level and the user'"'"'s pose; and

a navigation mode engine to select 3D navigation mode from a plurality of 3D navigation modes based on the identified user intention, wherein the plurality of 3D navigation modes includes at least a model navigation mode, a simple navigation mode, a driving navigation mode, a reaching navigation mode, and a multi-touch navigation mode.

10. The system of claim 9, further comprising a navigation action engine to:

execute a navigation action with the 3D visualization based on at least one of the selected 3D navigation mode and an identified user gesture.

11. The system of claim 10, wherein the navigation mode engine is further to:

automatically rotate the 3D visualization according to an angular rate of rotation on the computing device, when the system is in the model navigation mode.

12. The system of claim 10, wherein the navigation mode engine is further to:

automatically rotate the 3D visualization according to an angular rotational velocity of the computing device until the 3D visualization comes to a natural position, when the system is in the simple navigation mode.

13. The system of claim 10, wherein the navigation mode engine is further to:

rotate the 3D visualization according to a function of a rotation angle of the computing device, when the system is in a driving navigation mode.

14. Thee system of claim 10, wherein the navigation mode engine is further to:

automatically adjust at least one of a view point of the 3D visualization and the 3D visualization, when a reaching gesture is detected and the system is in a reaching navigation mode

15. The system of claim 10, wherein the navigation mode engine is further to:

move the 3D visualization in a direction corresponding to the direction of a moving touch gesture, when moving touch gesture is detected on the touch panel and the system is in the multi-touch navigation mode.

16. A non-transitory machine-readable storage medium encoded with instructions executable by at least one processor, the machine-readable storage medium comprising instructions to:

perform a behavior analysis of a user of a system including a 3D display displaying a 3D visualization, a computing device having a touch display, and a plurality of sensors connected to the computing device by using data from the plurality of sensors, the behavior analysis to;

identify an attention engagement level of the user, and

identify a pose of the user in relation to the computing device;

perform an intention analysis of the user in relation to the 3D visualization based on the user'"'"'s attention engagement level and the user'"'"'s pose;

transition the system to a 3D navigation mode selected from a plurality of 3D navigation modes based on the identified user intention; and

implement a navigation action with the 3D visualization based on at least one of the 3D navigation mode and a detected user gesture.

17. The non-transitory machine-readable>

storage medium of claim 16, wherein the plurality of 3D navigation modes includes at least a model navigation mode, a simple navigation mode, a driving navigation mode, a reaching navigation mode, and a multi-touch navigation mode.