MAN-MACHINE INTERACTION CONTROLLING METHOD AND APPLICATIONS THEREOF

• US 20130331964A1
• Filed: 08/09/2013
• Published: 12/12/2013
• Est. Priority Date: 02/11/2011
• Status: Active Grant

• Current Assignee: Defeng Huang
• Original Assignee: Defeng Huang
• Inventors: HUANG, Defeng
• Granted Patent: US 10,058,773 B2
• Time in Patent Office: Days
• US Class Current: 700/83
• CPC Class Codes: A63F 13/20 Input arrangements for video game devices
• CPC Class Codes: A63F 13/21 characterised by their sensors, purposes or types
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/422 automatically for the purpose of assisting the player, e.g. automatic braking in a driving game
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6054 by generating automatically game commands to assist the player, e.g. automatic braking in a driving game
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 30/20 Design optimisation, verification or simulation optimisation, verification or simulation of circuit designs G06F30/30

Abstract

A man-machine interaction controlling method and applications thereof are provided. A user performs user permitted micro-actions to control a self-role in a virtual environment to perform a virtual permission action plan on an operation position. The method includes steps of: 1) creating the self-role in the virtual environment; 2) performing micro-actions without leaving the position where the user stays; 3) tracing and recognizing the micro-action permitted by the user to enable the user need not leave away the position where the user stays when performing any micro-actions; 4) enabling the self-role to enlarge the micro-action of the user. Further an action enlarging system enables the user to control the self role in the virtual environment to do any actions while the user need not leave away from the control platform, further enables the user in the same operation platform during the operation process and easy to achieve that the kinetic parts of the user keep identical with the virtual action parts of the virtual role in the virtual environment, thereby the user is easy to operate.

Claims

1. A man-machine interaction controlling method, wherein a user performs user permitted micro-actions to control a self-role in a virtual environment to perform a virtual permission action plan on an operation position, the method comprises steps of:

1) creating the self-role in the virtual environment to make the self-role have more than one virtual action part;

2) associating kinetic parts of the user with the virtual action parts of the self-role, determining enlarging times of an action range of different virtual action parts relative to action range of the kinetic parts of the user, permitting gestures of the two adjacent kinetic parts of the user are different from gestures of the associating virtual actions parts of the self-role, further permitting movement morphology of the user and the self-role are different and not similar, further satisfying the self-role is not lying or siting in a movement process while the user is lying or siting on the operation position and need not leave away from the operation position;

3) performing the micro-actions by the user while siting or lying on an operating position;

4) enabling the self-role to enlarge the micro-action of the user.

2. The man-machine interaction controlling method as claimed in claim 1, wherein a maximum range value M is set for each of the user permitted micro-actions which are performed by of the user or a prop, a maximum range value N is set for the virtual permission actions which are performed by the self-role, the N is less than a movement limit of the corresponding kinetic part of the user, supposing the action range of the micro-action permitted by the user at time t is Mt, the action range of the virtual permission action performed by the self-role is Nt, then if Mt≧

M, Nt=N;

if Mt<

M, N>

Nt>

Mt, further in the virtual embodiment, the user is always in a same operation position and need not leave away from the operation position, the method further comprising the steps of;

1) defining a upper limit of the action range M of the micro-action to ensure the user continuously to perform any controlling action;

2) limiting a maximum movement range of user'"'"'s limbs and enabling the limited parts can perform the micro-action completely.

3. The man-machine interaction controlling method as claimed in claim 1, further comprising one or more of the following steps of:

1) acting to corresponding parts of the user according to an action of an object when any object in the virtual environment acts to certain or some parts of self-role;

2) determining reaction parts and effect acted to the self-role to make the action acting to the corresponding acted parts of the user is proportional to the determined reaction effect according to the action characters and the instantaneous state of the self-role acting to any object in the virtual environment;

3) establishing one or more sets of user permitted micro-action plan or one or more sets of virtual permission action plan;

4) enabling the user only to see animation view of the virtual environment and not to see the body of himself/herself;

5) enabling images of the virtual environment to cover vision of the user;

6) permitting at least two virtual action parts whose enlarging times are not 1 to have different enlarging times.

4. The man-machine interaction controlling method as claimed in claim 1, further comprising:

making the corresponding parts of the user to be acted with a certain proportion load that the user is able to receive according to the physical fatigue degree or the biggest motion ability of the self-role.

5. The man-machine interaction controlling method as claimed in claim 1, wherein a selecting method and a combination method are used, the selecting method is permitting the user select other kinetic parts of the user to replace the corresponding virtual action parts of the self-role when the user has no the parts corresponding to the virtual action parts of the self-role, the combination part is setting a share part on the user'"'"'s body to control more than one virtual action parts of the self-role when the number of the kinetic parts on user'"'"'s body is less than that of the virtual action parts of the self-role.

6. The man-machine interaction controlling method as claimed in claim 5, wherein the combination method further comprises one or more of the following steps:

1) selecting other virtual action parts by a command or in cooperating with other kinetic parts when the virtual action parts of the self-role is required to switch;

2) combing the share part with one or more kinetic parts to control the virtual permission action plan together.

7. The man-machine interaction controlling method as claimed in claim 5, wherein the virtual environment comprises at least one or more of a future environment, a past environment, and a dream environment.

8. The man-machine interaction controlling method as claimed in claim 1 wherein the method provides a super ability to the self-role, and further comprises the steps of:

1) creating a virtual permission action plan of super ability of the self-role excepting the ability for enlarging stamina of the user.

2) tracing the change of the permitted micro-action of the user and determining the acted object of the virtual permission action of super ability of the self-role.

3) evaluating evaluation indicators of the super ability of the self-role during performing the virtual permission action of the super ability to make the acted object generate morphology change proportionally.

9. The man-machine interaction controlling method as claimed in claim 7, wherein the method opens the authority to the user to reset the parameters of the object in the virtual environment to enable the user to establish, adjust, and delete the virtual environment.

10. The man-machine interaction controlling method as claimed in claim 1, wherein the method, applied to the exhibition and communication of the space design and space sample, comprises the steps of:

1) modeling a 3D model for a space design and a space sample;

2) enabling the user to use the man-machine interaction controlling method claimed in any one of the claims 1-4 to control the self-role to perform the virtual actions in the 3D model modeled for the space design and space sample.

11. The man-machine interaction controlling method as claimed in claim 1, which is applied to shoot a movie, comprises the steps of:

1) modeling a 3D model for movie scenes;

2) enabling actors to use the man-machine interaction controlling method claimed in any one of the claims 1-4 to control the self-role to perform the virtual actions in the 3D model modeled in the step

     1);

recording the required scenes in the 3D model and images of the virtual actions performed by the self-role.

12. The man-machine interaction controlling method as claimed in claim 1, wherein the method is applied to simulate an experiment and comprises the steps of:

collecting the known laws of nature and establishing algorithm f[x1(x11, x12 . . . x1n), x2(x21, x22 . . . x2n) . . . xn(xn1, xn2 . . . xnn)]=y1(y11, y12 . . . y1n), y2(y21, y22 . . . y2n) . . . yn(yn1, yn2 . . . ynn), wherein Xn is a main element before a reaction, Xnn is the computing parameters of the Xn, yn is a main element after the reaction, ynn is computing parameters of yn, f is an algorithm formular.

enabling the user to use the man-machine interaction controlling method claimed in any one of the claims 1-3 to control the self-role performs f1 action to the xn in the virtual environment and adjust the xnn value of the xn to the setting value of the user;

computing and recording the yn value and ynn value according to the algorithm formular of the step

     1).

13. The man-machine interaction controlling method as claimed in claim 1, which is applied to travel, comprises the steps of:

1) modeling a 3D model to tourist areas;

2) enabling the user to use the man-machine interaction controlling method claimed in any one of the claims 1-3 to control the self-role to perform the virtual action in the 3D model of the step

     1).

14. a man-machine interaction controlling system, a user performs a user permitted micro-action on an operation position to control a self-role in a virtual environment, wherein the system comprises an imaging device, an operation platform, a recognizing and capturing device for recognizing and capturing the user permitted micro-action plan, and a synchronization controlling system for controlling the synchronization of the actions of the user and self-role;

the operation platform includes an operation position and an obstacle system, the obstacle system provides a limitation mechanism to limit the movement range of the user'"'"'s limbs to make the limited parts perform the permitted action at a maximum range M and ensure the user continuously perform any controlling action while the user is not required to leave away from the operation position;

the recognizing and capturing device is capable of recognizing and capturing the user permitted micro-action;

the synchronization controlling system satisfies;

1) associating kinetic parts of the user with the virtual action parts of the self-role;

determining enlarging times of an action range of different virtual action parts relative to action range of the kinetic parts of the user, permitting gestures of the two adjacent kinetic parts of the user are different from gestures of the associating virtual actions parts of the self-role, further permitting movement morphology of the user and the self-role is different and not similar, further satisfying the self-role is not lying or siting in a movement process while the user is lying or siting on the operation position and need not leave away from the operation position;

2) a maximum range value M is set for each of the user permitted micro-actions which are performed by of the user or a prop, a maximum range value N is set for the virtual permission actions which are performed by the self-role, the N is less than a movement limit of the corresponding kinetic part of the user, supposing the action range of the micro-action permitted by the user in time t is Mt, the action range of the virtual permission action performed by the self-role is Nt, then if Mt≧

M, Nt=N;

if Mt<

M, N>

Nt>

Mt;

3) the virtual action plan refers to the action or action plan performed by the self-role or a prop in the virtual environment and defined by the virtue environment.

15. The man-machine interaction controlling system as claimed in claim 14, further comprising one or more of the following features:

1) displaying the imaging device of the virtual environment to make the images of the virtual environment cover the vision of user and enabling the user only to see the animation view of the virtual environment and do not see the body of himself/herself;

2) the recognizing and capturing device including a plurality of position sensing elements with different distinct characters to make the computer to recognize the user'"'"'s parts corresponding to the position sensing elements.

3) the obstacle system further including a reaction sensing device and/or action sensing device;

the obstacle system acting to the corresponding parts of the user according to the characters of the action of the object when any object in the virtual environment acts to one or some parts of the self-role;

the reaction sensing device determining the reaction parts and effect acted to the self-role to make the corresponding acted parts of the user to be proportional to the determined reaction effect according to the action characters and the instantaneous state of the self-role;

4) the system further comprising one or more of a olfactory system, a tactile system, a physical fatigue random obstacle system.

16. The man-machine interaction controlling system as claimed in claim 15, wherein the obstacle system changes the load which the reaction sensing device and the action sensing device put on the user according to the physical fatigue degree or the biggest motion ability of the self-role.