HUMAN-COMPUTER INTERACTION METHOD, TERMINAL AND SYSTEM

• US 20150227198A1
• Filed: 04/17/2015
• Published: 08/13/2015
• Est. Priority Date: 10/23/2012
• Status: Abandoned Application

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: FANG, Jin, TANG, Mu, CHEN, Yan, DU, Jian, JIN, Jinsong, CHENG, Jun, LIANG, Jingbiao, WANG, Tao, WAN, Xi
• Application Number:
  US14/690,263
• Publication Number:
  US 20150227198A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Embodiments of the present disclosure disclose a human-computer interaction method, including: acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera; acquiring a corresponding operation instruction according to a combined gesture formed by the acquired positions and/or motion tracks of the multiple auxiliary light sources in the captured area; and executing the acquired operation instruction. The embodiments of the present disclosure further disclose a human-computer interaction terminal and system. By using the present disclosure, interference immunity of gesture input can be improved, thereby improving accuracy of manipulation.

Claims

1. A human-computer interaction method, comprising:

at a terminal device having one or more processors and memory for storing program modules to be executed by the one or more processors;

acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera;

acquiring a corresponding operation instruction according to a combined gesture formed by the acquired positions and/or motion tracks of the multiple auxiliary light sources in the captured area; and

executing the acquired operation instruction.

2. The human-computer interaction method according to claim 1, wherein the step of acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera further includes:

distinguishing the position or motion track of each auxiliary light source according to any one of or a combination of at least two of the size, shape, and color of the multiple auxiliary light sources.

3. The human-computer interaction method according to claim 1, wherein the multiple auxiliary light sources are disposed on a component suitable for being worn on a human hand.

4. The human-computer interaction method according to claim 3, wherein the multiple auxiliary light sources are disposed on the component at multiple positions corresponding to fingers and/or a palm of a human hand.

5. The human-computer interaction method according to claim 4, wherein the step of acquiring a corresponding operation instruction according to a combined gesture formed by the acquired positions and/or motion tracks of the multiple auxiliary light sources in the captured area further includes:

acquiring the corresponding operation instruction according to the combined gesture formed by the positions and/or motion tracks of the auxiliary light sources corresponding to the fingers and/or palm.

6. The human-computer interaction method according to claim 1, wherein the captured area is divided into multiple subareas, and the step of acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera further includes:

acquiring a subarea in which the positions of the multiple auxiliary light sources are located.

7. The human-computer interaction method according to claim 1, wherein the captured area is divided into multiple subareas, and the step of acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera further includes:

acquiring a subarea passed by the motion tracks of the multiple auxiliary light sources and a moving direction thereof.

8. The human-computer interaction method according to claim 1, wherein the camera is an infrared camera, and the auxiliary light sources are infrared auxiliary light sources.

9. The human-computer interaction method according to claim 1, wherein the camera is a visible-light camera, and the auxiliary light sources are visible-light auxiliary light sources.

10. A human-computer interaction terminal having one or more processors, memory, and one or more program modules stored in the memory and to be executed by the one or more processors, the one or more program modules further comprising:

a light source capture module, configured to acquire positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera;

an operation instruction acquisition module, configured to acquire a corresponding operation instruction according to a combined gesture formed by the acquired positions and/or motion tracks of the multiple auxiliary light sources in the captured area; and

an instruction execution module, configured to execute the acquired operation instruction.

11. The human-computer interaction terminal according to claim 10, wherein the light source capture module distinguishes the position or motion track of each auxiliary light source according to any one of or a combination of more of the size, shape, and color of the multiple auxiliary light sources.

12. The human-computer interaction terminal according to claim 11, wherein the multiple auxiliary light sources are disposed at multiple positions corresponding to fingers and/or a palm of a human hand, on a component suitable for being worn on a human hand, and

the operation instruction acquisition module is specifically configured to:

acquire the corresponding operation instruction according to the combined gesture formed by the positions and/or motion tracks of the auxiliary light sources corresponding to the fingers and/or palm.

13. The human-computer interaction terminal according to claim 10, wherein the captured area is divided into multiple subareas, and the light source capture module further includes:

a positioning unit, configured to acquire a subarea in which the positions of the multiple auxiliary light sources are located.

14. The human-computer interaction terminal according to claim 10, wherein the captured area is divided into multiple subareas, and the light source capture module further includes:

a track acquisition unit, configured to acquire a subarea passed by the motion tracks of the multiple auxiliary light sources and a moving direction thereof.

15. The human-computer interaction terminal according to claim 10, wherein the camera is an infrared camera, and the auxiliary light sources are infrared auxiliary light sources.

16. The human-computer interaction terminal according to claim 10, wherein the camera is a visible-light camera, and the auxiliary light sources are visible-light auxiliary light sources.

17. A non-transitory computer readable medium storing one or more program modules, wherein the one or more program modules, when executed by a human-computer interaction terminal having one or more processors, cause the human-computer interaction terminal to perform the following steps:

acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera;

acquiring a corresponding operation instruction according to a combined gesture formed by the acquired positions and/or motion tracks of the multiple auxiliary light sources in the captured area; and

executing the acquired operation instruction.

18. The non-transitory computer readable medium according to claim 17, wherein the light source capture module distinguishes the position or motion track of each auxiliary light source according to any one of or a combination of more of the size, shape, and color of the multiple auxiliary light sources.

19. The non-transitory computer readable medium according to claim 17, wherein the captured area is divided into multiple subareas, and the step of acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera further includes:

acquiring a subarea in which the positions of the multiple auxiliary light sources are located.

20. The non-transitory computer readable medium according to claim 17, wherein the captured area is divided into multiple subareas, and the step of acquiring positions and/or motion tracks of multiple auxiliary light sources in a captured area by using a camera further includes:

acquiring a subarea passed by the motion tracks of the multiple auxiliary light sources and a moving direction thereof.