Human-to-Computer Natural Three-Dimensional Hand Gesture Based Navigation Method
First Claim
1. A method for providing natural human-to-computer interactions using a three-dimensional hand gesture based recognition system, the method comprising the steps of:
- a) determining at least two points of interest in a hand of a user;
b) recognising natural gestures performed by said at least two points of interest comprising;
b1) recognising a first natural gesture corresponding to a three-dimensional hand pose to trigger the beginning of a human-to-computer interaction by determining when two points of interest in three-dimensional space move close to one another to a distance between the two points of interest below a predetermined threshold value;
b2) recognising a second natural gesture from movements of the three-dimensional hand pose to control a continuous human-to-computer interaction by determining movement of at least one point of interest in the three-dimensional space, wherein the human-to-computer interaction is controlled as long as said first three-dimensional hand pose lasts; and
b3) recognising a third natural gesture to trigger termination of the human-to-computer interaction by determining when the two points of interest move away from one another to a distance between the two points of interest which is higher than a second predetermined threshold value; and
c) interacting with a graphical user interface using a sequence of said first, second and third natural gestures performed by said points of interest.
2 Assignments
0 Petitions
Accused Products
Abstract
Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions. From depth images provided by a range finding imaging system, the method enables efficient and robust detection of a particular sequence of natural gestures including a beginning (start), and an ending (stop) of a predetermined type of natural gestures for delimiting the period during which a control (interaction) gesture is operating in an environment wherein a user is freely moving his hands. The invention is more particularly, although not exclusively, concerned by detection without any false positives nor delay, of intentionally performed natural gesture subsequent to a starting finger tip or hand tip based natural gesture so as to provide efficient and robust navigation, zooming and scrolling interactions within a graphical user interface up until the ending finger tip or hand tip based natural gesture is detected.
-
Citations
20 Claims
-
1. A method for providing natural human-to-computer interactions using a three-dimensional hand gesture based recognition system, the method comprising the steps of:
-
a) determining at least two points of interest in a hand of a user; b) recognising natural gestures performed by said at least two points of interest comprising; b1) recognising a first natural gesture corresponding to a three-dimensional hand pose to trigger the beginning of a human-to-computer interaction by determining when two points of interest in three-dimensional space move close to one another to a distance between the two points of interest below a predetermined threshold value; b2) recognising a second natural gesture from movements of the three-dimensional hand pose to control a continuous human-to-computer interaction by determining movement of at least one point of interest in the three-dimensional space, wherein the human-to-computer interaction is controlled as long as said first three-dimensional hand pose lasts; and b3) recognising a third natural gesture to trigger termination of the human-to-computer interaction by determining when the two points of interest move away from one another to a distance between the two points of interest which is higher than a second predetermined threshold value; and c) interacting with a graphical user interface using a sequence of said first, second and third natural gestures performed by said points of interest. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification
-
- Resources
-
Current AssigneeSony Depthsensing Solutions SA/NV (Sony Group Corp.)
-
Original AssigneeSoftKinetic Software
-
InventorsDal Zot, David, Rennuit, Antoine, Simons, Kevin
-
Granted Patent
-
Time in Patent OfficeDays
-
Field of Search
-
US Class Current1/1
-
CPC Class CodesG06F 3/011 Arrangements for interactio...G06F 3/017 Gesture based interaction, ...G06F 3/0304 Detection arrangements usin...G06F 3/0485 Scrolling or panningG06V 40/28 Recognition of hand or arm ...
