Method for selecting interactivity mode

• US 10,331,307 B2
• Filed: 09/19/2013
• Issued: 06/25/2019
• Est. Priority Date: 09/19/2012
• Status: Active Grant

• Current Assignee: Institut National des Sciences Appliquées
• Original Assignee: Institut National des Sciences Appliquées
• Inventors: Anquetil, Eric, Almaksour, Abdullah, Richard, Gregoire
• Primary Examiner(s): Weng, Pei Yong
• Application Number:
  US14/429,649
• Publication Number:
  US 20150227275A1
• Time in Patent Office: 2,105 Days
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method is provided for selecting, from at least two available modes, a mode of interaction between a user and a digital playback device. The digital playback device is capable of obtaining at least one item of information representative of a gesture performed by a user, the gesture being performed with the aid of at least one limb or of at least one part of a limb by the user. The method includes: obtaining a number of limbs or of parts of limbs used to perform the gesture; and when the number exceeds a first predetermined value, selecting a first mode of interaction from among the at least two available modes; and when the number is less than or equal to a second predetermined value, selecting a second mode of interaction from among the at least two available modes.

Claims

1. A method comprising:

selecting a mode of interaction between a user and a digital rendering device from among at least two available modes, wherein selecting comprises the following acts performed by the digital rendering device;

obtaining, by a gesture capturing interface of said digital rendering device, at least one piece of information representing a gesture performed by the user, said gesture being performed by said user by using at least one limb or at least one part of a limb;

counting from the obtained information a number of limbs or parts of limbs used to carry out said gesture;

selecting a mode of interaction of the digital rendering device from among said at least two available modes as a function of the number, wherein selecting comprises;

when said number exceeds a first predetermined value, selecting a first mode of interaction from among said at least two available modes, called an indirect handing mode in which the digital rendering device interprets the gesture performed as a command;

when said number is smaller than or equal to a second predetermined value, selecting a second mode of interaction from among said at least two available modes, called a direct handling mode in which the digital rendering device interprets the gesture performed by the user as an interaction with elements displayed by the digital rendering device; and

operating the digital rendering device in the selected first or second mode in response to the gesture, said operating comprising, in said indirect handing mode, the following acts;

recognizing a shape drawn by said limbs or parts of limbs used to carry out said gesture;

displaying a piece of data representing the recognized shape in an area at an end of the shape drawn by the user, called a piece of visual feedback data, said visual feedback data comprising at least a text caption;

initializing a validation time counter for a predetermined period of time;

validating the recognized shape when no action takes place during the period of time defined by said counter, said validating comprising performing a command associated with said recognized shape;

when an action takes place during the period of time defined by said counter, initiating a corrective mechanism comprising;

initializing the corrective mechanism;

displaying a list of possible gestures;

selecting, by the user, a gesture in the list of gestures;

displaying actions to be performed by the recognition engine;

selecting, by the user, said action to perform among said displayed actions to be performed by the recognition engine;

performing said selected action to perform by the recognition engine.

2. The method for selecting according to claim 1, wherein said rendering device comprises a tactile surface and said at least one limb is a hand and said at least one part of a limb is a finger.

3. The method for selecting according to claim 1, wherein said rendering device comprises a stereoscopic camera and said at least one limb is an arm and said at least one part of a limb is a hand.

4. The method for selecting according to claim 1, wherein said first predetermined value is equal to said second predetermined value and said first predetermined value is equal to one.

7. The method for selecting according to claim 1, wherein the text caption is associated with the recognized shape.

5. A non-transitory computer-readable support comprising a computer program product stored thereon, which comprises program code instructions for executing a method of selecting a mode of interaction between a user and a digital rendering device from among at least two available modes, when the instructions are executed by a processor of the digital rendering device, said method comprising:

selecting the mode of interaction between the user and the digital rendering device from among at least two available modes, wherein selecting comprises the following acts performed by the digital rendering device;

obtaining, by a gesture capturing interface of said digital rendering device, at least one piece of information representing a gesture performed by the user, said gesture being performed by said user by using at least one limb or at least one part of a limb;

counting from the obtained information a number of limbs or parts of limbs used to carry out said gesture;

selecting a mode of interaction of the digital rendering device from among said at least two available modes as a function of the number, wherein selecting comprises;

when said number exceeds a first predetermined value, selecting a first mode of interaction from among said at least two available modes, called an indirect handing mode in which the digital rendering device interprets the gesture performed by the user as a command;

when said number is smaller than or equal to a second predetermined value, selecting a second mode of interaction from among said at least two available modes, called a direct handling mode in which the digital rendering device interprets the gesture performed by the user as an interaction with elements displayed by the digital rendering device; and

operating the digital rendering device in the selected mode in response to the gesture, said operating comprising, in said indirect handing mode, the following acts;

recognizing a shape drawn by said limbs or parts of limbs used to carry out said gesture;

displaying of a piece of data representing the recognized shape in an area at an end of the shape drawn by the user, called a piece of visual feedback data, said visual feedback data comprising at least a text caption;

initializing of a validation time counter for a predetermined period of time;

validating the recognized shape when no action takes place during the period of time defined by said counter, said validating comprising performing a command associated with said recognized shape;

when an action takes place during the period of time defined by said counter, initiating a corrective mechanism comprising;

initializing the corrective mechanism;

displaying a list of possible gestures;

selecting, by the user, a gesture in the list of gestures;

displaying actions to be performed by the recognition engine;

selecting, by the user, said action to perform among said displayed actions to be performed by the recognition engine;

performing said selected action to perform by the recognition engine.

6. The non-transitory computer-readable support according to claim 5, wherein the text caption is associated with the recognized shape.