Environment-dependent dynamic range control for gesture recognition

• US 9,851,804 B2
• Filed: 06/05/2014
• Issued: 12/26/2017
• Est. Priority Date: 12/29/2010
• Status: Expired due to Fees

• Current Assignee: Vibrant Licensing LLC (IP Edge LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Kim, Seungil
• Primary Examiner(s): Earles, Bryan
• Application Number:
  US14/297,584
• Publication Number:
  US 20140285458A1
• Time in Patent Office: 1,300 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Technologies are generally described for environment-dependent dynamic range control for gesture recognition. In some examples, user environment including, but not limited to, location, device size, virtual or physical display size, is detected and gesture control range adjusted according to the detected environment. In other examples, a controller user interface or dynamic range status indicator may be adjusted based on the modified gesture recognition range control.

Claims

1. A method to adjust a gesture input dynamic range of a gesture recognition in an apparatus, the method comprising:

detecting an environment of the apparatus;

identifying, based on at least a detected number of people in a background of a user and a noise level, the environment as one of a private environment and a public environment;

adjusting, based on the environment of the apparatus, the gesture input dynamic range for the apparatus;

displaying a recognition control user interface (UI) of the apparatus;

adjusting the recognition control UI of the apparatus by modifying one or more control elements of the recognition control UI of the apparatus, wherein adjusting the recognition control UI is based on one or more of;

the environment, a size of the apparatus, and a type of the apparatus, wherein modifying the one or more control elements of the recognition control UI of the apparatus includes modifying a position of the one or more control elements, wherein the one or more control elements indicates the gesture input dynamic range, and wherein modifying the position of the one or more control elements comprises;

positioning the one or more control elements wider apart from each other, in response to the user being in the private environment or the size of the apparatus being large, and

positioning the one or more control elements closer to each other, in response to the user being in the public environment or the size of the apparatus being small;

determining whether the recognition control UI is displayed on a display screen of the apparatus;

in response to a determination that the recognition control UI is absent on the display screen of the apparatus, displaying one or more display elements to indicate the adjusted gesture input dynamic range; and

capturing an input through a gesture input.

2. The method of claim 1, wherein adjusting the gesture input dynamic range includes:

in response to the identification of the environment as the public environment, adjusting the gesture input dynamic range for a smaller gesture; and

in response to the identification of the environment as the private environment, adjusting the gesture input dynamic range for a larger gesture.

3. The method of claim 1, wherein adjusting the gesture input dynamic range includes adjusting the gesture input dynamic range for one of a finger gesture and a hand gesture.

4. The method of claim 1, wherein adjusting the gesture input dynamic range includes adjusting the gesture input dynamic range for one of a smaller hand gesture and a larger hand gesture.

5. The method of claim 1, wherein detecting the environment of the apparatus includes detecting the environment based on one or more of an image recognition and a distance between the apparatus and the user.

6. The method of claim 1, further comprising:

in response to a change in the environment, modifying a configuration of the apparatus to determine the gesture input dynamic range in the changed environment.

7. The method of claim 1, wherein modifying the one or more control elements of the recognition control UI of the apparatus further includes modifying one or more of:

a textual scheme of the one or more control elements, a graphical scheme of the one or more control elements, a color of the one or more control elements, a shading of the one or more control elements, and a size of the one or more control elements.

8. The method of claim 1, wherein adjusting the gesture input dynamic range includes:

in response to an identification of the environment as the private environment, adjusting the gesture input dynamic range for a hand gesture; and

in response to another identification of the environment as the public environment, adjusting the gesture input dynamic range for a finger gesture.

9. An apparatus to adjust a gesture input dynamic range of a gesture recognition, the apparatus comprising:

a display device that includes a touch screen and that is configured to detect a touch input;

an image capture device coupled to the display device; and

a processor coupled to the display device and the image capture device, the processor configured to perform or control performance of operations to;

detect an environment of the apparatus while in operation;

identify, based on at least a detected number of people in a background of a user and a noise level, the environment as one of a private environment and a public environment;

adjust, based on the environment, the gesture input dynamic range for the apparatus;

display a recognition control user interface (UI) of the apparatus;

adjust the recognition control UI of the apparatus by modification of a position of one or more control elements of the recognition control UI, wherein the adjustment of the recognition control UI is based on one or more of;

the environment, a size of the apparatus, and a type of the apparatus, wherein the one or more control elements indicate the gesture input dynamic range, and wherein the modification of the position of the one or more control elements comprises;

position the one or more control elements wider apart from each other, in response to the user being in the private environment or the size of the apparatus being large, and

position the one or more control elements closer to each other, in response to the user being in the public environment or the size of the apparatus being small;

determine whether the recognition control UI is displayed on the touch screen of the apparatus;

in response to a determination that the recognition control UI being absent on the touch screen of the apparatus, instruct the display device that includes the touch screen to display one or more display elements to indicate the adjusted gesture input dynamic range; and

capture an input through a gesture input.

10. The apparatus of claim 9, wherein the processor is further configured to:

provide feedback through the display device to indicate the adjusted gesture input dynamic range.

11. The apparatus of claim 9, wherein the apparatus further comprises a communication module and an audio input module, and wherein the processor is configured to detect the environment of the apparatus based on one or more of:

a captured audio signal, a captured image, and a location information obtained from one of;

a global positioning service (GPS) signal, a wireless network signal, and a cellular communication signal.

12. The apparatus of claim 9, wherein to adjust the gesture input dynamic range, the processor is configured to:

in response to the identification of the environment as the public environment, adjust the gesture input dynamic range for a smaller gesture; and

in response to the identification of the environment as the private environment, adjust the gesture input dynamic range for a larger gesture.

13. The apparatus of claim 9, wherein the apparatus comprises one of:

a desktop computer, a laptop computer, a handheld computer, a vehicle-mount computer, a smart phone, a television monitor, a projection device, and the display device coupled to a computing device.

14. An input recognition module coupled to a display device and configured to adjust a gesture input dynamic range of a gesture recognition, the input recognition module comprising:

a memory configured to store instructions; and

a processor coupled to the memory, wherein the processor is configured to execute the instructions, which, in response to execution by the processor, cause the processor to perform or control performance of operations to;

detect an environment of the display device while in operation;

identify, based on at least a detected number of people in a background of a user and a noise level, the environment as one of a private environment and a public environment;

adjust, based on the environment, the gesture input dynamic range of the display device;

display a recognition control user interface (UI);

adjust the recognition control UI of the display device by modification of a position of one or more control elements of the recognition control UI, wherein the adjustment of the recognition control UI is based on one or more of;

the environment, a size of the display device, and a type of the display device, wherein the one or more control elements indicate the gesture input dynamic range, and wherein the modification of the position of the one or more control elements comprises;

position the one or more control elements wider apart from each other, in response to the user being in the private environment or the size of the display device being large, and

position the one or more control elements closer to each other, in response to the user being in the public environment or the size of the display device being small;

determine whether the recognition control UI is displayed on the display device;

in response to a determination that the recognition control UI is absent on the display device, display one or more display elements to indicate the adjusted gesture input dynamic range; and

capture an input through a gesture input.

15. The input recognition module of claim 14, wherein the processor is further configured to:

detect a switch to a new display device by the user.

16. The input recognition module of claim 15, wherein the processor is further configured to:

increase, based on the gesture input dynamic range, a size of the one or more control elements of the recognition control UI.

17. The input recognition module of claim 15, wherein the processor is further configured to:

decrease, based on the gesture input dynamic range, a size of the one or more control elements of the recognition control UI.