×

Dynamic user interactions for display control

  • US 9,766,709 B2
  • Filed: 03/14/2014
  • Issued: 09/19/2017
  • Est. Priority Date: 03/15/2013
  • Status: Active Grant
First Claim
Patent Images

1. A method performed by a gesture recognition and control system for using gestures to supplant or augment use of a standard input device coupled to an electronic device, the method including:

  • capturing, in a three-dimensional (3D) sensor space, an image including the standard input device and a body part of a user;

    identifying the standard input device and the body part of the user included in the captured image;

    matching the standard input device in the captured image to an entry of an object template or image in a database, wherein the database maps standard input devices to object templates or images, and wherein each standard input device respectively generates one or more standard signals in response to performing one or more specific control manipulations with each respective standard input device;

    detecting that the captured image includes a depiction of a coupling between the matched standard input device and the electronic device;

    receiving, after the steps of identifying the body part of the user and detecting that the captured image depicts the matched standard input device coupled to the electronic device, an input from the user indicating the user prefers to control the electronic device with 3D gestures over controlling the electronic device by performing control manipulations directly from the standard input device;

    identifying a library of analogous 3D gestures that are analogous to the control manipulations performed using the matched standard input device;

    detecting a gesture in the 3D sensor space;

    identifying the gesture from the library of analogous 3D gestures;

    identifying a signal corresponding to the identified gesture in the library of analogous 3D gestures, the identified signal mimicking the standard signal for performing the specific control manipulation from the matched standard input device; and

    providing the identified signal, which mimics the standard signal, to the electronic device instructing the electronic device to perform the specific control manipulation.

View all claims
  • 11 Assignments
Timeline View
Assignment View
    ×
    ×