SPATIAL OPERATING ENVIRONMENT (SOE) WITH MARKERLESS GESTURAL CONTROL

• US 20140035805A1
• Filed: 06/04/2013
• Published: 02/06/2014
• Est. Priority Date: 04/02/2009
• Status: Abandoned Application

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Alessandro Valli, Paul Yarin, Peter Hawkes
• Inventors: MINNEN, David, YARIN, Paul, BROWNING, Alan, HAWKES, Peter, RICK, Tobias, VALDES, Miguel Sanchez, VALLI, Alessandro, CHAK, Dan
• Application Number:
  US13/909,980
• Publication Number:
  US 20140035805A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A Spatial Operating Environment (SOE) with markerless gestural control includes a sensor coupled to a processor that runs numerous applications. A gestural interface application executes on the processor. The gestural interface application receives data from the sensor that corresponds to a hand of a user detected by the sensor, and tracks the hand by generating images from the data and associating blobs in the images with tracks of the hand. The gestural interface application detects a pose of the hand by classifying each blob as corresponding to an object shape. The gestural interface application generates a gesture signal in response to a gesture comprising the pose and the tracks, and controls the applications with the gesture signal.

Claims

1. A system comprising:

a sensor coupled to a processor;

a plurality of applications coupled to the processor; and

a gestural interface application running on the processor, the gestural interface application receiving data from the sensor that corresponds to a hand of a user detected by the sensor, tracking the hand by generating images from the data and associating blobs in the images with tracks of the hand, detecting a pose of the hand by classifying each blob as corresponding to an object shape, generating a gesture signal in response to a gesture comprising the pose and the tracks, and controlling the plurality of applications with the gesture signal.