Control system for navigating a principal dimension of a data space

• US 10,061,392 B2
• Filed: 09/19/2016
• Issued: 08/28/2018
• Est. Priority Date: 02/08/2006
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: Underkoffler, John S., Kramer, Kwindla H.
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US15/268,766
• Publication Number:
  US 20170068324A1
• Time in Patent Office: 708 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/08 Cursor circuits

Abstract

Systems and methods are described for navigating through a data space. The navigating comprises detecting a gesture of a body from gesture data received via a detector. The gesture data is absolute three-space location data of an instantaneous state of the body at a point in time and physical space. The detecting comprises identifying the gesture using the gesture data. The navigating comprises translating the gesture to a gesture signal, and navigating through the data space in response to the gesture signal. The data space is a data-representational space comprising a dataset represented in the physical space.

Claims

1. A system comprising:

a detector constructed to receive absolute three-space location data of an object within a coordinate space of a room;

a gestural interface coupled to the detector, wherein the gestural interface is constructed to detect a gesture from the received absolute three-space location data and generate a gesture signal corresponding to the gesture; and

a graphics interface coupled to the gestural interface and coupled to a display, wherein the graphics interface is constructed to control rendering of data on the display according to the gesture signal,

wherein the detector is constructed to detect an evolving absolute three-space location of the object within the coordinate space of the room,

wherein the gestural interface is constructed to generate an updated gesture signal corresponding to the evolving absolute three-space location, and

wherein the graphics interface is constructed to update rendering of data on the display according to the updated gesture signal.

2. The system of claim 1, wherein the detecting includes detecting an evolving orientation of the object.

3. The system of claim 1, wherein the gesture is synchronized with the rendered data.

4. The system of claim 1, wherein the gestural interface is constructed to detect a first pose of the object and activate a pushback interaction in response to the detection of the first pose.

5. The system of claim 4, wherein the gestural interface is constructed to:

record a first location at which the first pose is entered, wherein the first location is an absolute three-space location of the object in the coordinate space of the room; and

set the first location as an origin, wherein subsequent detected object locations are reported as relative offsets to the origin.

6. The system of claim 5, wherein the detecting comprises detecting a forward movement of the object, wherein the forward movement is movement along a z-axis toward the display, wherein the z-axis is defined as an axis normal to a front region of the display.

7. The system of claim 6, wherein the detecting comprises detecting a rearward movement of the object, wherein the rearward movement is movement along the z-axis away from front region of the display.

8. A method comprising:

a detector of a gestural control system receiving absolute three-space location data of an object within a coordinate space of a room;

a gestural interface of the gestural control system detecting a gesture from the received absolute three-space location data and generating a gesture signal corresponding to the gesture; and

a graphics interface of the gestural control system controlling rendering of data on a display according to the gesture signal,

wherein receiving absolute three-space location data comprises;

detecting an evolving absolute three-space location of the object within the coordinate space of the room,

wherein generating a gesture signal comprises;

generating an updated gesture signal corresponding to the evolving absolute three-space location, and

wherein controlling rendering comprises;

updating rendering of data on the display according to the updated gesture signal.

9. The method of claim 8, wherein the detecting includes detecting an evolving orientation of the object.

10. The method of claim 8, wherein the gesture is synchronized with the rendered data.

11. The method of claim 8, wherein the gestural interface detects a first pose of the object and activates a pushback interaction in response to the detection of the first pose.

12. The method of claim 11,

wherein the gestural interface records a first location at which the first pose is entered,

wherein the first location is an absolute three-space location of the object in the coordinate space of the room,

wherein the gestural interface sets the first location as an origin, and

wherein subsequent detected object location are reported as relative offsets to the origin.

13. The method of claim 12, wherein the detecting comprises detecting a forward movement of the object, wherein the forward movement is movement along a z-axis toward the display, wherein the z-axis is defined as an axis normal to a front region of the display.

14. The method of claim 13, wherein the detecting comprises detecting a rearward movement of the object, wherein the rearward movement is movement along the z-axis away from front region of the display.