OPERATING ENVIRONMENT WITH GESTURAL CONTROL AND MULTIPLE CLIENT DEVICES, DISPLAYS, AND USERS

• US 20150077326A1
• Filed: 12/31/2013
• Published: 03/19/2015
• Est. Priority Date: 04/02/2009
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: KRAMER, Kwindla Hultman, UNDERKOFFLER, John, SPARRELL, Carlton, SINGH, Navjot, HOLLENBACH, Kate, YARIN, Paul
• Granted Patent: US 9,740,293 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Embodiments described herein includes a system comprising a processor coupled to display devices, sensors, remote client devices, and computer applications. The computer applications orchestrate content of the remote client devices simultaneously across the display devices and the remote client devices, and allow simultaneous control of the display devices. The simultaneous control includes automatically detecting a gesture of at least one object from gesture data received via the sensors. The detecting comprises identifying the gesture using only the gesture data. The computer applications translate the gesture to a gesture signal, and control the display devices in response to the gesture signal.

Claims

1. A system comprising:

a processor coupled to a plurality of display devices;

a plurality of remote client devices coupled to the processor; and

a plurality of applications coupled to the processor, wherein the plurality of applications orchestrate content of the plurality of remote client devices simultaneously across at least one of the plurality of display devices and the plurality of remote client devices, and allow simultaneous control of the plurality of display devices, wherein the simultaneous control comprises automatically detecting a gesture of at least one object from gesture data received at the processor, the detecting comprising identifying the gesture and translating the gesture to a gesture signal, and controlling the plurality of display devices in response to the gesture signal.

2. A system comprising:

a processor coupled to a plurality of display devices and a plurality of sensors;

a plurality of remote client devices coupled to the processor; and

a plurality of applications coupled to the processor, wherein the plurality of applications orchestrate content of the plurality of remote client devices simultaneously across at least one of the plurality of display devices and the plurality of remote client devices, and allow simultaneous control of the plurality of display devices, wherein the simultaneous control comprises automatically detecting a gesture of at least one object from gesture data received via the plurality of sensors, the detecting comprising identifying the gesture using only the gesture data, translating the gesture to a gesture signal, and controlling the plurality of display devices in response to the gesture signal.