Visual collaboration interface

• US 10,627,915 B2
• Filed: 05/21/2019
• Issued: 04/21/2020
• Est. Priority Date: 03/17/2014
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: Minnen, David, Yarin, Paul
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US16/418,637
• Publication Number:
  US 20190272043A1
• Time in Patent Office: 336 Days
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/34 for rolling or scrolling

Abstract

Embodiments described herein includes a system comprising a processor coupled to display devices, sensors, remote client devices, and computer applications. The computer applications orchestrate content of the remote client devices simultaneously across the display devices and the remote client devices, and allow simultaneous control of the display devices. The simultaneous control includes automatically detecting a gesture of at least one object from gesture data received via the sensors. The detecting comprises identifying the gesture using only the gesture data. The computer applications translate the gesture to a gesture signal, and control the display devices in response to the gesture signal.

Claims

1. A method comprising:

with a wand input device that includes a camera, a gyroscope, a processor, and a storage device, downloading a pointer application;

with the processor, executing the pointer application;

with the pointer application, establishing a wireless communication session with a gestural system external to the wand input device;

with the pointer application, generating inertial data by using the gyroscope;

with the pointer application, sending at least the inertial data to the gestural system via the wireless communication session;

with the gestural system, receiving gesture data and the inertial data of the wand input device;

with the gestural system, generating a plurality of gesture signals for the wand input device by using the gesture data and the inertial data; and

with the gestural system, controlling at least one display device coupled to the gestural system, in response to at least one generated gesture signal generated by the gestural system.

2. The method of claim 1, wherein the gesture data is generated by using an image sensor.

3. The system of claim 1, wherein the wand input device is a mobile phone.

4. A system comprising:

a gestural system coupled to a display device; and

a wand input device comprising;

a housing that comprises;

a camera,

a gyroscope,

a processor, and

a storage device that stores a pointer application,

wherein the pointer application is constructed to control the wand input device to;

establish a wireless communication session with the gestural system,

generate inertial data by using the gyroscope, and send at least the generated inertial data to the gestural system via the wireless communication session,

wherein the gestural system is constructed to;

receive the inertial data and gesture data of the wand input device,

generate a plurality of gesture signals for the wand input device by using the inertial data and the gesture data, and

control the display device in response to at least one generated gesture signal.

5. The system of claim 4, wherein controlling the display device comprises:

moving a pointer displayed by the display device based on movement of the wand input device.

6. The system of claim 4, wherein the wand input device is a mobile phone.