Visual collaboration interface

• US 10,338,693 B2
• Filed: 04/10/2018
• Issued: 07/02/2019
• Est. Priority Date: 03/17/2014
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: Minnen, David, Yarin, Paul
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US15/949,961
• Publication Number:
  US 20180299966A1
• Time in Patent Office: 448 Days
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/34 for rolling or scrolling

Abstract

Embodiments described herein includes a system comprising a processor coupled to display devices, sensors, remote client devices, and computer applications. The computer applications orchestrate content of the remote client devices simultaneously across the display devices and the remote client devices, and allow simultaneous control of the display devices. The simultaneous control includes automatically detecting a gesture of at least one object from gesture data received via the sensors. The detecting comprises identifying the gesture using only the gesture data. The computer applications translate the gesture to a gesture signal, and control the display devices in response to the gesture signal.

Claims

1. A method comprising:

generating gesture data of a first edge device by using a sensor;

a hardware gestural application server system receiving the generated gesture data;

the first edge device providing inertial data of the first edge device to the hardware gestural application server system;

the hardware gestural application server system generating a first gesture signal by using the gesture data and the inertial data; and

the hardware gestural application server system controlling a plurality of display devices in response to the first gesture signal.

2. The method of claim 1, wherein the sensor is a camera.

3. The method of claim 1, wherein the first edge device is a wand input device.

4. The method of claim 3, wherein the sensor is a camera.

5. The method of claim 1, wherein the first edge device is a mobile communication device.

6. The method of claim 5, wherein the sensor is a camera.

7. The method of claim 1, wherein the first edge device includes a gyroscope.

8. The method of claim 7, wherein the first edge device generates the inertial data by using the gyroscope.

9. The method of claim 5, wherein the first edge device is communicatively coupled to the hardware gestural application server system via a native application of the first edge device.

10. The method of claim 1,

wherein the hardware gestural application server system includes a gesture interface and at least one processor, and

wherein the at least one processor is communicatively coupled to the gesture interface, the first edge device, and the plurality of display devices.

11. The method of claim 10, wherein the at least one processor is communicatively coupled to the first edge device via a native application of the first edge device.

12. The method of claim 11, wherein at least one application runs on the processor.

13. The method of claim 1, wherein the hardware gestural application server system controls content simultaneously across the plurality of display devices in response to the first gesture signal by using at least one application of the hardware gestural application server system.

14. The method of claim 1, wherein the hardware gestural application server system uses a gesture interface of the hardware gestural application server system to generate the first gesture signal.

15. A system comprising:

a hardware gestural application server system; and

a first edge device,

wherein the first edge device is constructed to provide inertial data of the first edge device to the hardware gestural application server system, and

wherein the hardware gestural application server system is constructed to;

receive gesture data generated by a sensor for the first edge device,

generate a first gesture signal by using the gesture data and the inertial data, and

control a plurality of display devices in response to the first gesture signal.

16. The system of claim 15, further comprising the plurality of display devices.

17. The system of claim 15, wherein the hardware gestural application server system is constructed to control content simultaneously across the plurality of display devices in response to the first gesture signal by using at least one application of the hardware gestural application server system.

18. The system of claim 15, wherein the sensor is a camera.

19. The system of claim 15, wherein the first edge device is a wand input device.

20. The system of claim 15, wherein the first edge device is a mobile communication device.