Operating environment with gestural control and multiple client devices, displays, and users

• US 9,684,380 B2
• Filed: 11/12/2013
• Issued: 06/20/2017
• Est. Priority Date: 04/02/2009
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: Underkoffler, John, Kramer, Kwindla Hultman
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US14/078,259
• Publication Number:
  US 20140325373A1
• Time in Patent Office: 1,316 Days
• Field of Search: 345156-178
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications

Abstract

Embodiments described herein includes a system comprising a processor coupled to display devices, sensors, remote client devices, and computer applications. The computer applications orchestrate content of the remote client devices simultaneously across the display devices and the remote client devices, and allow simultaneous control of the display devices. The simultaneous control includes automatically detecting a gesture of at least one object from gesture data received via the sensors. The detecting comprises identifying the gesture using only the gesture data. The computer applications translate the gesture to a gesture signal, and control the display devices in response to the gesture signal.

Claims

1. A system comprising:

a processor coupled to a plurality of display devices and a plurality of sensors;

a plurality of remote client devices coupled to the processor, wherein each remote client device of the plurality of remote client devices includes an element of a session workflow; and

a plurality of applications coupled to the processor, wherein the processor is configured to integrate pixels of the element of each of the plurality of remote client devices into a session workflow rendered on the plurality of display devices, wherein the processor is configured as a collaborative interface of the plurality of remote client devices, wherein any remote client device of the plurality of remote client devices can interact directly with applications running on any other remote client device of the plurality of remote client devices to control the element of each of the plurality of remote client devices.