Remote devices used in a markerless installation of a spatial operating environment incorporating gestural control

• US 9,317,128 B2
• Filed: 03/17/2014
• Issued: 04/19/2016
• Est. Priority Date: 04/02/2009
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: Yarin, Paul, Minnen, David
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US14/216,500
• Publication Number:
  US 20150054729A1
• Time in Patent Office: 764 Days
• Field of Search: 345156-178
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Embodiments described herein includes a system comprising a processor coupled to display devices, sensors, remote client devices, and computer applications. The computer applications orchestrate content of the remote client devices simultaneously across the display devices and the remote client devices, and allow simultaneous control of the display devices. The simultaneous control includes automatically detecting a gesture of at least one object from gesture data received via the sensors. The detecting comprises identifying the gesture using only the gesture data. The computer applications translate the gesture to a gesture signal, and control the display devices in response to the gesture signal.

Claims

1. A system comprising:

a processor coupled to a plurality of display devices;

a gesture interface coupled to the processor, wherein the gesture interface is configured to detect a first gesture of at least one object from gesture data received at the processor, identify the first gesture from a first set of gestures, and translate the first gesture to a gesture signal;

an edge device coupled to the processor via a native application hosted on the edge device, wherein the processor is configured to detect a second gesture of the edge device using data of the edge device, identify the second gesture from a second set of gestures, and translate the second gesture to the gesture signal, wherein the edge device includes a mobile communication device;

applications running on the processor, wherein the applications are configured to control content simultaneously across the plurality of display devices in response to the gesture signal.

2. A system comprising:

a processor coupled to a plurality of display devices and a plurality of sensors;

remote client devices coupled to the processor; and

applications coupled to the processor, wherein the applications are configured to orchestrate simultaneous rendering of content from the remote client devices across the plurality of display devices and the remote client devices, and are configured to allow simultaneous control of the plurality of display devices from the remote client devices, wherein the simultaneous control comprises automatically detecting a gesture of at least one object from gesture data received via the plurality of sensors and from an application running on at least one of the remote client devices, and controlling at least one of the plurality of display devices and content of the remote client devices in response to the gesture signal.