Multi-process interactive systems and methods

• US 10,223,418 B2
• Filed: 01/19/2018
• Issued: 03/05/2019
• Est. Priority Date: 10/14/2009
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: Kramer, Kwindla Hultman, Underkoffler, John S.
• Primary Examiner(s): Ibrahim, Mohamed
• Application Number:
  US15/875,661
• Publication Number:
  US 20180144030A1
• Time in Patent Office: 410 Days
• Field of Search: None
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/52 Program synchronisation; Mutual exclusion, e.g. by means of semaphores
• CPC Class Codes: G06V 40/113 Recognition of static hand signs

Abstract

A multi-process interactive system is described. The system includes numerous processes running on a processing device. The processes include separable program execution contexts of application programs, such that each application program comprises at least one process. The system translates events of each process into data capsules. A data capsule includes an application-independent representation of event data of an event and state information of the process originating the content of the data capsule. The system transfers the data messages into pools or repositories. Each process operates as a recognizing process, where the recognizing process recognizes in the pools data capsules comprising content that corresponds to an interactive function of the recognizing process and/or an identification of the recognizing process. The recognizing process retrieves recognized data capsules from the pools and executes processing appropriate to contents of the recognized data capsules.

Claims

1. A method comprising:

a first processing device;

translating at least a first event of a first process into a first state data capsule that includes process state of at least one process of the first processing device and transferring the first state data capsule into a first coordination repository, and

controlling a first plurality of display devices communicatively coupled to the first processing device to display frame outputs of a first rendering process of the first processing device; and

a second processing device;

translating at least a second event of a second process into a second state data capsule that includes process state of at least one process of the second processing device and transferring the second state data capsule into the first coordination repository,

recognizing the first state data capsule in the first coordination repository,

retrieving the first state data capsule from the first coordination repository,

controlling at least one display device communicatively coupled to the second processing device to display frame outputs of a second rendering process of the second processing device based on contents of the first state data capsule,

wherein the first rendering process and the second rendering process are processes of a first application,

wherein the first processing device and the second processing device control different display devices.

2. The method of claim 1, wherein the first plurality of display devices controlled by the first processing device display an image that is different from an image displayed by the least one display device controlled by the second processing device.

3. The method of claim 2, wherein the second processing device controls a second plurality of display devices to display frame outputs of a second rendering process of the second processing device based on contents of the first state data capsule.

4. The method of claim 3, further comprising:

a third processing device;

translating at least a third event of a third process into a third state data capsule that includes process state of at least one process of the third processing device and transferring the third state data capsule into the first coordination repository,

recognizing the first state data capsule in the first coordination repository,

retrieving the first state data capsule from the first coordination repository,

controlling at least one display device communicatively coupled to the third processing device to display frame outputs of a third rendering process of the third processing device based on contents of the first state data capsule,

wherein the first rendering process, the second rendering process, and the third rendering process are processes of the first application, and

wherein the first processing device, the second processing device, and the third processing device control different display devices.

5. The method of claim 4, wherein the first plurality of display devices and the second plurality of display devices collectively display a same image as the at least one display device controlled by the third processing device.

6. The method of claim 5, further comprising:

a fourth processing device;

translating at least a fourth event of a fourth process into a fourth state data capsule that includes process state of at least one process of the fourth processing device and transferring the fourth state data capsule into the first coordination repository,

recognizing the first state data capsule in the first coordination repository,

retrieving the first state data capsule from the first coordination repository,

controlling at least one display device communicatively coupled to the fourth processing device to display frame outputs of a fourth rendering process of the fourth processing device based on contents of the first state data capsule,

wherein the first rendering process, the second rendering process, the third rendering process, and the fourth rendering process are processes of the first application, and

wherein the first processing device, the second processing device, the third processing device, and the fourth processing device control different display devices.

7. The method of claim 6, wherein the first plurality of display devices and the second plurality of display devices collectively display a first image, and wherein the at least one display device controlled by the third processing device and the at least one display device controlled by the fourth processing device collectively display the first image.

8. The method of claim 1, further comprising:

the second processing device recognizing a first user input data capsule in a first user input repository;

the second processing device retrieving the first user input data capsule from the first user input repository; and

the second processing device performing rendering based on contents of the first user input data capsule.

9. The method of claim 8, further comprising, a gestural process generating the first user input data capsule and transferring the first user input data capsule into the first user input repository, wherein generating the first user input data capsule comprises:

the gestural process translating at least a first event of the gestural process into the first user input data capsule,

wherein the first user input data capsule includes user input information of the gestural process.

10. The method of claim 9, wherein one of the first processing device, the second processing device, and a third processing device executes the gestural process.

11. The method of claim 8, further comprising, the first processing device generating the first user input data capsule and transferring the first user input data capsule into the first user input repository, wherein generating the first user input data capsule comprises:

the first processing device translating at least a first event of a first user input process of the first processing device into the first user input data capsule,

wherein the first user input data capsule includes user input information of the first user input process.

12. The method of claim 1, wherein the second processing device controls at a second plurality of display devices to display frame outputs of a second rendering process of the second processing device based on contents of the first state data capsule.

13. The method of claim 1, wherein the first plurality of display devices controlled by the first processing device display a same image as the at least one display device controlled by the second processing device.