Proteins, pools, and slawx in processing environments

• US 10,664,327 B2
• Filed: 09/14/2017
• Issued: 05/26/2020
• Est. Priority Date: 04/24/2007
• Status: Active Grant

• Current Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Original Assignee: Oblong Industries, Inc. (Oblong, Inc.)
• Inventors: Kramer, Kwindla Hultman, Underkoffler, John S.
• Primary Examiner(s): Anya, Charles E
• Application Number:
  US15/705,077
• Publication Number:
  US 20180004583A1
• Time in Patent Office: 985 Days
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes

Abstract

Embodiments described herein include mechanisms for encapsulating data that needs to be shared between or across processes. These mechanisms include slawx (plural of “slaw”), proteins, and pools. Generally, slawx provide the lowest-level of data definition for inter-process exchange, proteins provide mid-level structure and hooks for querying and filtering, and pools provide for high-level organization and access semantics. Slawx includes a mechanism for efficient, platform-independent data representation and access. Proteins provide a data encapsulation and transport scheme using slawx as the payload. Pools provide structured and flexible aggregation, ordering, filtering, and distribution of proteins within a process, among local processes, across a network between remote or distributed processes, and via longer term (e.g. on-disk, etc.) storage.

Claims

1. A method comprising:

a first device running a first application;

a second device running a second application;

the first application generating first raw input data in response to a first user action of a first user of the first application, the first raw input data including a full set of state information for the first user action;

the second application generating second raw input data in response to a second user action of a second user of the second application, the second raw input data including a full set of state information for the second user action;

the first application of the first device adding the first raw input data to a first protein structure, adding first semantic data to the first protein structure, and depositing the first protein structure into an input repository of a third device via a network connection;

the second application of the second device encapsulating adding the second raw input data to a second protein structure, adding second semantic data to the second protein structure, and depositing the second protein structure into the input repository of the third device;

the third device identifying protein structures in the input repository that include semantic data that matches a pattern;

responsive to a determination that the first semantic data included in the first protein structure matches the pattern, the third device extracting the first protein structure from the input repository via a local memory bus of the third device;

responsive to a determination that the second semantic data included in the second protein structure matches the pattern, the third device extracting second protein structure from the input repository via the local memory bus of the third device; and

the third device using the first raw input data of the extracted first protein structure and the second raw input data of the extracted second protein structure to process at least one event corresponding to the first protein structure and the second protein structure,

wherein the first protein structure and the second protein structure have a same record format,

wherein the first semantic data identifies the first user action and the second protein structure second semantic data identifies the second user action,

wherein the first protein structure includes an application-independent representation of the first raw input data, and

wherein the second protein structure includes an application-independent representation of the second raw input data.

2. The method of claim 1, wherein a first input device of the first device generates the first raw input data, wherein a second input device of the second device generates the second raw input data.

3. The method of claim 1, wherein the first protein structure specifies the first user action and information identifying an input device of the first raw input data, and wherein the second protein structure specifies the second user action and information identifying an input device of the second raw input data.

4. The method of claim 3, wherein the input device of the first raw input data is different from the input device of the second raw input data.

5. The method of claim 3, wherein the first semantic data specifies a semantic meaning for the first user action, and wherein the second semantic data specifies a semantic meaning for the second user.

6. The method of claim 5, wherein the third device extracts the first protein structure based on the semantic meaning for the first user action.

7. The method of claim 6, wherein the third device extracts the second protein structure based on the semantic meaning for the second user action.

8. The method of claim 6, wherein the third device extracts the second protein structure based on the second user action.

9. The method of claim 3, wherein the third device extracts the first protein structure based on the first user action.

10. The method of claim 9, wherein the third device extracts the second protein structure based on a semantic meaning for the second user action that is specified by the first protein structure.

11. The method of claim 9, wherein the third device extracts the second protein structure based on the second user action.

12. The method of claim 3, wherein the input device of the first raw input data is one of a gestural input sensor, a keyboard, a mouse, and an infrared remote control.

13. The method of claim 12, wherein the input device of the second raw input data is a gestural input sensor.

14. The method of claim 1, wherein the first device deposits the first protein structure into the input repository via at least one of the local memory bus and a network connection, and wherein the second device deposits the first protein structure into the input repository via at least one of the local memory bus and a network connection.

15. The method of claim 1, wherein the first semantic data comprises a first human-readable description of the first user action and the second semantic data comprises a second human-readable description of the second user action.

16. The method of claim 15,

wherein the pattern identifies a user action,

wherein the pattern is compared with the first human-readable description to determine that the first semantic data included in the first protein structure matches the pattern, and

wherein the pattern is compared with the second human-readable description to determine that the second semantic data included in the second protein structure matches the pattern.

18. The method of claim 1, wherein a first gestural input sensor of the first device generates the first raw input data, wherein a second gestural input sensor of the second device generates the second raw input data, wherein the first raw input data corresponds to the first user action, and wherein the second raw input data corresponds to the second user action.

19. The method of claim 18, wherein the third device runs a third application, and wherein the third application uses the first raw input data of the first protein structure and the second raw input data of the second protein structure to process the at least one event corresponding to the first protein structure and the second protein structure, wherein the third application is different from the first application and the second application.

20. The method of claim 18,

wherein the third device runs a third application, and wherein the third application updates graphical output of the third device based on the first raw input data of the first protein structure and the second raw input data of the second protein structure,

wherein the third application is different from the first application and the second application,

wherein the first protein structure specifies the first user action and information identifying the first device,

wherein the second protein structure specifies the second user action and information identifying the second device,

wherein the third application extracts the first protein structure from the input repository based on the first user action, and

wherein the third application extracts the second protein structure from the input repository based on the second user action.

17. A system comprising:

a first device constructed to run a first application;

a second device constructed to run a second application; and

a third device that comprises an input repository,

wherein the first application is constructed to generate first raw input data in response to a first user action of a first user of the first application, the first raw input data including a full set of state information for the first user action,

wherein the second application is constructed to generate second raw input data in response to a second user action of a second user of the second application, the second raw input data including a full set of state information for the second user action,

wherein the first application is constructed to add the first raw input data to a first protein structure, add first semantic data to the first protein structure, and deposit the first protein structure into the input repository via a network connection,

wherein the second application is constructed to add the second raw input data to a second protein structure, add second semantic data to the second protein structure, and deposit the second protein structure into the input repository,

wherein the third device is constructed to;

identify protein structures in the input repository that include semantic data that matches a pattern,

responsive to a determination that the first semantic data included in the first protein structure matches the pattern, extract the first protein structure from the input repository via a local memory bus of the third device,

responsive to a determination that the second semantic data included in the second protein structure matches the pattern, extract the second protein structure from the input repository via the local memory bus of the third device,

wherein the third device is constructed to use the first raw input data of the extracted first protein structure and the second raw input data of the extracted second protein structure to process at least one event corresponding to the first protein structure and the second protein structure,

wherein the first protein structure and the second protein structure have a same record format,

wherein the first semantic data identifies the first user action and the second semantic data identifies the second user action,

wherein the first protein structure includes an application-independent representation of the first input raw data, and

wherein the second protein structure includes an application-independent representation of the second raw input data.