Shared real-time content editing activated by an image

• US 9,857,964 B2
• Filed: 05/09/2017
• Issued: 01/02/2018
• Est. Priority Date: 01/14/2013
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Soon-Shiong, Patrick
• Primary Examiner(s): Avellino, Joseph E
• Assistant Examiner(s): Book, Phyllis A
• Application Number:
  US15/591,017
• Publication Number:
  US 20170242576A1
• Time in Patent Office: 238 Days
• Field of Search: None
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

Systems and methods for instantiating collaboration interfaces via object recognition are disclosed. An object recognition engine communicatively coupled to a database and an electronic device receives sensor data related to an object and identifies an object characteristic. A component is selected having criteria satisfied by the object characteristic and a collaboration interface is instantiated on the electronic device. This can allow a user to edit content related to an object. A substantially identical collaboration interface can be instantiated on a second electronic device to allow collaboration among user with respect to content related to the object.

Claims

1. A collaboration system, comprising:

a collaboration database storing a plurality of collaboration interface components; and

at least one processor configured to control an object recognition engine communicatively coupled with the collaboration database, and the object recognition engine being configured to;

receive sensor data related to an object via an input interface;

identify a set of object characteristics from the sensor data;

select the set of collaboration interface components having the selection criteria satisfied by the object characteristics;

instantiate a collaboration interface from the set of components on at least a first electronic device, instantiate the collaboration interface on a second electronic device, determine the first electronic device as an owner of the collaboration interface, determine the second electronic device as a non-owner of the collaboration interface, the instantiation of the collaboration interface on the first electronic device including a plurality of editing functions based on the determination of the first electronic device as the owner of the collaboration interface, and the instantiation of the collaboration interface on the second electronic device including a proper subset of the plurality of editing functions based on the determination of the second electronic device as the non-owner of the collaboration interface; and

configure the first electronic device to generate a first collaboration command via the instantiated collaboration interface.

2. The system of claim 1, wherein the object recognition engine is coupled to a construction engine, and wherein the construction engine is configured to construct a plurality of collaboration interfaces to be instantiated.

3. The system of claim 2, wherein the instantiated collaboration interface is selected from the plurality of constructed collaboration interfaces.

4. The system of claim 1, wherein the object recognition engine is disposed within the electronic device.

5. The system of claim 1, wherein the plurality of collaboration interface components comprises at least one of a video editor component, an image editor component, a text editor component, a game editor component, and an audio editor component.

6. The system of claim 1, wherein the object recognition engine is further configured to initiate an action targeting the first electronic device prior to instantiating the collaboration interface.

7. The system of claim 1, wherein the first collaboration command comprises at least one of:

a comment, a modification, an addition, or a deletion.

8. The system of claim 1, wherein the object recognition engine is further configured to instantiate the collaboration interface on the second electronic device associated with a second user.

9. The system of claim 8, wherein the first device is located at least 1 mile away from the second device.

10. The system of claim 8, wherein the second electronic device is configured to generate a second collaboration command under direction of the second user via the instantiated collaboration interface.

11. The system of claim 10, further comprising a reconciliation engine coupled with the electronic device, and wherein the reconciliation engine is configured to provide an indication of a conflict between the first collaboration command and the second collaboration command.

12. The system of claim 11, wherein the reconciliation engine is further configured to reconcile the first user command with the second user command.

13. The system of claim 1, wherein the object recognition engine is further coupled with a database storing a plurality of rules that govern operation of the instantiated collaboration interface.

14. The system of claim 1, wherein the instantiated collaboration interface is configured to enforce a rule associated with the object.

15. The system of claim 14, wherein the rule comprises intellectual property rules.

16. The system of claim 14, wherein the rule comprises censorship rules.

17. The system of claim 14, wherein the rule comprises version control rules.

18. The system of claim 1, wherein the object recognition engine is further configured to instantiate a second collaboration interface on the first electronic device.

19. The system of claim 18, wherein the object recognition engine is further configured to instantiate the second collaboration interface based on the first user command.

20. The system of claim 1, wherein the object recognition engine is further configured to receive sensor data related to a second object.

21. The system of claim 20, wherein the object recognition engine is further configured to identify a second set of object characteristics from the sensor data related to the second object.

22. The system of claim 21, wherein the set of components further has selection criteria satisfied by the second set of object characteristics.

23. A collaboration system, comprising:

a collaboration database storing a plurality of collaboration interface components; and

at least one processor configured to control an object recognition engine communicatively coupled with the collaboration database, and the object recognition engine being configured to;

receive sensor data related to an object via an input interface;

identify a set of object characteristics from the sensor data;

select the set of collaboration interface components having the selection criteria satisfied by the object characteristics;

instantiate a collaboration interface from the set of components on at least a first electronic device, instantiate the collaboration interface on a second electronic device, determine the first electronic device as an owner of the collaboration interface, determine the second electronic device as a non-owner of the collaboration interface, the instantiation of the collaboration interface on the first electronic device including a plurality of editing functions based on the determination of the first electronic device as the owner of the collaboration interface, and the instantiation of the collaboration interface on the second electronic device including a proper subset of the plurality of editing functions based on the determination of the second electronic device as the non-owner of the collaboration interface, the plurality of editing functions comprising augmented reality editing functions; and

configure the first electronic device to generate a first collaboration command via the instantiated collaboration interface.