Systems and methods for collaborative synchronous image selection

• US 10,133,460 B2
• Filed: 02/18/2016
• Issued: 11/20/2018
• Est. Priority Date: 03/26/2014
• Status: Active Grant

• Current Assignee: Unanimous A.I., Inc.
• Original Assignee: Unanimous A.I., Inc.
• Inventors: Rosenberg, Louis B.
• Primary Examiner(s): To, Jennifer N
• Assistant Examiner(s): Hoang, Amy P
• Application Number:
  US15/047,522
• Publication Number:
  US 20160170616A1
• Time in Patent Office: 1,006 Days
• CPC Class Codes: E21B 47/13 by electromagnetic energy, e.g. radio frequency
• CPC Class Codes: E21B 47/18 through the well fluid , e.g. mud pressure pulse telemetry
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities

Abstract

Systems and methods for real-time collaborative computing and collective intelligence are disclosed. A collaborative application runs on a collaborative server connected to a plurality of computing devices. Collaborative sessions are run wherein a group of independent users, networked over the internet, collaboratively answer questions in real-time, thereby harnessing their collective intelligence. Methods for collaborative selection of a target point on an image displayed on the computing devices. Methods for collaborative zooming and panning of an image displayed on the computing devices.

Claims

1. A collaborative intelligence system for enabling a plurality of users to jointly control a graphical pointer and collaboratively select a coordinate location within a graphical image during a collaborative session, the system comprising:

a central collaboration server configured to run a collaboration server application and to exchange real-time data with each of a plurality of networked computing devices, each of the computing devices having a user interface and a display and running a collaborative intent application, wherein the collaborative intent application on each computing device is configured to;

receive and display a graphical image on the display;

display a collaboratively controlled graphical pointer over the graphical image;

receive, repeatedly in real-time, from the central collaboration server, a pointer location;

update, repeatedly in real-time, the displayed location of the collaboratively controlled graphical pointer such that it moves across the graphical image, the updated displayed location based at least in part on the received pointer location and the displayed location substantially synchronized among the plurality of computing devices;

receive, repeatedly in real-time, user input through the user interface, the user input representing a user intent direction and a user intent magnitude, said user intent direction indicating a desired direction of motion of the collaboratively controlled graphical pointer with respect to the graphical image, said user intent magnitude indicating a desired speed of motion of the collaboratively controlled graphical pointer with respect to the graphical image; and

send, repeatedly in real-time, a representation of the user intent direction and user intent magnitude to the central collaboration server;

wherein the collaboration server application running on the central collaboration server is configured to;

receive, repeatedly in real-time, the representation of the user intent direction and user intent magnitude, from each of the plurality of computing devices;

determine, repeatedly in real-time, a group intent vector from the user intent directions and user intent magnitudes received from the plurality of computing devices, the group intent vector indicating a collaboratively desired motion of the collaboratively controlled graphical pointer;

determine, repeatedly in real-time, the updated pointer location for the collaboratively controlled graphical pointer based at least in part upon the group intent vector;

send, repeatedly in real-time, the pointer location to the plurality of computing devices;

determine, repeatedly, whether a speed of the collaboratively controlled graphical pointer has fallen below a threshold value for more than a threshold amount of time;

identify a target location upon the graphical image in response to the determination that the speed of the collaboratively controlled graphical pointer has fallen below the threshold value for more than the threshold amount of time; and

send the target location to at least one of the plurality of computing devices.

2. The collaborative intelligence system of claim 1, wherein the target location is a coordinate with respect to an origin location on the graphical image.

3. The collaborative intelligence system of claim 1, wherein at least one of the plurality of computing devices displays a graphical identifier at the target location.

4. The collaborative intelligence system of claim 1, wherein the graphical image is a geographic map.

5. The collaborative intelligence system of claim 1, wherein the graphical image is a calendar.

6. The collaborative intelligence system of claim 1, wherein during the collaborative selection process the graphical image is panned under collaborative control, said panning performed in response to the collaboratively controlled graphical pointer being collaboratively positioned so as to interact with a panning boundary.

7. The collaborative intelligence system of claim 1, wherein user intent direction is indicated by a user controlling a second graphical pointer displayed on the display, the user intent direction being based upon an angle between the second graphical pointer and the collaboratively controlled graphical pointer.

8. The collaborative intelligence system of claim 1, wherein user intent magnitude is indicated by a user by controlling a second graphical pointer displayed on the display, the user intent magnitude being based upon a distance between the second graphical pointer and the collaboratively controlled graphical pointer.

9. The collaborative intelligence system of claim 1, wherein the speed threshold increases over time during the collaborative session.

10. A collaborative intelligence system for enabling a plurality of users to jointly control panning of a display of a graphical image, the system comprising:

a central collaboration server configured to run a collaboration server application and to exchange real-time data with each of a plurality of networked computing devices, each of the computing devices having a user interface and a display and running a collaborative intent application, wherein the collaborative intent application on each computing device is configured to;

receive and display a portion of a graphical image in a display area of the display, wherein only a portion of the graphical image is visible as a result of the graphical image being larger than the display area;

display a collaboratively controlled graphical pointer over the displayed portion of the graphical image;

receive, repeatedly in real-time, from the collaborative intelligence server, a pointer location;

update, repeatedly in real-time, the displayed location of the collaboratively controlled graphical pointer such that it moves with respect to the display area, the updated location based at least in part on the received pointer location and displayed location substantially synchronized among the plurality of computing devices;

receive, repeatedly in real-time, user input through the user interface, the user input representing a user intent direction and a user intent magnitude, said user intent direction indicating a desired direction of motion of the collaboratively controlled graphical pointer, said user intent magnitude indicating a desired speed of motion of the collaboratively controlled graphical pointer; and

send, repeatedly in real-time, a representation of the user intent direction and user intent magnitude to the collaborative intelligence server;

wherein the collaboration server application running on the central collaboration server is configured to;

receive, repeatedly in real-time, the representation of the user intent direction and user intent magnitude, from each of the plurality of computing devices;

determine, repeatedly in real-time, a group intent vector from the user intent directions and user intent magnitudes received from the plurality of computing devices, the group intent vector indicating a collaboratively desired motion of the collaboratively controlled graphical pointer

determine, repeatedly in real-time, an updated pointer location for the collaboratively controlled graphical pointer based at least in part upon the group intent vector;

send, repeatedly in real-time, the pointer location to the plurality of computing devices;

determine, repeatedly, whether the collaboratively controlled graphical pointer has reached a panning boundary region defined with respect to the display area, and if the graphical pointer has reached the panning boundary region, prevent the pointer from leaving the panning boundary region; and

coordinate the panning of the graphical image, a direction of the panning being substantially opposite to the direction of the group intent vector when the collaboratively controlled pointer has reached the panning boundary region.

11. The collaborative intelligence system of claim 10 wherein a speed of the panning of the graphical image is proportional to a magnitude of the group intent vector.

12. The collaborative intelligence system of claim 10 wherein the panning boundary region is a small region near the center of the display area.

13. The collaborative intelligence system of claim 10 wherein the collaboratively controlled graphical pointer is pulled back to the center of the panning boundary region by a simulated gravitational force.

14. The collaborative intelligence system of claim 10 wherein the graphical image is a geographic map.

15. The collaborative intelligence system of claim 10 wherein the graphical image includes a plurality of distinct graphical targets.

16. The collaborative intelligence system of claim 10 wherein user intent direction is indicated by a user by controlling a second graphical pointer, the user intent direction being based upon an angle between the second graphical pointer and the collaboratively controlled graphical pointer.

17. The collaborative intelligence system of claim 10 wherein user intent magnitude is indicated by a user by controlling a second graphical pointer displayed on the display area, the user intent magnitude being based upon a distance between the second graphical pointer and the collaboratively controlled graphical pointer.

18. The collaborative intelligence system of claim 10 wherein the collaborative intent application is further configured to determine, repeatedly, whether a speed of the collaboratively controlled graphical pointer has fallen below a threshold value for more than a threshold amount of time and if so, trigger a zoom feature wherein the graphical image is zoomed in on the display of the plurality of computing devices.

19. The collaborative intelligence system of claim 10 wherein the collaborative intent application is further configured to determine, repeatedly, whether a speed of the collaboratively controlled graphical pointer has fallen below a threshold value for more than a threshold amount of time and in response identify a target location upon the graphical image in response to the determination, the target location being sent to at least one of the plurality of computing devices.