Collaboration system

• US 9,207,833 B2
• Filed: 02/27/2013
• Issued: 12/08/2015
• Est. Priority Date: 09/25/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Doray, Bernard, To, Paul, Haller, Michael, Brandl, Peter, Seifried, Thomas J.
• Primary Examiner(s): Titcomb, William
• Application Number:
  US13/779,058
• Publication Number:
  US 20130227433A1
• Time in Patent Office: 1,014 Days
• Field of Search: 345/179, 382/314, 715/753
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 10/103 Workflow collaboration or project management
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15

Abstract

A collaboration system provides enhanced user interface to enable users to interact with electronic devices. In one embodiment, users can add content to a digital system by using a pen that streams coordinates so that input to the digital system may be based on conventional pen and paper handwriting. In another embodiment, a pie-based menu system is used for input to large display area digital devices in which an occluded portion of the pie-based menu system is not used for direct input by the user. The selection of which areas of the pie-based menu system should be omitted from use is adaptive and responsive to whether the user is left-handed or right-handed, and the wrist angle defined by the user'"'"'s posture. In still another embodiment, an ergonomic open-shaped pie menu system is provided to facilitate selection of options on a digital surface.

Claims

1. A collaboration system, comprising:

an electronic pen configured to enable a user to write on paper such that what the user is writing while using the electronic pen is visible on the paper, the electronic pen further being configured to record information about strokes made by the user while writing; and

a collaboration server including a storage medium, the collaboration server configured to;

establish a collaboration session displayable on a digital surface;

receive input from the electronic pen over a communication network and store the input from the electronic pen on the storage medium;

process the input from the electronic pen to recreate what the user was writing while using the electronic pen; and

cause the recreated writing to be shown during the collaboration session on the digital surface;

wherein, in response to the user of the digital surface invoking a menu, the digital surface is configured to display the menu, wherein the menu is a pie-shaped menu having an input area, the input area extending in a circular segment extending less than 360 degrees such that no portion of the input area is disposed in an area expected to be occluded by the user'"'"'s hand when the user interacts with the menu.

2. The collaboration system of claim 1, wherein the collaboration server is further configured to store the recreated writing and the collaboration session.

3. The collaboration system of claim 1, wherein one or more applications are configured to be run on the digital surface, and wherein the menu is configured to control the one or more applications.

4. The collaboration system of claim 3, further comprising a hardware device comprising an interactive screen, and wherein users of the digital surface are able to invoke a menu associated with the one or more applications by interacting with the interactive screen to cause the menu associated with the one or more applications to be drawn on the digital surface.

5. The collaboration system of claim 1, wherein the menu is invokable via the electronic pen with a single down action and two press actions within a defined period of time.

6. The collaboration system of claim 1, wherein the menu is centered approximately at the location where the menu was invoked.

7. The collaboration system of claim 1, wherein the area expected to be occluded extends approximately 90 degrees.

8. The collaboration system of claim 1, wherein an orientation of the area expected to be occluded is based on a direction vector between a location where the menu was invoked and a location of contact between the digital surface and the user'"'"'s hand.

9. The collaboration system of claim 8, wherein the location where the menu is invoked is a tip of the electronic pen contacts the digital surface.

10. The collaboration system of claim 8, wherein, in response to the user invoking the menu without any contact between the user'"'"'s hand and the digital surface, the orientation of the area expected to be occluded is established using a default value.

11. The collaboration system of claim 8, wherein, in response to the user invoking the menu without any contact between the user'"'"'s hand and the digital surface, the orientation of the area expected to be occluded is established using a previous direction vector from a previous menu invocation.

12. The collaboration system of claim 8, wherein the direction vector enables the area expected to be occluded to be adjusted based on the user'"'"'s posture.

13. The collaboration system of claim 8, wherein the direction vector enables the server to distinguish between right-handed users and left-handed users, and enables the collaboration server to automatically generate a right-handed menu for a right-handed user and a left-handed menu for a left-handed user.

14. The collaboration system of claim 1, wherein the menu further has a gesture area, configured to enable the user to provide gesture based input.

15. The collaboration system of claim 14, wherein the gesture area extends into the area expected to be occluded.

16. The collaboration system of claim 15, wherein the gesture area enables functions associated with the input area to be moved between regions of the input area.

17. The collaboration system of claim 16, wherein the gesture area enables new functions to be associated with the regions of the input area.

18. The collaboration system of claim 1, wherein the user is remotely located from the digital surface.