Manipulation of Content on a Surface

• US 20150067552A1
• Filed: 08/28/2013
• Published: 03/05/2015
• Est. Priority Date: 08/28/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Leorin, Simone, Duong, Nghiep Duy, Shaw, Steven Wei, Verthein, William George
• Granted Patent: US 9,830,060 B2
• Time in Patent Office: Days
• US Class Current: 715/765
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

Various embodiments enable expeditious manipulation of content on a surface so as to make the content quickly visually available to one or more attendees or participants. In at least some embodiments, content can be automatically manipulated to automatically present the content in a surface location that provides an unobstructed view of the content. Alternately or additionally, content can be manually selected to become “floating” in a manner which moves the content to a surface location that provides an unobstructed view of the content.

Claims

1. A computer-implemented method comprising:

capturing content that is provided onto a surface;

ascertaining a location of an obstruction relative to the surface;

ascertaining a location that is unobstructed by the obstruction; and

relocating captured content to the location that is unobstructed by the obstruction.

2. The computer-implemented method of claim 1, wherein the content comprises text and said relocating comprises automatically relocating the captured content.

3. The computer-implemented method of claim 1, wherein the content comprises text and said relocating comprises receiving user input to relocate selected content and responsive to receiving the user input, relocating the captured content.

4. The computer-implemented method of claim 1, wherein said ascertaining is performed using one or more sensors comprising part of the surface.

5. The computer-implemented method of claim 1, wherein said ascertaining is performed using one or more cameras.

6. The computer-implemented method of claim 1, wherein said ascertaining a location that is unobstructed is performed by ascertaining a predefined location.

7. The computer-implemented method of claim 1, wherein said ascertaining a location that is unobstructed is performed by computing the location relative to the obstruction.

8. The computer-implemented method of claim 1, wherein said ascertaining a location that is unobstructed is performed by computing the location relative to the obstruction and as the obstruction moves relative to the surface.

9. The computer-implemented method of claim 1, wherein the obstruction comprises a person.

10. One or more computer readable storage memories embodying a content manipulation module comprising:

a content capture module configured to capture content that is provided on an interactive surface or multitouch screen;

a location detection module configured to ascertain a location of an obstruction relative to the interactive surface or multitouch screen;

a content re-location module configured to ascertain the location that is unobstructed by the obstruction; and

a content rendering module configured to relocate content captured by the content capture module, said content rendering module being configured to relocate said content either automatically or responsive to receiving gestural input to relocate selected content.

11. The one or more computer readable storage memories of claim 10, wherein the content comprises text.

12. The one or more computer readable storage memories of claim 10, wherein the content comprises content other than text.

13. The one or more computer readable storage memories of claim 10, further comprising one or more sensors operably coupled to the location detection module and configured to detect obstructions.

14. The one or more computer readable storage memories of claim 10, further comprising one or more cameras operably coupled to the location detection module and configured to detect obstructions.

15. The one or more computer readable storage memories of claim 10, wherein the content re-location module is configured to compute unobstructed locations as the obstruction moves relative to the interactive surface or multitouch screen;

and the content rendering module is configured to automatically relocate content to unobstructed locations as the obstruction moves relative to the interactive surface or multitouch screen.

16. An interactive surface or multitouch screen embodying the one or more computer readable storage memories of claim 10.

17. A computing device embodying the one or more computer readable storage memories of claim 10.

18. The one or more computer readable storage memories of claim 10, wherein the obstruction comprises a person.

19. A system comprising:

one or more surfaces configured to receive input from a user;

a computing device configured to be coupled to the one or more surfaces and configured to perform operations comprising;

capturing content that is input by a user onto the one or more surfaces;

ascertaining a location of a person relative to the one or more surfaces;

ascertaining a location that is unobstructed by the person;

automatically relocating captured content to the location that is unobstructed by the person.

20. The system of claim 19, wherein the computing device is configured to perform operations further comprising ascertaining additional locations that are unobstructed by the person as the person moves relative to the one or more surfaces;

and automatically relocating content to the additional locations as the person moves relative to the one or more surfaces.