USING PHYSICAL OBJECTS IN CONJUNCTION WITH AN INTERACTIVE SURFACE

• US 20170024370A1
• Filed: 05/18/2016
• Published: 01/26/2017
• Est. Priority Date: 09/30/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: HARTMANN, Bjrn U., BENKO, Hrvoje, MORRIS, Meredith J., WILSON, Andrew D.
• Granted Patent: US 10,346,529 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/171 by use of digital ink

Abstract

An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.

Claims

1-20. -20. (canceled)

21. A system comprising:

one or more processing devices; and

one or more computer-readable memory devices or storage devices storing computer-readable instructions which, when executed by the one or more processing devices, cause the one or more processing devices to;

detect multiple finger contacts on an interactive surface, the multiple finger contacts engaging a digital object shown on the interactive surface; and

manipulate an orientation, size, or location of the digital object on the interactive surface responsive to the multiple finger contacts.

22. The system of claim 21, wherein the computer-readable instructions, when executed by the one or more processing devices, cause the one or more processing devices to:

change an orientation of the digital object responsive to the multiple finger contacts.

23. The system of claim 22, wherein the computer-readable instructions, when executed by the one or more processing devices, cause the one or more processing devices to:

rotate the digital object around a fixed pivot defined by an individual finger contact.

24. The system of claim 23, wherein the digital object is rotated counterclockwise around the fixed pivot.

25. The system of claim 21, further comprising:

an infrared emitter-detector configured to detect the multiple finger contacts.

26. The system of claim 21, further comprising:

a content projection mechanism disposed above the interactive surface and configured to project the digital object onto the interactive surface.

27. The system of claim 21, further comprising:

a content projection mechanism integrated into interactive surface and configured to project the digital object on the interactive surface.

28. A method performed by one or more processing devices, the method comprising:

displaying an interface object on an interactive surface;

detecting a touch contact on the interface object; and

responsive to the touch contact, displaying a menu object on the interactive surface in association with the interface object.

29. The method of claim 28, further comprising:

detecting placement of a physical article on the interactive surface; and

responsive to placement of the physical article on the interactive surface, displaying the interface object on the interactive surface.

30. The method of claim 29, further comprising:

printing a digital copy of the physical article responsive to a user activation of a printing option on the menu object.

31. The method of claim 29, further comprising:

saving a digital copy of the physical article responsive to a user activation of a saving option on the menu object.

32. The method of claim 29, further comprising:

emitting infrared signals toward the interactive surface; and

processing the infrared signals to detect the placement of the physical article on the interactive surface.

33. The method of claim 28, further comprising:

emitting infrared signals toward the interactive surface; and

processing the infrared signals to detect the touch contact on the interactive surface.

34. A system comprising:

one or more processing devices configured to provide an interactive management module, the interactive management module being configured to;

display a digital copy of a physical article on an interactive surface;

receive a finger touch contact on the digital copy; and

responsive to the finger touch contact, apply a highlight to the physical article.

35. The system of claim 34, wherein the highlight is applied to a part of the physical article that corresponds to a part of the digital copy to which the finger touch contact is applied.

36. The system of claim 34, wherein the interactive management module is further configured to:

detect that the finger touch contact has been removed from the digital copy of the physical article; and

responsive to removal of the finger touch contact from the digital copy, remove the highlight from the physical article.

37. The system of claim 34, wherein the interactive management module is further configured to:

detect that the finger touch contact has been removed from the digital copy of the physical article; and

preserve the highlight on the physical article after removal of the finger touch contact.

38. The system of claim 34, wherein the interactive management module is further configured to:

responsive to the finger touch contact, place a digital mark on the digital copy of the physical article.

39. The system of claim 34, further comprising:

an infrared emitter-detector configured to detect the finger touch contact.

40. The system of claim 34, further comprising:

a content projection mechanism disposed above the interactive surface and configured to project the digital copy of the physical article onto the interactive surface.