System and method for converting gestures into digital graffiti

• US 9,661,468 B2
• Filed: 10/02/2014
• Issued: 05/23/2017
• Est. Priority Date: 07/07/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Khosravy, Moe, Novik, Lev, Woodcock, Katrika Marie
• Primary Examiner(s): XAVIER, ANTONIO J
• Application Number:
  US14/505,456
• Publication Number:
  US 20150022549A1
• Time in Patent Office: 964 Days
• Field of Search: None
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

The subject disclosure provides a device, computer readable storage medium, and method for converting gestures undergone by a device into digital graffiti. The disclosure includes ascertaining an orientation of the device and a path traversed by the device. Gestures undergone by the device are identified as a function of the orientation and the path. Digital graffiti corresponding to the gestures are then superimposed onto a digital canvas.

Claims

1. A portable device, comprising:

a motion detector configured to output motion information as a function of at least one movement of the portable device;

an orientation detector configured to output direction information as a function of an orientation of the portable device, the direction information identifying a pointing direction of the portable device; and

at least one processor configured to;

present a set of points of interest, the set of points of interest being generated at least in part from the pointing direction of the portable device;

filter the set of points of interest, based on a selection gesture undergone by the portable device, to a subset of one or more points of interest within the pointing direction, wherein the selection gesture is a distinct motion or gesture apart from the pointing direction of the mobile device;

receive a selection of a digital canvas from a plurality of retrievable digital canvases respectively corresponding to the subset of one or more points of interest; and

superimpose digital graffiti onto the selected digital canvas in response to a graffiti gesture undergone by the portable device, the graffiti gesture being identified at least in part by graffiti motion information.

2. The portable device of claim 1 further comprising a location detector configured to output a location of the portable device, the at least one processor further configured to process at least the location to ascertain the digital canvas.

3. The portable device of claim 1, the motion detector further configured to ascertain a velocity of the portable device during at least a portion of a path traversed by the portable device, the at least one processor further configured to identify the graffiti gesture based on the velocity.

4. The portable device of claim 1 further comprising an ink component that outputs a two-dimensional mapping of the graffiti gesture, the at least one processor further configured to process the two-dimensional mapping, the digital graffiti derived from at least a portion of the two-dimensional mapping.

5. The portable device of claim 4 further comprising a beautification component configured to output a beautification of at least a portion of the two-dimensional mapping, the at least one processor further configured to process the beautification, the digital graffiti including at least a portion of the beautification.

6. The portable device of claim 1 further comprising an object component configured to output a digital image corresponding to the graffiti gesture, the at least one processor further configured to process the digital image, the digital graffiti including at least a portion of the digital image.

7. The portable device of claim 6 further comprising a library configured to store at least the digital image, the at least one processor further configured to retrieve the digital image from the library component.

8. The portable device of claim 6 further comprising a network interface configured to facilitate interfacing the portable device with a network, the at least one processor further configured to retrieve the digital image from the network.

9. The portable device of claim 1, wherein the subset of one or more points of interest is generated at least in part from a panning gesture defining an arc in which the set of points of interest is contained.

10. A computer hardware storage device, comprising computer-readable instructions, the computer-readable instructions including instructions for performing the following acts:

present a set of points of interest at a portable device, the set of points of interest being generated at least in part from direction information, the direction information identifying a pointing direction of the portable device;

filter the set of points of interest, based on a selection gesture undergone by the portable device, to a subset of one or more points of interest within the pointing direction, wherein the selection gesture is a distinct motion or gesture apart from the pointing direction of the mobile device;

receive a selection of a digital canvas from a plurality of retrievable digital canvases respectively corresponding to the subset of one or more points of interest;

identify a graffiti gesture undergone by the portable device; and

superimpose digital graffiti onto the digital canvas in response to the graffiti gesture.

11. The computer hardware storage device of claim 10, the computer readable instructions further comprising instructions for determining a location of the portable device, the digital canvas ascertained as a function of the location.

12. The computer hardware storage device of claim 10, the computer readable instructions further comprising instructions for attaching metadata to the digital graffiti.

13. The computer hardware storage device of claim 10, the computer readable instructions further comprising instructions for limiting a scope depth encompassed by a given pointing interaction, the at least one endpoint within the scope depth.

14. The computer hardware storage device of claim 10, the computer readable instructions further comprising instructions for ascertaining a digital image corresponding to the gesture, the digital graffiti including at least a portion of the digital image.

15. The computer hardware storage device of claim 14, the computer readable instructions further comprising instructions for retrieving the digital image from at least one of an external memory component accessible over a network or a library of images stored locally on the portable device.

16. A computer-implemented method, comprising:

employing a computer hardware storage device having instructions stored thereon that are operable, when executed by one or more computing processors, to cause a computing system to implement the following acts;

present a set of points of interest at a portable device, the set of points of interest being generated at least in part from a pointing direction of the portable device, the pointing direction being identified by direction information;

filter the set of points of interest, based on a selection gesture undergone by the portable device, to a subset of one or more points within the pointing direction, wherein the selection gesture is a distinct motion or gesture apart from the pointing direction of the mobile device;

receive a selection of a digital canvas from a plurality of retrievable digital canvases respectively corresponding to the subset of one or more points of interest;

identify a graffiti gesture undergone by the portable device; and

superimpose digital graffiti onto the digital canvas in response to the graffiti gesture.

17. The method of claim 16, wherein motion information corresponding to the selection gesture is defined at least in part by one or more accelerometer measurements.