System and method for converting gestures into digital graffiti

• US 8,872,767 B2
• Filed: 07/07/2009
• Issued: 10/28/2014
• Est. Priority Date: 07/07/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Khosravy, Moe, Novik, Lev, Woodcock, Katrika Marie
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): XAVIER, ANTONIO J
• Application Number:
  US12/499,016
• Publication Number:
  US 20110006977A1
• Time in Patent Office: 1,939 Days
• Field of Search: None
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

The subject disclosure provides a device, computer readable storage medium, and method for converting gestures undergone by a device into digital graffiti. The disclosure includes ascertaining an orientation of the device and a path traversed by the device. Gestures undergone by the device are identified as a function of the orientation and the path. Digital graffiti corresponding to the gestures are then superimposed onto a digital canvas.

Claims

1. A device, comprising:

a motion component configured to output motion information as a function of at least one movement of the device, the motion information identifying a path traversed by the device;

a directional component configured to output direction information as a function of an orientation of the device, the direction information identifying a pointing direction of the device; and

at least one processor configured to simultaneously superimpose digital graffiti created via at least one gesture undergone by the device onto a plurality of digital canvasses, the plurality of digital canvasses selected from a plurality of retrievable digital canvasses respectively corresponding to a plurality of aggregated points of interest within a predetermined radius from a particular point of interest and identified as being substantially within the pointing direction of the device.

2. The device of claim 1, the at least one processor further configured to process at least the orientation of the device to ascertain at least one digital canvas.

3. The device of claim 1 further comprising a position component configured to output a location of the device, the at least one processor further configured to process at least the location to ascertain at least one digital canvas.

4. The device of claim 3, the at least one processor is further configured to process the location to determine at least one point of interest relating to the location, the at least one digital canvas corresponding to the at least one point of interest.

5. The device of claim 1 further comprising a scanning component that outputs sensory information pertaining to a signal received from at least one entity proximate to the device, the at least one processor further configured to process at least the sensory information to ascertain the at least one digital canvas.

6. The device of claim 1 further comprising an ink component that outputs a two-dimensional mapping of the at least one gesture, the at least one processor further configured to process the two-dimensional mapping, the digital graffiti derived from at least a portion of the two-dimensional mapping.

7. The device of claim 6 further comprising a beautification component that outputs a beautification of at least a portion of the two-dimensional mapping, the at least one processor further configured to process the beautification, the digital graffiti including at least a portion of the beautification.

8. The device of claim 1 further comprising an object component that outputs a digital image corresponding to the at least one gesture, the at least one processor further configured to process the digital image, the digital graffiti including at least a portion of the digital image.

9. The device of claim 8 further comprising a library component that stores at least the digital image, the at least one processor further configured to retrieve the digital image from the library component.

10. The device of claim 8 further comprising a network component that facilitates interfacing the device with a network, the at least one processor further configured to retrieve the digital image from the network.

11. The device of claim 1, the motion component further configured to ascertain a velocity of the device during at least a portion of the path traversed by the device, the at least one processor further configured to identify the at least one gesture based on the velocity.

12. A computer readable storage device, comprising:

a memory component configured to store computer-readable instructions, the computer-readable instructions including instructions for performing the following acts;

ascertaining an orientation of a portable device, the orientation ascertained as a function of direction information processed by a processor, the direction information indicating a pointing direction of the portable device;

ascertaining a path traversed by the portable device, the path ascertained as a function of motion information processed by the processor;

identifying a gesture undergone by the portable device;

selecting multiple digital canvasses from a plurality of retrievable digital canvasses, the plurality of retrievable digital canvasses respectively corresponding to a plurality of aggregated points of interest within a predetermined radius from a particular point of interest and included in the pointing direction of the portable device; and

superimposing digital graffiti onto the multiple digital canvasses simultaneously, the digital graffiti generated via the gesture.

13. The computer readable storage medium of claim 12, the computer readable instructions further comprising instructions for processing a photo of an area proximate to the portable device, the at least one digital canvas including at least a portion of the photo.

14. The computer readable storage device of claim 12, the computer readable instructions further comprising instructions for determining a location of the portable device, at least one digital canvas ascertained as a function of the location.

15. The computer readable storage medium of claim 12, the computer readable instructions further comprising instructions for analyzing a signal received from at least one entity proximate to the portable device, the at least one digital canvas ascertained as a function of the signal.

16. The computer readable storage device of claim 12, the computer readable instructions further comprising instructions for attaching metadata to the digital graffiti.

17. The computer readable storage device of claim 12, the computer readable instructions further comprising instructions for processing a two-dimensional trace corresponding to at least a portion of the path, the digital graffiti derived from at least a portion of the two-dimensional trace.

18. The computer readable storage device of claim 12, the computer readable instructions further comprising instructions for ascertaining a digital image corresponding to the gesture, the digital graffiti including at least a portion of the digital image.

19. The computer readable storage device of claim 18, the computer readable instructions further comprising instructions for retrieving the digital image from at least one of an external memory component accessible over a network or a library of images stored locally on the portable device.

20. The computer readable storage device of claim 12, the computer readable instructions further comprising instructions for limiting a scope depth encompassed by a given pointing interaction, the at least one endpoint within the scope depth.

21. A method, comprising:

employing a processor to execute computer executable instructions stored on a computer readable storage medium to implement the following acts;

determining an orientation of a portable device, the orientation ascertained as a function of data output by a compass included in the portable device, the data output by the compass identifying a pointing direction of the portable device;

determining a movement undergone by the portable device, the movement ascertained as a function of data output by an accelerometer unit included in the portable device;

determining a location of the portable device, the location ascertained as a function of data output by a global positioning system (GPS) unit included in the portable device;

ascertaining a gesture corresponding to the movement undergone by the portable device, the gesture ascertained as a function of at least the data output by the compass and the data output by the accelerometer unit;

selecting multiple digital canvasses from a plurality of retrievable digital canvasses, the plurality of retrievable digital canvasses respectively corresponding to a plurality of aggregated points of interest in the pointing direction of the portable device and within a predetermined radius from a particular point of interest; and

superimposing digital graffiti corresponding to the gesture onto the multiple digital canvasses simultaneously.

22. The method of claim 21, the determining a movement further comprising identifying an acceleration of the portable device during at least a portion of a path traversed by the portable device, the gesture ascertained as a function of the acceleration.