PERSISTENT GESTURELETS

• US 20130085847A1
• Filed: 10/07/2011
• Published: 04/04/2013
• Est. Priority Date: 09/30/2011
• Status: Abandoned Application

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Dyor, Matthew G., Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Huang, Xuedong, Davis, Marc E.
• Application Number:
  US13/269,466
• Publication Number:
  US 20130085847A1
• Time in Patent Office: Days
• US Class Current: 705/14.49
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence

Abstract

Methods, systems, and techniques for automatically providing auxiliary content are provided. Example embodiments provide a Dynamic Gesturelet Generation System (DGGS), which enables one to dynamically define a gesturelet for navigating to or presenting other content, or for performing some behavior. In overview, the DGGS allows a portion of electronically presented content to be dynamically indicated by a gesture. The indicated portion can then be formed into a gesturelet and used by the DGGS to navigate to other content, perform a set of instructions, present auxiliary content, or for other purposes. Gesturelets may be stored persistently and associated with some auxiliary content, such as a set of behaviors, advertisements, competitions, supplemental material or images, or the like. Later, when an action in the system occurs such that the persistent representation is retrieved, the behavior associated with the persistent representation is performed and the associated auxiliary content presented.

Claims

1. A method in a computing system for automatically providing auxiliary content, comprising:

receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system;

generating and storing a persistent representation of the indicated portion, wherein the persistent representation is accessible separately from the electronic content;

receiving one or more indicators of auxiliary content;

associating the generated persistent representation with the one or more indicators of auxiliary content; and

upon receiving notification that the generated persistent representation has been retrieved, determining possible content to be presented, the determining based upon the indicated portion represented by the retrieved persistent representation and the auxiliary content associated with the retrieved persistent representation.

2. The method of claim 1 wherein the generated persistent representation is a uniform resource identifier.

3. The method of claim 1 wherein the generated persistent representation is stored as a uniform resource identifier.

4. The method of claim 1 wherein the generated persistent representation is stored in at least one of a file, a memory, and/or a data repository.

5. The method of claim 1 wherein the generated persistent representation is stored as a network resource.

6. The method of claim 1 wherein the associating the generated persistent representation with the one or more indicators of auxiliary content further comprises:

associating the generated persistent representation with an advertisement.

7. The method of claim 6 wherein the advertisement is supplied by an entity other than an entity associated with the presented electronic content, is supplied by an entity that competes against an entity associated with the presented electronic content, is selected from a plurality of advertisements, and/or is supplied by an entity associated with the presented electronic content.

11. The method of claim 1 wherein the associating the generated persistent representation with the one or more indicators of auxiliary content further comprises:

associating the generated persistent representation with an opportunity for commercialization.

12. The method of claim 11 wherein the opportunity for commercialization is at least one of an advertisement, interactive entertainment, a role-playing game, a computer-assisted competition, and/or effectuated by bidding.

17. The method of claim 1 wherein the associating the generated persistent representation with the one or more indicators of auxiliary content further comprises:

associating the generated persistent representation with information supplemental to the presented electronic content.

18. The method of claim 1 wherein the associating the generated persistent representation with the one or more indicators of auxiliary content further comprises:

associating the generated persistent representation with a purchase and/or an offer.

19. The method of claim 18 wherein the purchase and/or an offer is for at least one of information, an item for sale, a service for offer, a service for sale, a prior purchase of the user, a current purchase, and/or a purchase of someone that is part of a social network of the user.

25. The method of claim 1 wherein the input device is at least one of a mouse, a touch sensitive display, a wireless device, a human body part, a microphone, a stylus, and/or a pointer.

26. The method of claim 1 wherein the user inputted gesture approximates a circle shape.

27. The method of claim 1 wherein the user inputted gesture approximates at least one of an oval shape, a closed path, and/or a polygon.

28. The method of claim 1 wherein the user inputted gesture is an audio gesture.

29. The method of claim 28 wherein the audio gesture is at least one of a spoken word or phrase and/or a direction.

31. The method of claim 1 wherein the indicated portion of the presented electronic content includes at least a word or a phrase.

32. The method of claim 1 wherein the indicated portion of the presented electronic content includes at least a graphical object, image, and/or icon.

33. The method of claim 1 wherein the indicated portion of the presented electronic content includes an utterance.

34. The method of claim 1 wherein the indicated portion of the presented electronic content comprises non-contiguous parts or contiguous parts.

36. The method of claim 1 wherein receiving one or more indicators of auxiliary content further comprises:

receiving one or more indicators of auxiliary content that is based upon the indicated portion.

37. The method of claim 1 wherein the determining possible content to be presented is based upon a set of criteria.

38. The method of claim 37 wherein the set of criteria includes context of other text, graphics, and/or objects within the presented electronic content.

39. The method of claim 37 wherein the set of criteria includes an attribute of the gesture.

40. The method of claim 39 wherein the attribute of the gesture is at least one of a size of the gesture, a direction of the gesture, a color, and/or a measure of steering of the gesture.

46. The method of claim 37 wherein the set of criteria includes prior history associated with the user.

47. The method of claim 46 wherein the prior history includes at least one of prior search history, prior navigation history, prior purchase history, and/or demographic information associated with the user prior search history.

54. The method of claim 46 wherein the prior history is used to disambiguate the possible content to determine a target content.

55. The method of claim 1 wherein the presentation device is at least one of a browser, a mobile device, a hand-held device, embedded as part of the computing system, a remote display associated with the computing system, a speaker, or a Braille printer.

61. The method of claim 1 wherein the determining possible content to be presented further comprises:

disambiguating the possible content to determine a target content to be presented.

62. The method of claim 61, further comprising:

causing the target content to be presented on the presentation device.

63. The method of claim 61 wherein the disambiguating the possible content to determine a target content to be presented further comprises:

presenting the one or more indicators of possible content and receiving a selected indicator of the one or more indicators of content to determine the target content.

64. The method of claim 61 wherein the disambiguating the possible content to determine a target content to be presented further comprises:

determining a default target content to be presented.

65. The method of claim 64 wherein the default target content may be overridden by a user.

66. The method of claim 61 wherein the disambiguating the possible content to determine a target content to be presented further comprises:

utilizing syntactic and/or semantic rules to aid in determining the target content.

67. The method of claim 61, further comprising:

associating the generated persistent representation with the target content.

68. The method of claim 61 wherein the target content is presented as an overlay.

70. The method of claim 68 wherein the overlay is made visible by appearing as though the pane is sliding from one side of the presentation device onto the presented document.

71. The method of claim 61 wherein the target content includes at least one advertisement.

72. The method of claim 71 wherein the advertisement is provided by at least one of an entity separate from the entity that provided the presented electronic content, a competitor entity, and/or an entity associated with the presented electronic content.

74. The method of claim 71 where the advertisement is selected from a plurality of advertisements.

76. The method of claim 61 wherein the target content includes supplemental information.

77. The method of claim 61 wherein the target content is displayed in an auxiliary window, pane, frame, or other auxiliary display construct.

78. The method of claim 61 wherein the target content is displayed in an auxiliary window juxtaposed to the other content being displayed.

79. The method of claim 61 wherein the target content comprises at least one of computer code, a web page, an electronic document, an electronic version of a paper document.

83. The method of claim 1 performed by a client or by a server.

8-10. -10. (canceled)

13-16. -16. (canceled)

20-24. -24. (canceled)

30. (canceled)

35. (canceled)

41-45. -45. (canceled)

48-53. -53. (canceled)

56-60. -60. (canceled)

69. (canceled)

73. (canceled)

75. (canceled)

80-82. -82. (canceled)

84-242. -242. (canceled)