COMMERCIALIZATION OPPORTUNITIES FOR INFORMATIONAL SEARCHING IN A GESTURE-BASED USER INTERFACE

• US 20130117111A1
• Filed: 08/31/2012
• Published: 05/09/2013
• Est. Priority Date: 09/30/2011
• Status: Abandoned Application

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Dyor, Matthew G., Levien, Royce A., Lord, Richard T., Lord, Robert W., Malmud, Mark A., Huang, Xuedong, Davis, Marc E.
• Application Number:
  US13/601,910
• Publication Number:
  US 20130117111A1
• Time in Patent Office: Days
• US Class Current: 705/14.54
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions

Abstract

Methods, systems, and techniques for presenting sponsor supplied content associated with commercial opportunities in a gesture-based user interface are provided. Example embodiments provide a Gesture Based Content Presentation System (GBCPS), which enables a gesture-based user interface to determine and present sponsor supplied content associated with an opportunity for commercialization related to a portion of electronic input that has been indicated by a received gesture. In overview, the GBCPS allows a portion (e.g., an area, part, etc.) of electronically presented content to be dynamically indicated by a gesture. The GBCPS examines the indicated portion in conjunction with possibly a set of (e.g., one or more) factors to determine which sponsor supplied content associated with an opportunity for commercialization to present. Once the sponsor supplied content associated with an opportunity for commercialization is determined, it is then presented to the user in conjunction with the indicated topic, object, and/or action.

Claims

1. A method in a computing system for presenting opportunities for commercialization in conjunction with browsing and/or searching for information, the method comprising:

presenting via a presentation device associated with the computing system one or more instances of electronic content containing information relating to a first topic in which a user has indicated an interest;

receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content, the indicated portion of electronic content identifying a second topic related to the first topic, an object related to the first topic, and/or an action related to the first topic;

dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action; and

presenting the determined sponsor supplied content associated with the opportunity for commercialization in conjunction with the identified first topic, second topic, object, and/or action, therein providing an opportunity for commercialization that relates to the first topic to which the user has indicated interest.

2. The method of claim 1, wherein the presenting via a presentation device associated with the computing system one or more instances of electronic content containing information relating to a first topic in which a user has indicated an interest further comprises:

presenting one or more web pages and/or portions of an electronic document.

4. The method of claim 1, wherein the presenting via a presentation device associated with the computing system one or more instances of electronic content containing information relating to a first topic in which a user has indicated an interest further comprises:

presenting electronic content containing information indicating that the user has an interest to seek knowledge, buy something, and/or seek additional information.

5. The method of claim 1, wherein the presenting via a presentation device associated with the computing system one or more instances of electronic content containing information relating to a first topic in which a user has indicated an interest further comprises:

presenting one or more instances of electronic content in response to the user submitting a query.

6. The method of claim 5, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content and/or an opportunity for commercialization that provides an answer to the query, will aid the user in answering the query, and/or that offers access to an anecdote, story, article, book, and/or document relating to the query.

9. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content further comprises:

receiving an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content identifying a second topic that is responsive to a search for further information relating to the first topic.

10. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content further comprises:

receiving an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content identifying an object and/or an action associated with a product and/or service that the user can purchase or bid on.

11. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content further comprises:

receiving an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content identifying an object and/or an action associated with a product and/or service that the user can visit or obtain more information about.

12. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content and/or an opportunity for commercialization by at least one of predicting what the user is interested in based upon historical data, looking up information, and/or based upon a statistical model.

13. The method of claim 12, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content and/or an opportunity for commercialization by predicting what the user is interested in based upon or by looking up information including historical data that includes at least one of user data, navigation data, data from other users similarly situated, related entity data, and/or values of the one or more of the set of factors.

15. The method of claim 12, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content and/or an opportunity for commercialization by using a statistical model that indicates a likelihood of at least one of where the user is likely to navigate to or a next topic, object, or action the user is likely to explore.

16. The method of claim 15, wherein the determining sponsor supplied content and/or an opportunity for commercialization by using a statistical model that indicates a likelihood of at least one of where the user is likely to navigate to or a next topic, object, or action the user is likely to explore further comprises:

determining sponsor supplied content and/or an opportunity for commercialization using a predictive statistical model that includes at least one of a decision tree, neural network, Bayesian network.

17. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content and/or an opportunity for commercialization by examination of navigation history of the user and comparing the navigation history of the user with the navigation history of other users to determine one or more likely next topics the user is likely to explore.

19. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining the sponsor supplied content associated with an opportunity for commercialization in advance of receiving an indication of the gestured input.

21. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining the sponsor supplied content associated with an opportunity for commercialization by retrieving the content from a storage device associated with the computing system.

22. The method of claim 1, further comprising:

dynamically determining the sponsor supplied content and/or the opportunity for commercialization in near real-time after receiving the user inputted gesture.

23. The method of claim 22, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining that the electronic content relates to a live event.

26. The method of claim 22, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining the sponsor supplied content and/or the opportunity for commercialization to one or more sponsors using real-time bidding.

28. The method of claim 1, wherein the presenting the determined sponsor supplied content associated with the opportunity for commercialization in conjunction with the identified first topic, second topic, object, and/or action, therein providing an opportunity for commercialization that relates to the first topic to which the user has indicated interest further comprises:

presenting the determined sponsor supplied content associated with the opportunity for commercialization in conjunction with identified first topic, second topic, object, and/or action with a time lag after the gestured input has been received.

31. The method of claim 1, further comprising:

charging a sponsor based upon a likelihood the determined sponsor supplied content and/or opportunity for commercialization will be participated in by the user.

32. The method of claim 1, further comprising:

charging a sponsor based upon presence and/or values of one or more of a set of factors.

33. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content and/or an opportunity for commercialization that provides access to an anecdote, story, article, book, and/or document.

34. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content and/or an opportunity for commercialization that provides access to a product and/or service related to identified first topic, second topic, object, and/or action.

35. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content associated with an opportunity for commercialization that provides a best match to the at least one of the identified first topic, second topic, object, and/or action.

36. The method of claim 35, wherein the determining sponsor supplied content associated with an opportunity for commercialization that provides a best match to the at least one of the identified first topic, second topic, object, and/or action further comprises:

determining which sponsor supplied content and/or opportunity for commercialization provides a cheapest price related to the identified first topic, the second topic, the object, and/or the action, a result that is closest in location, and/or a result that is most similar in content to the identified first topic, the second topic, the object, and/or the action.

45. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

receiving sponsor supplied content from an advertising server.

46. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content that includes content received from an entity other than the sponsor.

47. The method of claim 46, wherein the determining sponsor supplied content that includes content received from an entity other than the sponsor further comprises:

determining sponsor supplied content that includes content received via an interface for accessing context specific content and/or an application programming interface.

51. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining a sponsor supplied content that includes one or more of advertising content, a game, interactive entertainment, a computer-assisted competition, a bidding opportunity, a documentary, help text, an indication of price, textual content, an image, a video, and/or auditory content.

52. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

receiving an indication of a request from a not-for-profit organization as the sponsor supplied content.

53. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

receiving an indication of a person, place, or thing as the sponsor supplied content.

54. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

receiving text, an image, and/or audio as the sponsor supplied content.

55. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining sponsor supplied content that includes context specific content based at least in part on values of one or more of a set of factors.

57. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining an indication of at least one advertisement, purchase and/or an offer as the sponsor supplied content.

60. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining an indication of interactive entertainment, a role-playing game, a computer-assisted competition, and/or a bidding opportunity as the sponsor supplied content.

66. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

receiving the sponsor supplied content as at least one of a word, a phrase, an utterance, an image, a video, a pattern, an audio signal, a location, a pointer, a symbol, and/or another type of reference.

69. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining a sponsor supplied content based upon a set of factors that include context of other text, graphics, and/or objects within the presented content.

70. The method of claim 1, wherein the dynamically determining sponsor supplied content associated with an opportunity for commercialization that corresponds to at least one of the identified first topic, second topic, object, and/or action further comprises:

determining a sponsor supplied content based upon a set of factors including an attribute of the gesture, presentation device capabilities, prior history associated with the user, prior device communication history, time of day.

90. The method of claim 1, wherein the presenting the determined sponsor supplied content associated with the opportunity for commercialization in conjunction with the identified first topic, second topic, object, and/or action, therein providing an opportunity for commercialization that relates to the first topic to which the user has indicated interest further comprises:

presenting the sponsor supplied content associated with the opportunity for commercialization as a visual overlay on a portion of the presented electronic content.

101. The method of claim 1, wherein the presenting the determined sponsor supplied content associated with the opportunity for commercialization in conjunction with the identified first topic, second topic, object, and/or action, therein providing an opportunity for commercialization that relates to the first topic to which the user has indicated interest further comprises:

presenting the sponsor supplied content associated with the opportunity for commercialization in at least one of an auxiliary window, pane, frame, and/or other auxiliary presentation construct.

104. The method of claim 1, wherein the presenting the determined sponsor supplied content associated with the opportunity for commercialization in conjunction with the identified first topic, second topic, object, and/or action, therein providing an opportunity for commercialization that relates to the first topic to which the user has indicated interest further comprises:

presenting the sponsor supplied content based upon a social network associated with the user.

108. The method of claim 1, wherein the presenting the determined sponsor supplied content associated with the opportunity for commercialization in conjunction with the identified first topic, second topic, object, and/or action, therein providing an opportunity for commercialization that relates to the first topic to which the user has indicated interest further comprises:

presenting the determining sponsor supplied content in conjunction with the identified first topic, second topic, object, and/or action as not part of a purchasing activity.

116. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content further comprises:

receiving a user inputted gesture that approximates a at least one of a circle shape, an oval shape, a closed path, and/or a polygon.

120. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of the presented electronic content further comprises:

receiving an audio gesture.

128. The method of claim 1, wherein the presenting via a presentation device associated with the computing system one or more instances of electronic content containing information relating to a first topic in which a user has indicated an interest further comprises:

presenting the one or more instances of electronic content presented via a presentation device associated with at least one of a speaker, electronic reader, Braille printer, computer, notebook, tablet, wireless device, cellular phone, mobile device, hand-held device, electronic control panel, electronic display, electronic appliance, and/or wired device, mobile device, hand-held device, device embedded as part of the computing system, and/or remote device associated with the computing system.

129. The method of claim 1, further comprising:

performing the method by a client or by a server.

3. (canceled)

7-8. -8. (canceled)

14. (canceled)

18. (canceled)

20. (canceled)

24-25. -25. (canceled)

27. (canceled)

29-30. -30. (canceled)

37-44. -44. (canceled)

48-50. -50. (canceled)

56. (canceled)

58-59. -59. (canceled)

61-65. -65. (canceled)

67-68. -68. (canceled)

71-89. -89. (canceled)

91-100. -100. (canceled)

102-103. -103. (canceled)

105-107. -107. (canceled)

109-115. -115. (canceled)

117-119. -119. (canceled)

121-127. -127. (canceled)

130-390. -390. (canceled)