ANALYZING AND DISTRIBUTING BROWSING FUTURES IN A GESTURE BASED USER INTERFACE

• US 20130117105A1
• Filed: 08/29/2012
• Published: 05/09/2013
• Est. Priority Date: 09/30/2011
• Status: Abandoned Application

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Dyor, Matthew G., Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Huang, Xuedong, Davis, Marc E.
• Application Number:
  US13/598,475
• Publication Number:
  US 20130117105A1
• Time in Patent Office: Days
• US Class Current: 705/14.52
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions

Abstract

Methods, systems, and techniques for presenting auxiliary content and information regarding browsing and/or navigation futures to be used in a gesture-based user interface are provided. Example embodiments provide a Gesture Based Content Presentation System (GBCPS), which enables a gesture-based user interface to offer to one or more sponsors of content information regarding a next content to be examined by a user related to a portion of electronic input that has been indicated by a received gesture. In overview, the GBCPS allows a portion (e.g., an area, part, etc.) of electronically presented content to be dynamically indicated by a gesture. The GBCPS examines the indicated portion in conjunction with potentially a set of (e.g., one or more) factors to determine a next content and distributes information to potential sponsors. Once auxiliary content is received or determined, it is then presented to the user when the next content is navigated to.

Claims

1. A method in a computing system for analyzing browsing futures associated with gestured-based input, the method comprising:

receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system, the indicated portion of electronic content identifying an entity and/or action;

determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors;

distributing information regarding the determined next content to one or more sponsors of auxiliary content; and

receiving auxiliary content from at least one of the one or more sponsors that is presented via the presentation device upon detecting that the next content to be examined has been or is about to be navigated to by the user.

2. The method of claim 1, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining a next content by at least one of predicting based upon historical data, by looking up information, and/or based upon a statistical model.

3. The method of claim 2, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining a next content by predicting based upon historical data that includes at least one of user data, navigation data, data from other users similarly situated, related entity data, and/or values of the one or more of the set of factors.

4. The method of claim 2, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining a next content by looking up information including at least one of user data, navigation data, data from other users similarly situated, related entity data, and/or values of the one or more of the set of factors.

5. The method of claim 2, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining a next content by using a statistical model that indicates a likelihood of at least one of where the user is likely to navigate to, a next entity to explore based upon the identified identity, and/or a next action to perform based upon the identified action.

6. The method of claim 5, wherein the determining a next content by using a statistical model that indicates a likelihood of at least one of where the user is likely to navigate to, a next entity to explore based upon the identified identity, and/or a next action to perform based upon the identified action further comprises:

determining a next content using a predictive statistical model that includes at least one of a decision tree, neural network, or Bayesian network.

7. The method of claim 1, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining a next content by examination of navigation history of the user and comparing the navigation history of the user with the navigation history of other users to determine one or more likely next locations the user will navigate to.

8. The method of claim 7, wherein the determining a next content by examination of navigation history of the user and comparing the navigation history of the user with the navigation history of other users to determine one or more likely next locations the user will navigate to further comprises:

ranking the determined one or more likely next locations the user will navigate to in order to determine a next content.

9. The method of claim 1, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining before receiving an indication of a subsequent gestured input by the user indicating a next content to be examined.

10. The method of claim 1, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining a next content to be examined in near real-time.

11. The method of claim 10, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

offering the distributed information about the next content to be examined for sale or for bid.

12. The method of claim 11, wherein the receiving auxiliary content from at least one of the one or more sponsors that is presented via the presentation device upon detecting that the next content to be examined has been or is about to be navigated to by the user further comprises:

receiving an indication of a sale or bid from a selected one of the one or more sponsors;

determining auxiliary content associated with the indicated sale or bid; and

presenting the received auxiliary content associated with the sale or bid before the next content is about to be navigated to by the user.

13. The method of claim 12, wherein the determining auxiliary content associated with the indicated sale or bid further comprises:

determining auxiliary content from a stored repository of auxiliary content received prior to the receiving the indication of the sale or bid.

14. The method of claim 12, wherein the presenting the received auxiliary content associated with the sale or bid before the next content is about to be navigated to by the user further comprises:

causing content associated with an opportunity for commercialization to be presented to the user as a just-in-time opportunity for commercialization that is presented nearly simultaneously with the gestured input.

15. The method of claim 12, wherein the presenting the received auxiliary content associated with the sale or bid before the next content is about to be navigated to by the user further comprises:

causing an advertisement to be presented to the user as a just-in-time advertisement that is presented nearly simultaneously with the gestured input.

16. The method of claim 12, wherein the presenting the received auxiliary content associated with the sale or bid before the next content is about to be navigated to by the user further comprises:

causing the received auxiliary content to be presented before an action occurs in a live event.

17. The method of claim 16, wherein the causing the received auxiliary content to be presented before an action occurs in a live event further comprises:

causing the received auxiliary content to be presented right before an action in a sports event, a competition, a game, a pre-recorded live event, and/or a simultaneous transmission of a live event.

18. The method of claim 1, wherein the determining a next content to be examined by the user based upon the entity and/or action identified by the user inputted gesture and/or a set of factors further comprises:

determining a next content based upon a set of factors including at least one of similar gestured input history of one or more other users, context of other text, graphics, and/or objects within the corresponding presented content, an attribute of the gesture, presentation device capabilities, prior history associated with the user.

40. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

associating a confidence factor with the distributed information.

41. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information that is one or more of a link, a resource descriptor, a URI, a description of the content or type of content, information regarding the user, an organization, or an event, information associated with a web site or browser.

42. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing the information in exchange for compensation.

43. The method of claim 42, wherein the distributing the information in exchange for compensation further comprises:

distributing the information in exchange for compensation that comprises at least one of money, services, and/or barter.

44. The method of claim 1, further comprising:

charging based upon a likelihood that the determined next content to be examined will be examined by the user.

45. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

offering the distributed information about the next content to be examined for sale or for bid.

46. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information to an entity that provides the auxiliary content.

47. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information to a sponsor representing an entity that provides the auxiliary content.

48. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information to a sponsor that receives auxiliary content from a third party.

49. The method of claim 48, wherein the distributing information to a sponsor that receives auxiliary content from a third party further comprises:

receiving from the third party one or more of advertising content, a game, interactive entertainment, a computer-assisted competition, a bidding opportunity, a documentary, help text, an indication of price, textual content, an image, a video, and/or auditory content.

50. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information to a sponsor that receives auxiliary content from a third party via a programming interface for accessing context specific content.

51. The method of claim 50, wherein the distributing information to a sponsor that receives auxiliary content from a third party via a programming interface for accessing context specific further comprises:

distributing information to a sponsor that receives context specific content from a third party based at least in part on values of one or more of the set of factors.

52. The method of claim 50, wherein the distributing information to a sponsor that receives auxiliary content from a third party via a programming interface for accessing context specific further comprises:

distributing information to a sponsor that receives auxiliary content from at least one of an advertising server, an advertising system, a dictionary, an encyclopedia, and/or a translation tool.

53. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information to one or more entities that are separate from an entity that provides the presented electronic content in order to present competing auxiliary content.

54. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information to one or more sponsors that are competitors.

57. The method of claim 1, wherein the distributing information regarding the determined next content to one or more sponsors of auxiliary content further comprises:

distributing information to a sponsor that is an entity separate from an entity that provided the presented electronic content.

58. The method of claim 1, wherein the receiving auxiliary content from at least one of the one or more sponsors that is presented via the presentation device upon detecting that the next content to be examined has been or is about to be navigated to by the user further comprises:

receiving an indication of at least one of an advertisement, interactive entertainment, a role-playing game, a computer-assisted competition, a bidding opportunity, an indication of a purchase, and/or an indication of an offer as the auxiliary content.

67. The method of claim 1, wherein the receiving auxiliary content from at least one of the one or more sponsors that is presented via the presentation device upon detecting that the next content to be examined has been or is about to be navigated to by the user further comprises:

causing the received auxiliary content to be presented as a visual overlay on a portion of the presented electronic content or in at least one of an auxiliary window, pane, frame, and/or other auxiliary presentation construct.

81. The method of claim 1, wherein the receiving auxiliary content from at least one of the one or more sponsors that is presented via the presentation device upon detecting that the next content to be examined has been or is about to be navigated to by the user further comprises:

causing the received auxiliary content to be presented based upon a social network associated with the user.

82. The method of claim 1, wherein the receiving auxiliary content from at least one of the one or more sponsors that is presented via the presentation device upon detecting that the next content to be examined has been or is about to be navigated to by the user further comprises:

receiving auxiliary content by receiving at least one of a location, a pointer, a symbol, a word, a phrase, an utterance, an image, a video, a pattern, an audio signal, and/or another type of reference to auxiliary content.

84. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system, the indicated portion of electronic content identifying an entity and/or action further comprises:

receiving an indication of a user inputted gesture that identifies an entity and/or action that is a product and/or service, is a request from a not-for-profit organization, or that is a person, place, or thing.

87. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system, the indicated portion of electronic content identifying an entity and/or action further comprises:

receiving an indication of a user inputted gesture that corresponds to an indicated portion of the electronic content that contains text an image, or audio for identifying the entity and/or action.

90. The method of claim 1, wherein the receiving auxiliary content from at least one of the one or more sponsors that is presented via the presentation device upon detecting that the next content to be examined has been or is about to be navigated to by the user further comprises:

presenting the auxiliary content as at least one of a portion of the next content, a portion of a web site, as part of an electronic document, an image, text, and/or an utterance.

94. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system, the indicated portion of electronic content identifying an entity and/or action further comprises:

receiving a user inputted gesture that approximates a at least one of a circle shape, an oval shape, a closed path, and/or a polygon.

98. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system, the indicated portion of electronic content identifying an entity and/or action further comprises:

receiving an audio gesture.

102. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system, the indicated portion of electronic content identifying an entity and/or action further comprises:

receiving the indication of the user inputted gestured from an input device that comprises at least one of a mouse, a touch sensitive display, a wireless device, a human body part, a microphone, a stylus, and/or a pointer.

104. The method of claim 1, wherein the receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system, the indicated portion of electronic content identifying an entity and/or action further comprises:

receiving a user inputted gesture that corresponds to an indicated portion of electronic content presented via at least one of a browser, speaker, electronic reader, Braille printer, mobile device, a hand-held device, a device embedded as part of the computing system, and/or a remote device associated with the computing system and/or presented via a presentation device associated with at least one of a computer, notebook, tablet, wireless device, cellular phone, mobile device, hand-held device, electronic control panel, electronic display, electronic appliance, and/or wired device.

107. The method of claim 1, further comprising:

performing the method by a client or by a server.

19-39. -39. (canceled)

55-56. -56. (canceled)

59-66. -66. (canceled)

68-80. -80. (canceled)

83. (canceled)

85-86. -86. (canceled)

88-89. -89. (canceled)

91-93. -93. (canceled)

95-97. -97. (canceled)

99-101. -101. (canceled)

103. (canceled)

105. (canceled)

106. (canceled)

108-324. -324. (canceled)