GESTURE BASED SEARCH SYSTEM

• US 20130085848A1
• Filed: 10/28/2011
• Published: 04/04/2013
• Est. Priority Date: 09/30/2011
• Status: Abandoned Application

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Dyor, Matthew G., Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Huang, Xuedong, Davis, Marc E.
• Application Number:
  US13/284,673
• Publication Number:
  US 20130085848A1
• Time in Patent Office: Days
• US Class Current: 705/14.49
• CPC Class Codes: G06F 16/332 Query formulation
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

Methods, systems, and techniques for automatically initiating a search to present auxiliary content in a gesture based input system are provided Example embodiments provide a Gesture Based Search System (GBSS), which enables a gesture-based user interface to invoke (e.g., execute, generate, initiate, perform, or cause to be executed, generated, initiated, performed, or the like) a search related to an portion of electronic input that has been indicated by a received gesture. In overview, the GBSS allows a portion (e.g., an area, part, or the like) of electronically presented content to be dynamically indicated by a gesture. The GBSS then examines the indicated portion in conjunction with a set of (e.g., one or more) factors to determine input to a search. The search is then automatically initiated with the determined source input. Once search result content is determined, the result content is then presented to the user.

Claims

1. A method in a computing system for automatically initiating a search, comprising:

receiving, from an input device capable of providing gesture input, an indication of a user inputted gesture that corresponds to an indicated portion of electronic content presented via a presentation device associated with the computing system;

determining by inference, based upon content contained within the indicated portion of the presented electronic content and a set of factors, an indication of source input for the search;

automatically initiating a search of a designated body of electronic content using the indicated source input to obtain search result content; and

presenting the search result content in conjunction with the corresponding presented electronic content.

2. The method of claim 1 wherein the indicated source input comprises at least one of a word, a phrase, an utterance, an image, a video, a pattern, or an audio signal.

5. The method of claim 1 wherein the content contained within the indicated portion of electronic content includes an audio portion.

6. The method of claim 1 wherein the content contained within the indicated portion of electronic content includes at least a word or a phrase.

7. The method of claim 1 wherein the content contained within the indicated portion of electronic content includes at least a graphical object, image, and/or icon.

8. The method of claim 1 wherein the content contained within the indicated portion of electronic content includes an utterance.

9. The method of claim 1 wherein the content contained within the indicated portion of electronic content comprises non-contiguous parts or contiguous parts.

10. The method of claim 1 wherein the content contained within the indicated portion of electronic content is determined using syntactic and/or semantic rules.

11. The method of claim 1 wherein the set of factors are associated with weights that are taken into consideration in determining the indication of source input.

12. The method of claim 1 wherein the set of factors includes context of other text, audio, graphics, and/or objects within the presented electronic content.

13. The method of claim 1 wherein the set of factors includes an attribute of the gesture.

14. The method of claim 13 wherein the attribute of the gesture is at least one of a size of the gesture, a direction of the gesture, a color, and/or a measure of steering of the gesture.

21. The method of claim 1 wherein the set of factors includes presentation device capabilities.

24. The method of claim 1 wherein the set of factors includes at least one of prior device communication history, time of day, and/or prior history associated with the user.

27. The method of claim 24 wherein the prior history associated with the user includes at least one of prior search history, prior navigation history, prior purchase history, and/or demographic information associated with the user.

32. The method of claim 1 wherein the set of factors includes a received selection from a context menu.

33. The method of claim 32 wherein the context menu includes a plurality of actions and/or entities derived from a set of rules used to convert one or more nouns that relate to the indicated portion into corresponding verbs.

35. The method of claim 32 wherein the context menu includes actions that specify some form of buying or shopping, sharing, and/or exploring or obtaining information.

36. The method of claim 32 wherein the context menu includes an action to find, to share, and/or to obtain information about a better <

entity>

, wherein <

entity>

is an entity encompassed by the indicated portion of the presented electronic content.

39. The method of claim 32 wherein the context menu includes one or more comparative actions.

40. The method of claim 39 wherein the comparative actions of the context menu include at least one of an action to obtain an entity sooner, an action to purchase an entity sooner, or an action to find a better deal.

42. The method of claim 1 wherein determining by inference, based upon content contained within the indicated portion of the presented electronic content and a set of factors, an indication of source input for the search further comprises:

disambiguating possible source input by presenting one or more indicators of possible source input and receiving a selected indicator to one of the presented one or more indicators of possible source input to determine the indication of source input for the search.

45. The method of claim 1 wherein determining by inference, based upon content contained within the indicated portion of the presented electronic content and a set of factors, an indication of source input for the search further comprises:

disambiguating possible source input utilizing syntactic and/or semantic rules to aid in determining the source input for the search.

46. The method of claim 1, wherein the search result content comprises content that corresponds to a plurality of source inputs.

47. The method of claim 1 wherein the indicated source input is associated with a persistent state and/or a purchase.

48. The method of claim 47 wherein the persistent state is a uniform resource identifier.

50. The method of claim 1 wherein the designated body of electronic content is any page or object accessible over a network.

53. The method of claim 1, the automatically initiating a search of a designated body of electronic content using the indicated source input to obtain search result content further comprising automatically initiating a search of the designated body of electronic content using an off-the-shelf search engine and/or a keyword search engine.

55. The method of claim 1 wherein the search result content includes an opportunity for commercialization.

56. The method of claim 55 wherein the opportunity for commercialization is an advertisement.

57. The method of claim 56 wherein the advertisement is provided by at least one of:

an entity separate from the entity that provided the presented electronic content;

a competitor entity; and

/or an entity associated with the presented electronic content.

59. The method of claim 55 wherein the advertisement is at least one of interactive entertainment, a role-playing game, a computer-assisted competition and/or a bidding opportunity, and/or a purchase and/or an offer.

65. The method of claim 1 wherein the search result includes supplemental information to the presented electronic content.

66. The method of claim 1 wherein the search result is at least one of a web page, an electronic document, and/or an electronic version of a paper document.

67. The method of claim 1 wherein the search result content is presented as an overlay on top of the presented electronic content.

69. The method of claim 67 wherein the overlay is made visible by causing a pane to appear as though the pane is caused to slide from one side of the presentation device onto the presented electronic content.

70. The method of claim 1 wherein the search result content is presented in an auxiliary window, pane, frame, or other auxiliary display construct.

72. The method of claim 1 wherein the input device is at least one of a mouse, a touch sensitive display, a wireless device, a human body part, a microphone, a stylus, and/or a pointer.

73. The method of claim 1 wherein the user inputted gesture approximates at least one of a circle shape, an oval shape, a closed path, and/or a polygon.

77. The method of claim 1 wherein the user inputted gesture is an audio gesture.

81. The method of claim 1 wherein the presentation device is at least one of a browser, a mobile device, a hand-held device, embedded as part of the computing system, a remote display associated with the computing system, a speaker, or a Braille printer.

82. The method of claim 1 wherein the presented electronic content is at least one of code, a web page, an electronic document, an electronic version of a paper document, an image, a video, an audio and/or any combination thereof.

83. The method of claim 1 wherein the computing system comprises at least one of a computer, notebook, tablet, wireless device, cellular phone, mobile device, hand-held device, and/or wired device.

84. The method of claim 1 performed by a client or by a server.

3-4. -4. (canceled)

15-20. -20. (canceled)

22-23. -23. (canceled)

25-26. -26. (canceled)

28-31. -31. (canceled)

34. (canceled)

41. The method of claim 34 wherein the context menu is presented as at least one of a pop-up menu, an interest wheel, a rectangular shaped user interface element, or a non-rectangular shaped user interface element.

37-38. -38. (canceled)

43-44. -44. (canceled)

49. (canceled)

51-52. -52. (canceled)

54. (canceled)

58. (canceled)

60-62. -62. (canceled)

68. (canceled)

71. (canceled)

74-76. -76. (canceled)

78-80. -80. (canceled)

85-226. -226. (canceled)