Methods and systems for content-based search

• US 9,916,396 B2
• Filed: 02/19/2013
• Issued: 03/13/2018
• Est. Priority Date: 05/11/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Hong, Sun-Gi, Park, Youngchan
• Primary Examiner(s): Gaffin, Jeffrey A
• Assistant Examiner(s): Brahmachari, Mandrita
• Application Number:
  US13/771,020
• Publication Number:
  US 20150169067A1
• Time in Patent Office: 1,848 Days
• CPC Class Codes: G06F 16/9032 Query formulation
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

A technique is provided for search. The technique includes providing content. The technique includes receiving gesture data from a user, wherein the gesture data reflects a selection of a substantially enclosed area of the display screen. The technique includes, in response to receiving the gesture information, determining one or more search criteria associated with content within the enclosed area, and providing data related to the one or more search criteria.

Claims

1. A computer-implemented method comprising:

providing content for display on a display screen of a user device;

receiving gesture data from a user, wherein the gesture data is associated with a user selection of a portion of the displayed content;

identifying, in response to receiving the gesture data, a plurality of objects in the selected portion of the display content, wherein the plurality of objects includes a first object having a first object type and a second object having a second object type;

determining one or more search queries, wherein determining the one or more search queries includes;

identifying one or more first topics from the first object and one or more second topics from the second object,

determining a respective first weight for each of the first topics and a respective second weight for each of the second topics based on a plurality of criteria including the respective object types of the first object and the second object, and

determining the one or more search queries based on the one or more first topics, the one or more second topics, the respective first weights, and the respective second weights; and

providing, in response to the one or more search queries, one or more search results for display on the display screen of the user device.

2. The method of claim 1, further comprising obtaining the provided content from one or more sources remote from the user device.

3. The method of claim 1, further comprising activating a search mode of operation prior to receiving the gesture data.

4. The method of claim 1, wherein receiving the gesture data comprises receiving user input defining the user selection of the portion of the displayed content.

5. The method of claim 1, wherein receiving the gesture data comprises sensing a path using a touch sensitive sensor.

6. The method of claim 1, wherein identifying the plurality of objects in the selected portion of the displayed content comprises parsing the selected portion of the display content provided on the display screen, the selected portion of the displayed content including text, image, audio, video, and any combination thereof.

7. The method of claim 1, further comprising:

generating, in response to receiving the gesture data from the user, one or more search criteria;

providing the one or more search criteria on the display screen of the user device;

receiving user selection of a search criterion from the one or more search criteria; and

providing, in response to the selected search criterion, one or more search results for display on the display screen of the user device.

8. The method of claim 1, wherein determining the one or more search queries further includes:

obtaining metadata associated with the selected portion of the content;

obtaining a weight for the metadata; and

determining, based on the weight for the metadata, the one or more search queries.

9. The method of claim 1, wherein determining the one or more search queries further includes:

obtaining context data associated with the selected portion of the content;

obtaining a weight for the context data; and

determining, based on the weight for the context data, the one or more search queries.

10. A system comprising:

one or more computers configured to perform operations comprising;

providing content for display on a display screen of a user device;

receiving gesture data from a user, wherein the gesture data is associated with a user selection of a portion of the displayed content;

identifying, in response to receiving the gesture data, a plurality of objects in the selected portion of the displayed content, wherein the plurality of objects includes a first object having a first object type and a second object having a second object type;

determining one or more search queries, wherein determining the one or more search queries includes;

identifying one or more first topics from the first object and one or more second topics from the second object,

determining a respective first weight for each of the first topics and a respective second weight for each of the second topics based on a plurality of criteria including the respective object types of the first object and the second object, and

determining the one or more search queries based on the one or more first topics, the one or more second topics, the respective first weights, and the respective second weights; and

providing, in response to the one or more search queries, one or more search results for display on the display screen of the user device.

11. The system of claim 10, wherein the one or more computers are configured to perform operations further comprising obtaining the provided content from one or more sources remote from the user.

12. The system of claim 10, wherein the one or more computers are configured to perform operations further comprising activating a search mode of operation prior to receiving the gesture data.

13. The system of claim 10, wherein the gesture data comprises user input defining the user selection of the portion of the displayed content.

14. The system of claim 10, wherein receiving the gesture data comprises sensing a path using a touch sensitive sensor.

15. The system of claim 10, wherein identifying the plurality of objects in the selected portion of the displayed content comprises parsing the selected portion of the displayed content provided on the display screen, the selected portion of the displayed content including text, image, audio, video, and combinations thereof.

16. The system of claim 10, wherein determining the one or more search queries further includes:

obtaining metadata associated with the selected portion of the content;

obtaining a weight for the metadata; and

determining, based on the weight for the metadata, the one or more search queries.

17. The system of claim 10, wherein determining the one or more search queries further includes:

obtaining context data associated with the selected portion of the content;

obtaining a weight for the context data; and

determining, based on the weight for the context data, the one or more search queries.

18. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

providing content for display on a display screen of a user device;

receiving gesture data from a user, wherein the gesture data is associated with a user selection of a portion of the displayed content;

identifying, in response to receiving the gesture data, a plurality of objects in the selected portion of the displayed content, wherein the plurality of objects includes a first object having a first object type and a second object having a second object type;

determining one or more search queries, wherein determining the one or more search queries includes;

identifying one or more first topics from the first object and one or more second topics from the second object,

determining a respective first weight for each of the first topics and a respective second weight for each of the second topics based on a plurality of criteria including the respective object types of the first object and the second object, and

determining the one or more search queries based on the one or more first topics, the one or more second topics, the respective first weights, and the respective second weights, and

providing, in response to the one or more search queries, one or more search results for display on the display screen of the user device.

19. The non-transitory computer-readable medium of claim 18, storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations further comprising obtaining the provided content from one or more sources remote from the user device.

20. The non-transitory computer-readable medium of claim 18, storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations further comprising activating a search mode of operation prior to receiving the gesture data.

21. The non-transitory computer-readable medium of claim 18, wherein receiving the gesture data comprises receiving user input defining the user selection of the portion of the displayed content.

22. The non-transitory computer-readable medium of claim 18, wherein receiving the gesture data comprises sensing a path using a touch sensitive sensor.

23. The non-transitory computer-readable medium of claim 18 wherein identifying the plurality of objects in the selected portion of the displayed content comprises parsing the selected portion of the displayed content provided on the display screen, the selected portion of the displayed content including text, image, audio, video, and any combination thereof.

24. The non-transitory computer-readable medium of claim 18, storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations further comprising:

generating, in response to receiving the gesture data from the user, one or more search criteria;

providing the one or more search criteria on the display screen of the user device;

receiving user selection of a search criterion from the one or more search criteria; and

providing, in response to the selected search criterion, one or more search results for display on the display screen of the user device.