Iterative image search algorithm informed by continuous human-machine input feedback

• US 10,467,267 B2
• Filed: 08/28/2017
• Issued: 11/05/2019
• Est. Priority Date: 08/15/2014
• Status: Active Grant

• Current Assignee: Ask Sydney, LLC
• Original Assignee: Paul Lawrence Epstein, Sydney Nicole Epstein
• Inventors: Epstein, Sydney Nicole, Epstein, Paul Lawrence
• Primary Examiner(s): Pond, Robert M
• Application Number:
  US15/688,362
• Publication Number:
  US 20170357715A1
• Time in Patent Office: 799 Days
• Field of Search: 705 26, 705 27
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences

Abstract

System and computer-implemented method of analyzing tags associated with a sequence of images presented to a user to present a current interest of the user is disclosed. An image from among a plurality of images is presented on an electronic display. The image is associated with a set of tags. An input is received indicating a user'"'"'s preference for the image. A plurality of tags is processed based on the preference and the set of tags to determine a next set of tags from the plurality of tags. A next image is determined from the plurality of images based on the next set of tags. The next image represents a physical object, different from a physical object represented by the previous image. A sequence of images is generated by repeating the above process with the next image in place of the previous image for present a user'"'"'s current interest.

Claims

1. A computer-implemented method for an improved iterative image search engine informed by human-machine input feedback, the method comprising the steps of:

initiating, using one or more computers, a search session in response to receiving an input from a human-machine interface device associated with a computer terminal having or operatively coupled to a video display device;

retrieving, using at least one of the one or more computers, a set of digital images, each digital image associated with a set of tags from among a plurality of tags indicating one or more attributes or aspects of an object featured in the digital image;

causing to be displayed, by the video display device, a next digital image from the set of digital images;

repeating, a plurality of times until the search session ends, the following steps of;

responsive to the causing to be displayed the next digital image, receiving, via the human-machine interface device, one of at least two input options, the at least two input options including a favorable indication of the next digital image and an unfavorable indication of the next digital image;

analyzing, using at least one of the one or more computers, the set of tags associated with the next digital image to determine a subsequent set of tags that are to be associated with a subsequent digital image having at least a probable chance of being favorably indicated by a user, wherein the determining the subsequent set of tags is based on, responsive to the one of at least two input options selected via the human-machine interface device being the favorable indication, a weighting of tags to be included in the subsequent set of tags;

responsive to the one of at least two input options selected via the human-machine interface device being the unfavorable indication, removing at least one tag of the set of tags associated with the next digital image from the plurality of tags for a remainder of the search session; and

causing to be displayed, by the video display device, the subsequent digital image as the next digital image; and

ending the search session in response to (a) receiving a further input via the human-machine interface device such that the next digital image displayed on the video display device is a final digital image of the search session, (b) the repeating occurring a predetermined number of times, (c) there remaining no further tags from the plurality of tags to select the subsequent digital image, or (d) there remaining no further digital images from the set of digital images to select the subsequent digital image,

wherein each one of the at least two input options is received at least once during the search session.

2. The method of claim 1, further comprising:

responsive to retrieving the set of digital images, selecting, by at least one of the one or more computers, and causing to be displayed, by the video display device, a digital image of the set of digital images as a first digital image displayed.

3. The method of claim 2, wherein the first digital image displayed is selected based on a comparison between a set of tags associated with the first digital image displayed and information in a user profile associated with the user.

4. The method of claim 2, wherein the first digital image displayed is selected at random from the set of digital images.

5. The method of claim 2, wherein the first digital image displayed is selected based on an input from the human-machine interface device responsive to the user inputting a specific tag included within the plurality of tags, one or more words associated with the specific tag, or a combination thereof.

6. The method of claim 1, wherein the at least two input options further include a neutral indication of the next digital image.

7. The method of claim 1 wherein the at least one tag removed from the plurality of tags is not associated with an immediately preceding digital image displayed as the next digital image.

8. The method of claim 1, responsive to the one of at least two input options selected via the human-machine interface device being the favorable indication, the method further comprising adding at least one tag to the set of tags associated with the next digital image to determine the subsequent set of tags.

9. The method of claim 1, further comprising:

responsive to receiving the further input, causing to be displayed, by the video display device, a list of physical entities proximate to a location of the user and (i) associated with the final digital image, (ii) an object featured in the final digital image, or a combination thereof.

10. The method of claim 9, further comprising:

receiving, via the human-machine interface device, an input by the user selecting one of the physical entities provided in the list of physical entities; and

causing to be displayed, by the video display device, a user interface element displaying a profile associated with the selected physical entity.

11. The method of claim 1, wherein the weighting of the tags is based on a number of times each tag of the set of tags to be associated with the subsequent digital image is associated with the at least two input options.

12. The method of claim 1, wherein the weighting of the tags is based on a number of times each tag of the set of tags to be associated with the subsequent digital image is associated with the favorable indication of the at least two input options.