Lexicon based systems and methods for intelligent media search

• US 9,652,558 B2
• Filed: 05/18/2015
• Issued: 05/16/2017
• Est. Priority Date: 12/28/2012
• Status: Active Grant

• Current Assignee: Shutterstock Incorporated
• Original Assignee: Shutterstock Incorporated
• Inventors: Smiling, Eric J., Rodland, Andrew
• Primary Examiner(s): Vy, Hung T
• Application Number:
  US14/714,416
• Publication Number:
  US 20150248428A1
• Time in Patent Office: 729 Days
• Field of Search: 707770, 707707, 707722, 707759, 707765, 707769, 707777
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/53 Querying
• CPC Class Codes: G06F 16/90324 using system suggestions
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation

Abstract

A computer image search system for rapid retrieval of media files images corresponding to a sequence of input display commands, the system comprising: a programmable data processor operating under the control of a program to convert the display commands into data entries in an array of multi-bit data characters and words, each entry of the array corresponding to a set of descriptions of the image to be displayed; and a scanned-raster display device for generating illuminated points on a display surface in response to applied data signals causing the programmable data processor to perform the following operations: starting an indexer and loading an autocomplete data file; and performing operations until each media type M in an array of available media type is processed.

Claims

1. A computer image search system for rapid retrieval of media files images corresponding to a sequence of input display commands, the system comprising:

a programmable data processor operating under control of a program to convert display commands into data entries in an array of multi-bit data characters and words, each entry of the array corresponding to a set of descriptions of the image to be displayed; and

a scanned-raster display device for generating illuminated points on a display surface in response to applied data signals causing the programmable data processor to perform the following operations;

starting an indexer and loading an autocomplete data file; and

performing the following operations until each media type M in an array of available media type is processed;

spawning a worker process for a given media type M; and

until each spoken language in the autocomplete data file is processed;

identifying a next spoken language L in the autocomplete data file, and

processing media type M and spoken language L, if the identified next spoken language L is supported by the system.

2. The system of claim 1, wherein processing media type M and spoken language L comprises performing the following operations:

starting a media type processor;

performing the following operations until each of the prefixes P in an autocomplete index for spoken language L is processed;

determining a list of suggestions for prefix P in the autocomplete index;

removing prefix P from the list of suggestions, and

adding prefix P to the beginning of the list of suggestions, if either prefix P is a previously seen suggestion, or if prefix P is one of the suggestion in the list of suggestions; and

removing all but the first N items from the list of suggestions, based on a predefined criterion, wherein N indicates a maximum number of suggestions in the list of suggestions.

3. The system of claim 2, wherein the predefined criterion comprises a step to remove all but the first N items from the list of suggestions, if a number of items in the list of suggestions is greater than N.

4. The system of claim 1, further comprising the step of processing each suggestion in the list of suggestions by performing the following operations:

initiating a language processor;

determining if a suggestion S in the list of suggestions is not processed, if so then determining if the suggestion S exists in a first database;

storing a pointer to the suggestion S in a second database, if the suggestion S exists in the first database;

retrieving search results for the suggestion S from a search engine and retrieving a list of related terms for suggestion S from a related search service, if the suggestion S does not exist in the first database;

determining if at least one related term from the retrieved list of related terms remains unprocessed, if so then retrieving search results for an unprocessed related term from the search engine; and

encoding a search result, a list of related terms, and a retrieved search result as a media file set, and storing the media file set in the first database while storing a pointer to the media file set in the second database.

5. The system of claim 4, wherein the second database is indexed by a media type, a spoken language type and a prefix type.

6. A computer-implemented method for rapid retrieval of media files images corresponding to a sequence of input display commands, the method comprising:

starting an indexer and loading an autocomplete data file; and

performing the following operations until each media type M in an array of available media type is processed;

spawning a worker process for a given media type M; and

until each spoken language in the autocomplete data file is processed;

identifying a next spoken language L in the autocomplete data file, and

processing media type M and spoken language L, if the identified next spoken language L is supported by the system.

7. The method of claim 6, wherein processing media type M and spoken language L comprises:

starting a media type processor;

performing the following steps until each of the prefixes P in an autocomplete index for spoken language L is processed;

determining a list of suggestions for prefix P in the autocomplete index;

removing prefix P from the list of suggestions, and

adding prefix P to the beginning of the list of suggestions, if either prefix P is a previously seen suggestion, or if prefix P is one of the suggestion in the list of suggestions; and

removing all but the first N items from the list of suggestions, based on a predefined criterion, wherein N indicates a maximum number of suggestions in the list of suggestions.

8. The method of claim 7, wherein the predefined criterion comprises a step to remove all but the first N items from the list of suggestions, if a number of items in the list of suggestions is greater than N.

9. The method of claim 6, further comprising processing each suggestion in the list of suggestions by:

initiating a language processor;

determining if a suggestion S in the list of suggestions is not processed, if so then determining if the suggestion S exists in a first database;

storing a pointer to the suggestion S in a second database, if the suggestion S exists in the first database;

retrieving search results for the suggestion S from a search engine and retrieving a list of related terms for suggestion S from a related search service, if the suggestion S does not exist in the first database;

determining if at least one related term from the retrieved list of related terms remains unprocessed, if so then retrieving search results for an unprocessed related term from the search engine; and

encoding a search result, a list of related terms, and a retrieved search result as a media file set, and storing the media file set in the first database while storing a pointer to the media file set in the second database.

10. The method of claim 9, wherein the second database is indexed by a media type, a spoken language type and a prefix type.

11. A non-transitory machine-readable storage medium comprising machine-readable instructions for causing a processor to execute a method for rapid retrieval of media files images corresponding to a sequence of input display commands, the method comprising:

starting an indexer and loading an autocomplete data file; and

performing the following operations until each media type M in an array of available media type is processed;

spawning a worker process for a given media type M; and

until each spoken language in the autocomplete data file is processed;

identifying a next spoken language L in the autocomplete data file, and

processing media type M and spoken language L, if the identified next spoken language L is supported by the system.

12. The non-transitory machine-readable storage medium of claim 11, wherein processing media type M and spoken language L comprises:

starting a media type processor;

performing the following steps until each of the prefixes P in an autocomplete index for spoken language L is processed;

determining a list of suggestions for prefix P in the autocomplete index;

removing prefix P from the list of suggestions, and

adding prefix P to the beginning of the list of suggestions, if either prefix P is a previously seen suggestion, or if prefix P is one of the suggestion in the list of suggestions; and

removing all but the first N items from the list of suggestions, based on a predefined criterion, wherein N indicates a maximum number of suggestions in the list of suggestions.

13. The non-transitory machine-readable storage medium of claim 12, wherein the predefined criterion comprises a step to remove all but the first N items from the list of suggestions, if a number of items in the list of suggestions is greater than N.

14. The non-transitory machine-readable storage medium of claim 11, further comprising processing each suggestion in the list of suggestions by:

initiating a language processor;

determining if a suggestion S in the list of suggestions is not processed, if so then determining if the suggestion S exists in a first database;

storing a pointer to the suggestion S in a second database, if the suggestion S exists in the first database;

retrieving search results for the suggestion S from a search engine and retrieving a list of related terms for suggestion S from a related search service, if the suggestion S does not exist in the first database;

determining if at least one related term from the retrieved list of related terms remains unprocessed, if so then retrieving search results for an unprocessed related term from the search engine; and

encoding a search result, a list of related terms, and a retrieved search result as a media file set, and storing the media file set in the first database while storing a pointer to the media file set in the second database.

15. The non-transitory machine-readable storage medium of claim 14, wherein the second database is indexed by a media type, a spoken language type and a prefix type.