Transmitting card objects based on categorized and scraped data
First Claim
1. A server comprising:
- a network communication device;
a storage device comprising;
a category data store that stores category records corresponding with data categories, each of the stored category records comprising a category identifier (ID) that identifies the category record and a uniform resource locator (URL) pattern associated with the data category,an entity data store that stores entity records, anda card data store that stores card records; and
a processing device that executes computer-readable instructions that, if executed by the processing device, cause the processing device to;
receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL),compare the URL included in the data with the URL patterns stored in the category data store, one of the URL patterns indicating a portion of the URL,determine a data category of the data based on the comparison of the URL with the URL pattern,determine a data scraper based on the determined data category of the data, the determined data scraper comprising a scraper configuration that enables the determined data scraper to extract information from the web page and/or the native application,scrape the web page and/or the native application by extracting information from the web page and/or the native application using the determined data scraper,populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data,receive a card request, the card request comprising one or more search terms and/or contextual data,determine a card record from the card data store based on the received card request,generate a card object based on the determined card record, andtransmit the generated card object via the network communication device.
4 Assignments
0 Petitions
Accused Products
Abstract
A server configured to receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL); compare the URL included in the data with URL patterns stored in a category data store; determine a data category of the data based on the comparison; determine a data scraper based on the data category, the data scraper comprising a scraper configuration that enables the data scraper to extract information from the web page and/or the native application; scrape the web page and/or the native application by extracting information from the web page and/or the native application using the data scraper; store the extracted information in one or more data stores; used the stored information to provide search results and/or card objects.
-
Citations
30 Claims
-
1. A server comprising:
-
a network communication device; a storage device comprising; a category data store that stores category records corresponding with data categories, each of the stored category records comprising a category identifier (ID) that identifies the category record and a uniform resource locator (URL) pattern associated with the data category, an entity data store that stores entity records, and a card data store that stores card records; and a processing device that executes computer-readable instructions that, if executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL), compare the URL included in the data with the URL patterns stored in the category data store, one of the URL patterns indicating a portion of the URL, determine a data category of the data based on the comparison of the URL with the URL pattern, determine a data scraper based on the determined data category of the data, the determined data scraper comprising a scraper configuration that enables the determined data scraper to extract information from the web page and/or the native application, scrape the web page and/or the native application by extracting information from the web page and/or the native application using the determined data scraper, populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data, receive a card request, the card request comprising one or more search terms and/or contextual data, determine a card record from the card data store based on the received card request, generate a card object based on the determined card record, and transmit the generated card object via the network communication device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A server comprising:
-
a network communication device; a storage device comprising; a category data store that stores category records corresponding with data categories, each of the category records comprising a category identifier (ID) that identifies the category record and a structural pattern associated with the data category, the structural pattern indicating the structure of a web page and/or a native application, an entity data store that stores entity records, and a card data store that stores card records; and a processing device that executes computer-readable instructions that, if executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising metadata that indicates a structure of the web page and/or the native application, compare the structure indicated by the metadata with the structural patterns stored in the category data store, determine a data category of the data based on the comparison of the metadata with the structural patterns, determine a data scraper based on the determined data category of the data, the determined data scraper comprising a scraper configuration that enables the determined data scraper to extract information from the web page and/or the native application, scrape the web page and/or the native application for scraped data by extracting information from the web page and/or the native application using the determined data scraper, populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data, receive a card request, the card request comprising one or more search terms and/or contextual data, determine a card record from the card data store based on the received card request, generate a card object based on the determined card record, and transmit the generated card object via the network communication device. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A server comprising:
-
a network communication device; a storage device comprising; a category data store that stores category records corresponding with data categories, each of the category records comprising a category identifier (ID) that identifies the category record and metatag patterns associated with the data category, the metatag patterns indicating content displayed by a web page and/or a native application, and an entity data store that stores entity records; and a processing device that executes computer-readable instructions that, if executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising metadata that includes metatag pairs, each metatag pair comprising a tag label and a value interposed between the metatag pair, compare the tag labels with the metatag patterns stored in the category data store, determine a data category of the data based on the comparison of the metadata with the metatag patterns, determine a data scraper based on the determined data category of the data, the determined data scraper comprising a scraper configuration that enables the determined data scraper to extract information from the web page and/or the native application, scrape the web page and/or the native application by extracting information from the web page and/or the native application using the determined data scraper, populate one or more entity records in the entity data store based on the scraped data, receive a search request, the search request comprising one or more search terms and/or contextual data, determine one or more entity records from the entity data store based on the search request, generate a result object based on the determined entity records, and transmit the result object via the network communication device. - View Dependent Claims (16, 17, 18, 19)
-
-
20. A server comprising:
-
a network communication device; a storage device comprising an entity data store that stores entity records; and a processing device that executes computer-readable instructions that, if executed by the processing device, cause the processing device to; receive data corresponding with n states of a web page and/or a native application, n being greater than one, the data comprising n uniform resource locators (URLs) associated with respective states, compare the data of the n states with each other to determine similarity between the n states, cluster the n states into k clusters based on the comparison, k being less than n and greater than one, for each cluster, determine a data scraper based on a structure of the data in the cluster, scrape the states of the web page and/or the native application indicated by the URLs in the cluster, and populate one or more entity records in the entity data store using the scraped data, receive a search request, the search request comprising one or more search terms and/or contextual data, determine one or more entity records from the entity data store based on the search request, generate a result object based on the determined entity records, and transmit the generated result object via the network communication device. - View Dependent Claims (21, 22, 23, 24, 25)
-
-
26. A server comprising:
-
a network communication device; a storage device comprising an entity data store that stores entity records and a card data store that stores card records; and a processing device that executes computer-readable instructions that, if executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL), metadata indicating a structure of the web page and/or the native application, and/or content displayed by the web page and/or the native application, determine a category of the data based on the URL of the web page and/or the native application, the structure of the web page and/or the native application indicated by the metadata, and/or the content displayed by the web page and/or the native application, determine a scraper based on the category of the data, the scraper comprising a configuration that enables the scraper to extract information from the web page and/or the native application, scrape the web page and/or the native application for scraped data by extracting information from the web page and/or the native application using the scraper, and populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data. - View Dependent Claims (27, 28, 29, 30)
-
Specification