Transmitting Card Objects Based on Categorized and Scraped Data
First Claim
1. A server comprising:
- a network communication device;
a storage device comprising;
a category data store that stores category records corresponding with data categories, each category record comprising;
a category identifier (ID) that identifies the category record; and
a uniform resource locator (URL) pattern associated with the data category;
an entity data store that stores entity records; and
a card data store that stores card records; and
a processing device that executes computer-readable instructions that, when executed by the processing device, cause the processing device to;
receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL);
compare the URL included in the data with the URL patterns stored in the category data store;
determine a data category of the data based on the comparison of the URL with the URL patterns;
determine a data scraper based on the data category of the data, the data scraper comprising a scraper configuration that enables the data scraper to extract information from the web page and/or the native application;
scrape the web page and/or the native application by extracting information from the web page and/or the native application using the data scraper;
populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data;
receive a card request, the card request comprising one or more search terms and/or contextual data;
determine a card record from the card data store based on the card request;
generate a card object based on the determined card record; and
transmit the card object via the network communication device.
4 Assignments
0 Petitions
Accused Products
Abstract
A server configured to receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL); compare the URL included in the data with URL patterns stored in a category data store; determine a data category of the data based on the comparison; determine a data scraper based on the data category, the data scraper comprising a scraper configuration that enables the data scraper to extract information from the web page and/or the native application; scrape the web page and/or the native application by extracting information from the web page and/or the native application using the data scraper; store the extracted information in one or more data stores; used the stored information to provide search results and/or card objects.
-
Citations
30 Claims
-
1. A server comprising:
-
a network communication device; a storage device comprising; a category data store that stores category records corresponding with data categories, each category record comprising; a category identifier (ID) that identifies the category record; and a uniform resource locator (URL) pattern associated with the data category; an entity data store that stores entity records; and a card data store that stores card records; and a processing device that executes computer-readable instructions that, when executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL); compare the URL included in the data with the URL patterns stored in the category data store; determine a data category of the data based on the comparison of the URL with the URL patterns; determine a data scraper based on the data category of the data, the data scraper comprising a scraper configuration that enables the data scraper to extract information from the web page and/or the native application; scrape the web page and/or the native application by extracting information from the web page and/or the native application using the data scraper; populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data; receive a card request, the card request comprising one or more search terms and/or contextual data; determine a card record from the card data store based on the card request; generate a card object based on the determined card record; and transmit the card object via the network communication device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A server comprising:
-
a network communication device; a storage device comprising; a category data store that stores category records corresponding with data categories, each category record comprising; a category identifier (ID) that identifies the category record; and a structural pattern associated with the data category, the structural pattern indicating the structure of a web page and/or a native application; an entity data store that stores entity records; and a card data store that stores card records; and a processing device that executes computer-readable instructions that, when executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising metadata that indicates a structure of the web page and/or the native application; compare the structure indicated by the metadata with the structural patterns stored in the category data store; determine a data category of the data based on the comparison of the metadata with the structural patterns; determine a data scraper based on the data category of the data, the data scraper comprising a scraper configuration that enables the data scraper to extract information from the web page and/or the native application; scrape the web page and/or the native application for scraped data by extracting information from the web page and/or the native application using the data scraper; populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data; receive a card request, the card request comprising one or more search terms and/or contextual data; determine a card record from the card data store based on the card request; generate a card object based on the determined card record; and transmit the card object via the network communication device. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A server comprising:
-
a network communication device; a storage device comprising; a category data store that stores category records corresponding with data categories, each category record comprising; a category identifier (ID) that identifies the category record; and metatag patterns associated with the data category, the metatag patterns indicating content displayed by a web page and/or a native application; and an entity data store that stores entity records; and a processing device that executes computer-readable instructions that, when executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising metadata that includes metatag pairs, each metatag pair comprising a tag label and a value interposed between the metatag pair; compare the tag labels with the metatag patterns stored in the category data store; determine a data category of the data based on the comparison of the metadata with the metatag patterns; determine a data scraper based on the data category of the data, the data scraper comprising a scraper configuration that enables the data scraper to extract information from the web page and/or the native application; scrape the web page and/or the native application by extracting information from the web page and/or the native application using the data scraper; populate one or more entity records in the entity data store based on the scraped data; receive a search request, the search request comprising one or more search terms and/or contextual data; determine one or more entity records from the entity data store based on the search request; generate a result object based on the determined entity records; and transmit the result object via the network communication device. - View Dependent Claims (16, 17, 18, 19)
-
-
20. A server comprising:
-
a network communication device; a storage device comprising an entity data store that stores entity records; and a processing device that executes computer-readable instructions that, when executed by the processing device, cause the processing device to; receive data corresponding with n states of a web page and/or a native application, n being greater than one, the data comprising n uniform resource locators (URLs) associated with respective states; compare the data of the n states with each other to determine similarity between the n states; cluster the n states into k clusters based on the comparison, k being less than n and greater than one; for each cluster; determine a data scraper based on a structure of the data in the cluster, scrape the states of the web page and/or the native application indicated by the URLs in the cluster, and populate one or more entity records in the entity data store using the scraped data; receive a search request, the search request comprising one or more search terms and/or contextual data; determine one or more entity records from the entity data store based on the search request; generate a result object based on the determined entity records; and transmit the result object via the network communication device. - View Dependent Claims (21, 22, 23, 24, 25)
-
-
26. A server comprising:
-
a network communication device; a storage device comprising; an entity data store that stores entity records; and a card data store that stores card records; and a processing device that executes computer-readable instructions that, when executed by the processing device, cause the processing device to; receive data corresponding with a web page and/or a native application, the data comprising a uniform resource locator (URL), metadata indicating a structure of the web page and/or the native application, and/or content displayed by the web page and/or the native application; determine a category of the data based on the URL of the web page and/or the native application, the structure of the web page and/or the native application indicated by the metadata, and/or the content displayed by the web page and/or the native application; determine a scraper based on the category of the data, the scraper comprising a configuration that enables the scraper to extract information from the web page and/or the native application; scrape the web page and/or the native application for scraped data by extracting information from the web page and/or the native application using the scraper; and populate one or more entity records in the entity data store and/or one or more card records in the card data store based on the scraped data. - View Dependent Claims (27, 28, 29, 30)
-
Specification