Micro-Bucket Testing For Page Optimization

• US 20090281989A1
• Filed: 05/06/2008
• Published: 11/12/2009
• Est. Priority Date: 05/06/2008
• Status: Active Grant

• Current Assignee: Yahoo Assets LLC
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Sing, Vik, Kan, Ethan, Lestivo, Ingrid, Joshi, Deepa, Wexler, Mike, Shukla, Ashish
• Granted Patent: US 8,126,930 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/972 Access to data in other repository systems, e.g. legacy data or dynamic Web page generation

Abstract

Methods for optimizing webpage content by micro-bucket testing user customization to the webpage include presenting a plurality of modules at a webpage based on a request from a user. The modules define an intent of the webpage. A change defining customization to one or more modules within the webpage is detected. A test case representing the change is automatically generated. The generated test case is a modified webpage having the customization. The webpage is presented to a first segment of users as a control page and the modified webpage is presented to a second segment of users in response to a request for the webpage. User interaction by the first and segment of users is monitored at the webpage and the modified webpage to determine website metrics of the corresponding webpages. The website metrics is used in defining a new control page of the webpage from the modified webpage or retaining the webpage as the control page.

Claims

1. A method for optimizing a search webpage content by micro-bucket testing user customization to the search webpage, comprising:

presenting a plurality of search results and modules at a search webpage in response to a query, wherein the modules are provided in a topic page, the modules having content related to a topic of the query;

detecting a change to one or more modules within the topic page, the change defining customization provided by user interaction;

automatically generating a test case representing the change, the test case being a modified topic page having the customization;

presenting the topic page as a control page to a first segment of users and the modified topic page to a second segment of users in response to generation of subsequent search results using the query, the modified topic page representing a micro-bucket test of the topic page for the query; and

monitoring user interaction by the first and second segment of users to determine website metrics of the topic page and the modified topic page, the website metrics used in defining a new control page for subsequent search query from the modified topic page or retaining the topic page as the control page.

2. The method of claim 1, further including,

receiving additional changes to one or more modules within the topic page, the additional changes enabling generation of one or more additional test cases for the changes, the additional test cases being one or more modified topic pages;

presenting the topic page as the control page to the first segment of users and the one or more modified topic pages to the second and subsequent segments of users in response to generation of subsequent search results using the query, the one or more modified topic pages representing micro-bucket tests of the topic page for the query; and

monitoring user interaction by the first, second and subsequent segments of users to determine website metrics of the topic page and the one or more modified topic pages, the website metrics used in defining a new control page for subsequent search query from the one or more modified topic pages or retaining the topic page as the control page.

3. The method of claim 1, wherein change to the modules is dynamic.

4. The method of claim 2, wherein the changes are obtained from a plurality of users at a given period of time and wherein the changes may be to one or more modules or content in the topic page or the modified topic page.

5. The method of claim 4, wherein the change includes one or more of adding a module, deleting a module and re-positioning a module within the topic page or the modified topic page.

6. The method of claim 5, wherein detecting a change to one or more modules further including,

classifying the topic page into a category based on time critical needs associated with the content of the topic page;

and

reviewing the change based on the classification associated with the contents of the webpage, wherein the change includes addition of a module with content related to the topic page.

7. The method of claim 6, wherein reviewing the change is through any one or combination of a manual review process and an automated review process based on the classification of the topic page and wherein the automated review process includes automatically discarding the change when the change is unacceptable, the discarding of the change preventing generation of a test case for the change.

8. The method of claim 7, wherein the automated review process is performed prior to the generation of the test case.

9. The method of claim 7, wherein the manual review process further including,

determining any conflict encountered at the topic page based on the change;

and

manually resolving the conflict at the topic page,

wherein when the conflict is unresolved, the manual review process includes automatically discarding the change, the discarding of the change preventing presentation of the change in a modified topic page during the generation of subsequent search results using the query.

10. The method of claim 9, wherein the manual review process is performed after the generation and presentation of the modified topic page with the change based on the classification of the topic page, wherein the content of the modules in the topic page are time critical content.

11. The method of claim 1, further including locking one or more modules in the topic page, the locking preventing the one or more modules from being changed or deleted.

12. A method for optimizing webpage content by micro-bucket testing user customization to the webpage, comprising:

detecting a change to one or more modules within the webpage, the change defining customization provided by user interaction;

automatically generating a test case representing the change, the test case being a modified webpage having the customization;

presenting the webpage as a control page to a first segment of users and the modified webpage to a second segment of users in response to a subsequent request for the webpage, the modified webpage representing a micro-bucket test of the webpage; and

monitoring user interaction by the first and second segment of users to determine website metrics of the webpage and the modified webpage, the website metrics used in defining a new control page from the modified webpage or retaining the webpage as the control page.

13. The method of claim 12, further including,

receiving additional changes to one or more modules within the webpage, the additional changes enabling generation of one or more additional test cases for the additional changes, the additional test cases being one or more modified webpages having the customization;

presenting the webpage as the control page to the first segment of users and the one or more modified webpages to the second and subsequent segments of users in response to request for the webpage, each modified webpage presented to a distinct segment of users, the one or more modified webpages representing micro-bucket tests of the webpage; and

monitoring user interaction by the first, second and subsequent segments of users to determine website metrics of the webpage and the one or more modified webpages, the website metrics used in defining a new control page for subsequent request of the webpage from one or more modified webpages or retaining the webpage as the control page.

14. The method of claim 13, wherein the changes are obtained from a plurality of users at a given period of time and wherein the changes may be to one or more modules in the webpage or one of the modified webpages.

15. The method of claim 12, wherein the change includes one or more of adding a module, deleting a module and re-positioning a module within the webpage or the modified webpage.

16. The method of claim 15, wherein detecting a change to one or more modules further including,

reviewing the change based on a classification associated with the webpage, the classification is based on time critical need of the content of the webpage, wherein the change includes addition of a module with content related to the webpage.

17. The method of claim 16, wherein reviewing the change is through any one or combination of a manual review process and an automated review process based on the classification of the webpage,

wherein the automated review process includes automatically discarding the change when the change is unacceptable, the discarding of the change preventing generation of a test case for the change.

18. The method of claim 17, wherein the automated review process is performed prior to the generation of the test case.

19. The method of claim 17, wherein the manual review process further including,

determining any conflict encountered at the webpage based on the change;

and

manually resolving the conflict at the webpage,

automatically discarding the change when the conflict is unresolved, the discarding of the change preventing presentation of the change in a modified webpage during the generation of subsequent request for the webpage.

20. The method of claim 19, wherein the manual review process is performed after the generation and presentation of the modified webpage with the change based on the classification of the webpage, wherein the content of the one or more modules in the webpage are time critical content.

21. The method of claim 12, further including locking one or more modules in the webpage, the locking preventing the one or more modules from being changed or deleted.