Method and apparatus for evolutionary design

• US RE46,178 E1
• Filed: 10/27/2011
• Issued: 10/11/2016
• Est. Priority Date: 11/10/2000
• Status: Active Grant

• Current Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Original Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Inventors: Ficici, Steven G., Afeyan, Noubar B., Malek, Kamal M., Bufton, Nigel J., Austin, Howard A.
• Primary Examiner(s): RIFKIN, BEN M
• Application Number:
  US13/283,495
• Time in Patent Office: 1,811 Days
• Field of Search: 706/13
• US Class Current: 1/1
• CPC Class Codes: G06F 17/50 Computer-aided design
• CPC Class Codes: G06F 2217/08 Multi-objective optimization
• CPC Class Codes: G06F 2217/10 Probabilistic or stochastic CAD
• CPC Class Codes: G06N 3/126 Evolutionary algorithms, e.g. genetic algorithms or genetic programming
• CPC Class Codes: G06N 7/005 Probabilistic networks
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

The invention involves generating and presenting, typically electronically, a number of design alternatives to persons who are participating in the design, selection, or market research exercise. The participants (referred to as “selectors”) transmit data indicative of their preferences among or between the presented design alternatives, and that data is used to derive a new generation of design alternatives or proposals. The new designs are generated through the use of a computer program exploiting a genetic or evolutionary computational technique. The process is repeated, typically for many iterations or cycles.

Claims

1. A method of selecting a preferred one or a preferred group of forms of a product, each product form comprising a plurality of attributes, the method comprising the steps of:

(a) presenting, over an electronic network, to a plurality of selectors, one or more groups of product forms;

(b) obtaining information from a selector about the selector'"'"'s preference among the presented product forms;

(c) using the obtained information to determine a derived group of product forms, each of at least some of the derived product forms comprising a combination of attributes different than the plurality of attributes of each of at least some of the presented product forms;

(d) iterating steps (a) through (c), using a derived group from step (c), until a stopping criterion is achieved; and

(e) upon achieving the stopping criterion, selecting one or a group of preferred product forms, wherein each of the attributes comprises a structural, functional, stylistic, or economic feature of the product.

2. The method of claim 1 wherein the stopping criterion is achieved when the derived group of product forms ceases to change significantly after an iteration.

3. The method of claim 1 wherein step (b) comprises obtaining information indicative of which presented product forms are preferred by the selector.

4. The method of claim 1 wherein step (b) comprises obtaining information indicative of which presented product forms are not preferred by the selector.

5. The method of claim 1 wherein step (b) comprises obtaining information indicative of relative preference of the selector from among the presented product forms.

6. The method of claim 1 wherein the obtained information from step (b) includes information indicative of the confidence of the selector in the selector'"'"'s preference.

7. The method of claim 1 wherein step (b) comprises obtaining information indicative of a rating assigned to at least some of the presented product forms by at least one selector.

8. The method of claim 1 wherein step (b) comprises obtaining information indicative of a preference as between a presented product form and a previously presented product form.

9. The method of claim 1 wherein different selectors are presented with different groups of product forms.

10. The method of claim 1 wherein each selector comprises a person or a group of persons.

11. The method of claim 1 wherein step (c) includes determining the derived group of product forms by selecting the derived group of product forms.

12. The method of claim 1 wherein step (c) includes determining the derived group of product forms by selecting the derived group of product forms.

13. The method of claim 1 wherein step (c) includes determining the derived group of product forms by generating the derived group of product forms using a computational algorithm.

14. The method of claim 13 wherein the computational algorithm comprises an evolutionary algorithm.

15. The method of claim 13 wherein the computational algorithm comprises a genetic algorithm.

16. The method of claim 1 wherein, for each iteration, each selector is presented with a group of product forms substantially different from the groups presented to the other selectors.

17. An electronic network comprising computers for use by selectors to express preferences for certain forms of a product, each product form comprising a plurality of attributes, the network being configured to:

(a) present one or more groups of product forms to a plurality of selectors;

(b) obtain data from a selector indicative of the selector'"'"'s preference from among the presented product forms;

(c) use the obtained data to determine a derived group of product forms, each of at least some of the derived product forms comprising a combination of attributes different than the plurality of attributes of each of at least some of the presented product forms;

(d) iterate steps (a) through (c), using a derived group from step (c), until a stopping criterion is achieved; and

(e) upon achieving the stopping criterion, output data informing a decision to select one or a group of preferred product forms, wherein each of the attributes comprises a structural, functional, stylistic, or economic feature of the product.

18. The network of claim 17 wherein the stopping criterion comprises convergence of a group of product forms.

19. The network of claim 17 further configured to identify a subset of the plurality of selectors having similarity among expressed product form preferences.

20. The network of claim 17 configured to obtain data indicative of relative preference of the selector from among presented product forms.

21. The network of claim 17 configured to obtain data indicative of the confidence in an expressed selector preference.

22. The network of claim 17 configured to obtain data indicative of a rating assigned to at least some of the presented product forms.

23. The network of claim 17 configured to obtain data from a selector indicative of the selector'"'"'s preference as between a presented product form and a previously presented product form.

24. The network of claim 17 configured to present different selectors with a different group of product forms.

25. The network of claim 17 configured to use a computational algorithm to generate the derived group of product forms.

26. The network of claim 17 configured to use selection to assemble the derived group of product forms.

27. The network of claim 17 configured to use an evolutionary algorithm to generate the derived group of product forms.

28. The network of claim 17 configured to use a genetic algorithm to generate the derived group of product forms.

29. The network of claim 17 wherein, for each iteration, any one selector is presented with a group of product forms substantially different from the groups presented to the other selectors.

30. The network of claim 17 further comprising at least one server for performing at least function (c).

31. A method of selecting one or more preferred forms of a product, the method comprising the steps of:

(a) presenting, over an electronic network, to a plurality of selectors, one or more groups of the product forms;

(b) obtaining information from a selector about the selector'"'"'s preference among the presented product forms;

(c) using the obtained information to determine one or more derived product forms;

(d) repeating steps (a) through (c), using at least some of the one or more derived product forms from step (c), until a stopping condition is met; and

(e) upon achieving the stopping condition, selecting one or more of the remaining derived product forms as the one or more preferred product forms, wherein the product comprises a mass produced good, a consumer good, a manufactured good, a service, advertising material, or packaging material.

32. The method of claim 31 wherein the product comprises apparel, footwear, a computer, a telephone, a chair, a seat, an automobile, a bicycle, a home, a building, a boat hull, or a billboard.

33. The method of claim 31 wherein step (b) comprises obtaining information indicative of which product forms among the presented product forms are preferred by the selector.

34. The method of claim 31 wherein step (b) comprises obtaining information indicative of which product forms among the presented product forms are not preferred by the selector.

35. The method of claim 31 wherein different selectors are presented with different groups of product forms.

36. The method of claim 31 wherein each selector comprises a person or a group of persons.

37. The method of claim 31 comprising using a genetic or evolutionary computational technique to determine the derived product forms.

38. A system for selecting one or more preferred forms of a product, the method comprising the steps of:

(a) means for presenting, over an electronic network, to a plurality of selectors, one or more groups of the product forms;

(b) means for obtaining information from a selector about the selector'"'"'s preference among the presented product forms;

(c) means for using the obtained information to determine one or more derived product forms;

(d) means for repeating the functions of means (a) through (c), using at least some of the one or more derived product forms from step (c), until a stopping condition is met; and

(e) means for, upon achieving the stopping condition, selecting one or more of the remaining derived product forms as the one or more preferred product forms, wherein the product comprises a mass produced good, a consumer good, a manufactured good, a service, advertising material, or packaging material.

39. The system of claim 38 wherein the product comprises apparel, footwear, a computer, a telephone, a chair, a seat, an automobile, a bicycle, a home, a building, a boat hull, or a billboard.

40. A system for selecting one or more preferred forms of a product, the system comprising one or more server computers for communicating with a plurality of client computing devices over a computer network, each of the client computing devices being adapted for use by one of a plurality of selectors, the system being configured:

to present at least one group of product forms to each of the selectors;

to obtain information about the selector'"'"'s preferences among the presented product forms;

to use the obtained information to determine one or more derived product forms; and

to repeat the presenting, obtaining, and using functions with at least one of the one or more derived product forms until a stopping condition is met, and then to select one or more of the remaining derived product forms as the one or more preferred product forms, wherein the product comprises a mass produced good, a consumer good, a manufactured good, a service, advertising material, or packaging material.

41. The system of claim 40 wherein the products comprises apparel, footwear, a computer, a telephone, a chair, a seat, an automobile, a bicycle, a home, a building, a boat hull, or a billboard.

42. A method of identifying one or more preferred product forms, the method comprising the steps of:

(a) presenting, over an electronic network, to a plurality of selectors, one or more groups of the product forms;

(b) obtaining information from a selector about the selector'"'"'s preference among the presented product forms;

(c) using the obtained information to determine at least one derived group of the product forms;

(d) repeating steps (a) through (c), using the at least one derived group from step (c), until a stopping condition is met; and

(e) after achieving the stopping condition, identifying one or more of the remaining derived product forms as the one or more preferred product forms, manufacturing at least one of the one or more preferred product forms or a derivative thereof, and effecting a sale of the at least one of the one or more preferred product forms or the derivative thereof.

43. The method of claim 42 wherein step (b) comprises obtaining information indicative of which product forms among the presented product forms are preferred by the selector.

44. The method of claim 42 wherein step (b) comprises obtaining information indicative of which product forms among the presented product forms are not preferred by the selector.

45. The method of claim 42 wherein different selectors are presented with different groups of product forms.

46. The method of claim 42 wherein each selector comprises a person or a group of persons.

47. The method of claim 42 comprising using a computational technique to determine the at least one derived group of the product forms.

48. A system for identifying one or more preferred product forms, the method comprising the steps of:

(a) means for presenting, over an electronic network, to a plurality of selectors, one or more groups of the product forms;

(b) means for obtaining information from a selector about the selector'"'"'s preference among the presented product forms;

(c) means for using the obtained information to generate or select at least one derived group of the product forms;

(d) means for repeating the functions of means (a) through (c), using the at least one derived group from step (c), until a stopping condition is met; and

(e) means for, after achieving the stopping condition, identifying one or more of the remaining derived product forms as the one or more preferred product forms and effecting a sale of at least one of the one or more preferred product forms.

49. A method of identifying a decision object from a plurality of product forms, each product form having a market value, the method comprising the steps of:

(a) presenting, over an electronic network, to a plurality of selectors, one or more groups of the product forms;

(b) obtaining information from a selector about the selector'"'"'s preference among the presented product forms;

(c) using the obtained information to determine a derived group of product forms; and

(d) repeating steps (a) through (c), using a derived group from step (c), to arrive at a product form with an optimized market value.

50. A method of selecting one or more preferred forms of a product or service, each form of product or service comprising a plurality of attributes, the method comprising the steps of:

(a) presenting, over an electronic network, to a plurality of selectors, one or more groups of the forms of the product or service;

(b) obtaining information from a selector about the selector'"'"'s preference among the presented forms of the product or service;

(c) using the obtained information to determine one or more derived forms of the product or service;

(d) iterating steps (a) through (c), using derived forms from step (c), until a stopping criterion is achieved; and

(e) upon achieving the stopping criterion, selecting one or a group of preferred forms of the product or service for further development, manufacture, use, or sale.

51. The method of claim 50 wherein each of the attributes comprises a structural, functional, stylistic, or economic feature of the product or service.

52. The method of claim 50 wherein each of the attributes comprises an element of the product or service that is optional.

53. The method of claim 50 wherein each of the attributes comprises an element of the product or service that has many values or many subtypes.

54. A plurality of client computers for use in selecting one or more preferred forms of a product or service, each form of product or service comprising a plurality of attributes, each of at least some of the client computers configured to:

(a) receive for presentation, to one of a plurality of selectors, one or more groups of the forms of the product or service;

(b) obtain information from the selector about the selector'"'"'s preference among the presented forms of the product or service, and transmit at least some of that information to at least one server;

(c) receive for presentation to the selector one or more derived forms of the product or service, the one or more derived forms having been determined by use of the transmitted information;

(d) iterate functions (a) through (c), using derived forms from (c), until a stopping criterion is achieved by the at least one server; and

(e) upon the at least one server achieving the stopping criterion, receive for presentation to the selector one or a group of preferred forms of the product or service for manufacture, use, further development, or sale.

55. The plurality of client computers of claim 54 wherein each of the attributes comprises a structural, functional, stylistic, or economic feature of the product or service.

56. The plurality of client computers of claim 54 wherein each of the attributes comprises an element of the product or service that is optional.

57. The plurality of client computers of claim 54 wherein each of the attributes comprises an element of the product or service that has many values or many subtypes.

58. A method conducted by a designer for selecting a preferred one or a preferred group of products or services from a larger population of possible products or services, each of the products or services including a plurality of combinations of attributes, the method comprising causing a third party to:

(a) present, over an electronic network, to a plurality of selectors, one or more groups of the products or services;

(b) obtain information from a selector expressing a selector preference among the presented products or services;

(c) use the information to obtain a derived group of products or services; and

(d) iterate actions (a) through (c), using a derived group from step (c), and, upon achieving a stopping criterion, select one or a group of preferred products or services for submission to the designer for further development, manufacture, use, or sale.

59. A method to identify a preferred product form from a plurality of product forms, the method comprising:

(a) presenting, with a computing device over an electronic network, ones of the plurality of product forms via voting window presentation slots;

(b) designating a first portion of the voting window presentation slots for offspring products;

(c) designating a second portion of the voting window presentation slots for unviewed ones of the plurality of product forms;

(d) obtaining, with the computing device, respondent preference information from the voting window presentation slots associated with respective ones of the plurality of product forms;

(e) when the obtained preference information for a respective voting window is associated with a positive score, reducing a number of computation iterations by generating, by applying generative grammar techniques with an evolutionary algorithm with the computing device, an offspring product form to populate a respective one of the first portion of the voting window slots during a subsequent presentation;

(f) when the obtained preference information for the respective voting window is associated with a negative score, replacing, with the computing device, a respective one of the second portion of the voting window slots with an alternate one of the plurality of product forms not previously viewed for presentation during the subsequent presentation;

(g) iterating, with the computing device, (d) through (f) until a stopping condition occurs; and

(h) identifying, with the computing device, the preferred product form having a greatest preference information value.

60. A method as defined in claim 59, wherein designating the second portion of the voting window presentation slots for offspring products increases a voting diversity of the respondent.

61. A method as defined in claim 59, wherein the positive score is identified by a thumbs-up vote and the negative score is identified by a thumbs-down vote.

62. A method as defined in claim 59, wherein generating the offspring product form is based on two or more products having the positive score.

63. A method as defined in claim 59, wherein the alternate one of the plurality of product forms has not previously been presented via the voting window presentation slots.

64. A method as defined in claim 59, further including retaining the product form associated with the positive score along with the offspring product form when presenting a subsequent iteration of the number of voting window presentation slots.

65. A method as defined in claim 59, further including increasing a respondent product viewing diversity by restricting a number of positive score votes during each presentation iteration of the voting window presentation slots.

66. A method as defined in claim 59, further including decreasing a number of iterations to identify the indication of convergence by applying generative grammar techniques with the evolutionary algorithm.

67. A method as defined in claim 59, wherein the stopping condition includes an indication of convergence of generated offspring product forms.

68. A system comprising a server computer communicatively connected to one or more client computing devices over a network to identify a preferred product form from a plurality of product forms, the system to, at least:

(a) present ones of the plurality of product forms via voting window presentation slots;

(b) designate a first portion of the voting window presentation slots for offspring products;

(c) designate a second portion of the voting window presentation slots for unviewed ones of the plurality of product forms;

(d) obtain respondent preference information from the voting window presentation slots associated with respective ones of the plurality of product forms;

(e) when the obtained preference information for a respective voting window is associated with a positive score, reduce a number of computation iterations by generating, by applying generative grammar techniques with an evolutionary algorithm, an offspring product form to populate a respective one of the first portion of the voting window slots during a subsequent presentation;

(f) when the obtained preference information for the respective voting window is associated with a negative score, replace a respective one of the second portion of the voting window slots with an alternate one of the plurality of product forms not previously viewed for presentation during the subsequent presentation;

(g) iterate (d) through (f) until a stopping condition occurs; and

(h) identify the preferred product form having a greatest preference information value.

69. A system as defined in claim 68, wherein designating the second portion of the voting window presentation slots for offspring products increases a voting diversity of the respondent.

70. A system as defined in claim 68, wherein the positive score is identified by a thumbs-up vote and the negative score is identified by a thumbs-down vote.

71. A system as defined in claim 68, wherein generating the offspring product form is based on two or more products having the positive score.

72. A system as defined in claim 68, wherein the alternate one of the plurality of product forms has not previously been presented via the voting window presentation slots.

73. A system as defined in claim 68, wherein the system is to retain the product form associated with the positive score along with the offspring product form when presenting a subsequent iteration of the number of voting window presentation slots.

74. A system as defined in claim 68, wherein the system is to increase a respondent product viewing diversity by restricting a number of positive score votes during each presentation iteration of the voting window presentation slots.

75. A system as defined in claim 68, wherein the system is to identify the stopping condition via an indication of convergence of generated offspring product forms.

76. A method to decrease a number of computation iterations when identifying a preferred product form from a plurality of product forms, the method comprising:

(a) presenting, with a computing device over an electronic network, ones of the plurality of product forms via voting window presentation slots;

(b) designating a first portion of the voting window presentation slots for offspring products;

(c) designating a second portion of the voting window presentation slots for unviewed ones of the plurality of product forms;

(d) obtaining, with the computing device, respondent preference information from the voting window presentation slots associated with respective ones of the plurality of product forms;

(e) when the obtained preference information for a respective voting window is associated with a positive score, reducing the number of computation iterations by generating, by applying generative grammar techniques with an evolutionary algorithm via the computing device, an offspring product form to populate a respective one of the first portion of the voting window slots during a subsequent presentation;

(f) when the obtained preference information for the respective voting window is associated with a negative score, replacing, with the computing device, a respective one of the second portion of the voting window slots with an alternate one of the plurality of product forms not previously viewed for presentation during the subsequent presentation;

(g) iterating, with the computing device, (d) through (f) until a stopping condition occurs; and

(h) identifying, with the computing device, the preferred product form having a greatest preference information value.

77. A method as defined in claim 76, wherein designating the second portion of the voting window presentation slots for offspring products increases a voting diversity of the respondent.

78. A method as defined in claim 76, wherein the positive score is identified by a thumbs-up vote and the negative score is identified by a thumbs-down vote.

79. A method as defined in claim 76, wherein generating the offspring product form is based on two or more products having the positive score.

80. A method as defined in claim 76, wherein the alternate one of the plurality of product forms has not previously been presented via the voting window presentation slots.

81. A method as defined in claim 76, further including retaining the product form associated with the positive score along with the offspring product form when presenting a subsequent iteration of the number of voting window presentation slots.

82. A method as defined in claim 76, further including increasing a respondent product viewing diversity by restricting a number of positive score votes during each presentation iteration of the voting window presentation slots.