Augmented reality system for product selection

• US 10,455,089 B2
• Filed: 12/14/2011
• Issued: 10/22/2019
• Est. Priority Date: 03/22/2011
• Status: Active Grant

• Current Assignee: FMR LLC
• Original Assignee: FMR LLC
• Inventors: Martin, David
• Primary Examiner(s): Casey, Alexis M
• Application Number:
  US13/325,335
• Publication Number:
  US 20120246027A1
• Time in Patent Office: 2,869 Days
• Field of Search: 705 2663
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: H04M 3/42221 Conversation recording systems at the subscriber's set H04M1/656
• CPC Class Codes: H04M 3/5175 Call or contact centers supervision arrangements

Abstract

Techniques for searching for products in an inventory of product are disclosed. The techniques receive data that specifies attributes of a product, search inventory of products to determine potential matches or closely related matches to at least some of the attributes of the products, generate messages based on the search of inventory to determine the potential matches, generate positional information associated with the messages and generate a set of informational depictions of the generated messages, with the informational depictions of the messages when rendered on a display device are rendered in juxtaposition with representations of the products according to the generated positional information.

Claims

1. A system comprising:

one or more computer systems comprising at least one memory and at least one processor, the one or more computer systems configured to;

receive input data comprising a plurality of desired physical attributes of a desired product and user-preselected priorities associated with the desired physical attributes;

store the input data in a database in communication with the one or more computer systems, the database holding a plurality of input data and records of an inventory of products;

search by one or more of the desired physical attributes, the database, to determine matching products in the inventory of products that have physical attributes that match to the one or more desired physical attributes, the one or more computer systems further configured to further search the database to determine closely-matching products in the inventory of products that have physical attributes that match to at least some of the one or more desired physical attributes when no matching products are found, with the further search conducted based on the user-preselected priorities associated with the one or more desired physical attributes;

generate a first set of messages based on the search, the first set of messages including at least some text corresponding to the one or more desired physical attributes of inventory matches, wherein the inventory matches include the matching products or the closely-matching products;

generate a first set of informational depictions based on the first set of messages;

receive a signal from an electronic compass associated with a display, wherein the display is associated with a portable computing system of the system in communication with the one or more computer systems and the signal indicates a current orientation of the display;

generate positional information that associates the first set of informational depictions with representations of the inventory matches;

cause the first set of informational depictions to be rendered on the display in juxtaposition with the representations of the inventory matches, wherein the representations of the inventory matches that are displayed in a current view of the inventory matches are based on inventory matches located within a current field of view of an image capture device of the portable computing device, the positional information, and a location of the portable computing system determined based on the received signal from the electronic compass;

receive a selection from the portable computing system corresponding to one of the representations of the inventory matches;

generate a second set of messages including additional details on physical attributes of an inventory match corresponding to the selected representation;

generate a second set of informational depictions based on the second set of messages; and

cause the second set of informational depictions to be rendered on the display;

cause either of the first set or the second set of informational depictions to be projected onto the display for informational depictions corresponding to inventory matches located within the current field of view of the image capture device; and

wherein the representations of the inventory matches are real-world images of inventory matches.

2. The system of claim 1 further configured to:

receive information specifying a map in rectilinear coordinates of physical locations of the inventory matches;

receive location information of a current physical location of the portable computing system; and

generate the positional information relative to the rectilinear coordinates of the physical locations of the inventory matches to associate the first set of informational depictions with the inventory matches that are displayed in the current view of the inventory matches according to the location information and the signal received from the electronic compass.

3. The system of claim 1 wherein the system is further configured to:

generate an image depicting representations of the inventory matches residing in a physical location, the image augmented with the first set of informational depictions of the generated messages in juxtaposition with the representations of the inventory matches in the image.

4. The system of claim 1 wherein the system is further configured to:

receive information specifying a map of physical locations of the inventory matches;

receive location information from a global positioning system associated with the portable computing system; and

generate the positional information relative to the physical locations of the inventory matches to associate the first set of informational depictions with the locations of the inventory matches that are displayed in the current view of the inventory matches according to the location information received from the global positioning system and the signal received from the electronic compass.

5. The system of claim 3 wherein the inventory matches are automobiles/vehicles and the one or more computer systems are further configured to:

generate the image as a real-world image containing actual views of the automobiles/vehicles; and

generate the first set of informational depictions as pictorial representations that are depicted over the corresponding matching actual views of the automobiles/vehicles.

6. A computer program product tangibly stored on a computer readable hardware storage device, the computer program product for searching product inventory of products, the computer program product executable on at least one processor of one or more computer systems comprising at least one memory, the computer program product comprising instructions to cause the at least one processor to:

receive input data comprising a plurality of desired physical attributes of a desired product and user-preselected priorities associated with the desired physical attributes;

store the input data in a database in communication with the one or more computer systems, the database holding a plurality of input data and records of an inventory of products;

search, by one or more of the desired physical attributes, the database to determine matching products in the inventory of products that have physical attributes that match to the one or more desired physical attributes, the computer program product further comprising instructions to cause the at least one processor to further search the database to determine closely-matching products in the inventory of products that have physical attributes that match to at least some of the one or more desired physical attributes when no matching products are found, with the further search conducted based on the user-preselected priorities associated with the one or more desired physical attributes;

generate a first set of messages based on the search, the first set of messages including at least some text corresponding to the one or more desired physical attributes of inventory matches, wherein the inventory matches include the matching products or the closely-matching products;

generate a first set of informational depictions based on the first set of messages;

receive a signal from an electronic compass associated with a display, wherein the display is associated with a portable computing system of the system in communication with the processor and the signal indicates a current orientation of the display;

generate positional information that associates the first set of informational depictions with representations of the inventory matches;

cause the first set of informational depictions to be rendered on the display in juxtaposition with the representations of the inventory matches, wherein the representations of the inventory matches that are displayed in a current view of the inventory matches is based on inventory matches located within a current field of view of an image capture device of the portable computing device, the positional information, and a location of the portable computing system determined based on the received signal from the electronic compass;

receive a selection from the portable computing system corresponding to one of the representations of the inventory matches;

generate a second set of messages including additional details on physical attributes of an inventory match corresponding to the selected representation;

generate a second set of informational depictions based on the second set of messages; and

cause the second set of informational depictions to be rendered on the display;

cause either of the first set or the second set of informational depictions to be projected onto the display for informational depictions corresponding to inventory matches located within the current field of view of the image capture device; and

wherein the representations of the inventory matches are real-world images of inventory matches.

7. The computer program product of claim 6 further comprising instructions to:

receive information specifying a map in rectilinear coordinates of physical locations of the inventory matches; and

generate the positional information relative to the rectilinear coordinates of the physical locations of the inventory matches to associate the first set of informational depictions with the locations of the inventory matches that are displayed in the current view of the inventory matches according to the location information and the signal received from the electronic compass.

8. The computer program product of claim 6 further comprising instructions to:

generate an image depicting representations of the inventory matches residing in a physical location, the image augmented with the first set of informational depictions of the generated messages in juxtaposition with the representations of the inventory matches in the image.

9. The computer program product of claim 6 wherein instructions to generate the positional information further comprise instructions to:

receive information specifying a map of physical locations of the inventory matches;

receive location information from a global positioning system associated with the portable computing system; and

generate the positional information relative to the physical locations of the inventory matches to associate the first set of informational depictions with the locations of the inventory matches that are displayed in the current view of the inventory matches according to the location information received from the global positioning system and the signal received from the electronic compass.

10. The computer program product of claim 6 wherein the inventory matches are automobiles/vehicles and the computer program product further comprises instructions to:

generate the image as a real-world image containing actual views of the automobiles/vehicles; and

generate the first set of informational depictions as pictorial representations that are depicted over the corresponding matching actual views of the automobiles/vehicles.

11. A method comprising:

receiving by one or more computer systems comprising at least one memory and at least one processor, input data comprising a plurality of desired physical attributes of a desired product and user-preselected priorities associated with the desired physical attributes;

storing by one or more computer systems the input data in a database in communication with the one or more computer systems, the database holding a plurality of input data and records of an inventory of products;

searching by the one or more computer systems by one or more of the desired physical attributes, the database, to determine matching products in the inventory of products that have physical attributes that match to the one or more desired physical attributes, the one or more computer systems further configured to further search the database to determine closely-matching products in the inventory of products that have physical attributes that match to at least some of the one or more desired physical attributes when no matches are found, with the further search conducted based on the user-preselected priorities associated with the one or more desired physical attributes;

generating by the one or more computer systems a first set of messages based on the search, the first set of messages including text corresponding to the one or more desired physical attributes of inventory matches, wherein the inventory matches include the matching products or the closely-matching products;

generating by the one or more computer systems a first set of informational depictions based on the first set of messages;

receiving by the one or more computers a signal from an electronic compass associated with the display, wherein the display is associated with a portable computing system of the system in communication with the processor and the signal indicates a current orientation of the display;

generating by the one or more computer systems positional information that associates the first set of informational depictions with representations of the inventory matches;

causing by the one or more computer systems the first set of informational depictions to be rendered on the display in juxtaposition with the representations of the inventory matches, wherein the representations of the inventory matches that are displayed in a current view of the inventory matches is based on inventory matches located within a current field of view of an image capture device of the portable computing device, the positional information, and a location of the personal computing system determined based on the received signal from the electronic compass;

receiving a selection from the portable computing system corresponding to one of the representations of the inventory matches;

generating a second set of messages including additional details on desired physical attributes of an inventory match corresponding to the selected representation;

generating a second set of informational depictions based on the second set of messages; and

causing the second set of informational depictions based to be rendered on the display;

causing either of the first set or the second set of informational depictions to be projected onto the display for informational depictions corresponding to inventory matches located within the current field of view of the image capture device; and

wherein the representations of the inventory matches are real-world images of inventory matches.

12. The method of claim 11 further comprising:

receiving information specifying a map in rectilinear coordinates of physical locations of the inventory matches;

receiving location information of a current physical location of the portable computing system; and

generating the positional information relative to the rectilinear coordinates of the physical locations of the inventory matches to associate the first set of informational depictions with the inventory matches that are displayed in the current view of the inventory matches according to the location information and the signal received from the electronic compass.

13. The method of claim 11 further comprising:

generating an image depicting representations of the inventory matches residing in a physical location, the image augmented with the first set of informational depictions of the generated messages in juxtaposition with the representations of the inventory matches in the image.

14. The method of claim 11 further comprising:

receiving information specifying a map of physical locations of the inventory matches;

receiving location information from a global positioning system associated with the portable computing system; and

generating the positional information relative to the physical locations of the inventory matches to associate the first set of informational depictions with the locations of the inventory matches that are displayed in the current view of the inventory matches according to the location information received from the global positioning system and the signal received from the electronic compass.

15. The method of claim 11 wherein the inventory matches are automobiles/vehicles and the method further comprises:

generating the image as a real-world image containing actual views of the automobiles/vehicles; and

generating the first set of informational depictions as pictorial representations that are depicted over the corresponding matching actual views of the automobiles/vehicles.