Object relationships and similarities based on user context

• US 10,467,237 B1
• Filed: 02/22/2013
• Issued: 11/05/2019
• Est. Priority Date: 11/12/2012
• Status: Active Grant

• Current Assignee: Pinterest, Inc.
• Original Assignee: Pinterest, Inc.
• Inventors: Silbermann, Ben, Sharp, Evan, Sciarra, Paul, Jenkins, Jon
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): Le, Jessica N
• Application Number:
  US13/774,999
• Time in Patent Office: 2,447 Days
• Field of Search: 707722
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information

Abstract

This disclosure describes, in part, systems and methods that enable users to manage, search for, share and discover objects based on a context of the object from the user'"'"'s perspective. The same object may have vastly different meanings (context) to different individuals based on how they experience the object. Rather than managing objects solely based on information about the object, the implementations described allow users to specify a context for the object and manage objects based on that context. In addition, external sources may provide supplemental information about objects and/or representations of objects.

Claims

1. A computer-implemented method, comprising:

under control of one or more computing systems configured with executable instructions,

receiving, from a device associated with a user, a representation of a physical object, a textual description of the representation, and first location information that is indicative of a first geographic location where the representation was captured;

determining an identity of the physical object based on one or more of;

an image processing of the representation;

the textual description;

or

the first location information;

determining, based at least in part on the identity of the physical object, an external source of the physical object that is different than the user;

receiving, from the external source, a plurality of supplemental information corresponding to the physical object, wherein;

a first supplemental information of the plurality of supplemental information includes a purchase control to enable purchase of the physical object from the external source;

a second supplemental information includes first information about the physical object and has a first characteristic; and

a third supplemental information includes second information about the physical object and has a second characteristic, wherein;

the second supplemental information is different than the third supplemental information; and

the first characteristic is different than the second characteristic;

generating an object identifier that includes the representation and associations with the textual description and the plurality of supplemental information;

storing the object identifier in a data store;

receiving, subsequent to storing the object identifier in a data store, a request for the object identifier;

determining, based at least in part on second location information that is indicative of a second geographic location from which the request is received, a context corresponding to the request, wherein the second geographic location is different than the first geographic location;

determining that the context corresponds to the first characteristic of the second supplemental information;

in response to determining that the context corresponds to the first characteristic of the second supplemental information and based at least in part on the second location information;

generating a prepared object identifier that includes the representation and the second supplemental information, without including the third supplemental information;

including the purchase control of the first supplemental information in the prepared object identifier such that the physical object can be purchased from the external source through interaction with the purchase control; and

sending, for presentation via the device, the prepared object identifier that includes the purchase control and the second supplemental information, without sending the third supplemental information.

2. The computer-implemented method of claim 1, further comprising:

identifying a second representation of a second physical object, wherein the second representation is not received from a device associated with the user;

receiving a second textual description of the second representation from a second device of a second user; and

determining fourth supplemental information based at least in part on the second textual description and the second representation.

3. The computer-implemented method of claim 2, further comprising:

generating a second object identifier that includes the second representation and an association with the fourth supplemental information;

including the object identifier and the second object identifier in a set of a plurality of object identifiers; and

wherein the textual description and the second textual description are associated by the object identifier and the second object identifier being included in the set.

4. The computer-implemented method of claim 1, further comprising:

receiving a second request from a second device for the object identifier; and

sending for presentation via the second device, a second prepared object identifier that includes at least the representation.

5. The computer-implemented method of claim 1, further comprising:

prior to including the first supplemental information, determining that the second location information corresponds to a third geographic location of the external source.

6. The computer-implemented method of claim 1, further comprising:

receiving a second request for the object identifier from a second device associated with a second user;

in response to the second request being received, generating a second prepared object identifier based on the object identifier and the plurality of supplemental information; and

sending to the second device, the second prepared object identifier.

7. The computer-implemented method of claim 1, further comprising:

determining a location of a plurality of locations of the external source that is nearest the second geographic location; and

wherein at least one of the context or the purchase control corresponds to the location of the plurality of locations.

8. The computer-implemented method of claim 1, wherein the supplemental information includes information about the external source that sells the physical object.

9. The computer-implemented method of claim 1, further comprising:

receiving, from the external source, a request to add the supplemental information to the representation;

determining that the external source is at least one of a source of the physical object or a verified source; and

wherein receiving, from the external source, is in response to determining that the external source is at least one of the source of the physical object or the verified source.

10. The computer-implemented method of claim 1, further comprising:

subsequent to sending for presentation via the device, the prepared object identifier, determining that the second supplemental information is to be updated;

sending a request to the external source for updated supplemental information;

receiving, from the external source, updated supplemental information; and

sending, for presentation via the device, the updated supplemental information.

11. The computer-implemented method of claim 1, further comprising:

periodically receiving, from the external source, updated supplemental information.

12. A non-transitory computer-readable storage medium storing instructions that when executed by one or more processors cause the one or more processors to at least:

cause a representation of a physical object, a textual description of the representation, and first location information indicative of a first geographic location where the representation was captured to be received from a first device associated with a first user;

determine an identity of the physical object based on one or more of;

an image processing of the representation;

the textual description;

or

the first location information;

determine, based at least in part on the identity of the physical object, an external source of the physical object that is different than the first user;

receive, from the external source, a plurality of supplemental information corresponding to the physical object, wherein;

a first supplemental information of the plurality of supplemental information includes a purchase control to enable purchase of the physical object from the external source;

a second supplemental information includes first information about the physical object and has a first characteristic; and

a third supplemental information includes second information about the physical object and has a second characteristic, wherein;

the second supplemental information is different than the third supplemental information; and

the first characteristic is different than the second characteristic;

generate an object identifier that includes the representation and associations with the textual description and the plurality of supplemental information;

store the object identifier in a data store;

receive, subsequent to storage of the object identifier in the data store, a request from a second device for the object identifier;

determine, based at least in part on a second user associated with the second device or second location information that is indicative of a second geographic location corresponding to the second device from which the request is received, a context corresponding to the request, wherein the second geographic location is different than the first geographic location;

determine that the context corresponds to the first characteristic of the second supplemental information;

in response to a determination that the context corresponds to the first characteristic of the second supplemental information and based at least in part on the second location information;

generate a prepared object identifier that includes the representation and the second supplemental information, without including the third supplemental information; and

send, for presentation via the second device, the prepared object identifier that includes the second supplemental information, without sending the third supplemental information.

13. The non-transitory computer-readable storage medium of claim 12, the instructions when executed by the one or more processors further causing the one or more processors to at least:

in response to the request, include the purchase control of the first supplemental information in the prepared object identifier.

14. The non-transitory computer-readable storage medium of claim 12, wherein the representation is associated with a plurality of textual descriptions.

15. A computing system, comprising:

one or more processors; and

a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to at least;

in response to a representation of a physical object, a textual description of the representation, and first location information indicative of a first geographic location where the representation was captured being received from a device associated with a user, determine, based at least in part on one or more of an image processing of the representation, the textual description, or the first location information, an identity of the physical object;

determine, based at least in part on the identity of the physical object, an external source of the physical object that is different than the user;

receive, from the external source, a plurality of supplemental information corresponding to the physical object, wherein;

a first supplemental information of the plurality of supplemental information includes a purchase control to enable purchase of the physical object from the external source;

a second supplemental information includes first information about the physical object and has a first characteristic; and

a third supplemental information includes second information about the physical object and has a second characteristic, wherein;

the second supplemental information is different than the third supplemental information; and

the first characteristic is different than the second characteristic;

generate an object identifier that includes the representation and associations with the textual description and the plurality of supplemental information;

store the object identifier in a data store;

receive, subsequent to storing the object identifier in a data store, a request for the object identifier;

determine, based at least in part on second location information that is indicative of a second geographic location from which the request is received, a context corresponding to the request, wherein the second geographic location is different than the first geographic location;

determine that the context does not correspond to the first characteristic of the second supplemental information or the second characteristic of the third supplemental information;

in response to determining that the context corresponds to the first characteristic of the second supplemental information and based at least in part on the second location information;

generate a prepared object identifier that includes the representation and the purchase control of the first supplemental information, without including the second supplemental information or the third supplemental information; and

cause the prepared object identifier to be sent to the device for presentation such that the user may initiate a purchase of the physical object from the external source by interacting with the purchase control.

16. The computing system of claim 15, wherein:

the purchase control includes a price and a buy button.