Determining images of interest based on a geographical location

• US 10,387,487 B1
• Filed: 01/18/2019
• Issued: 08/20/2019
• Est. Priority Date: 01/25/2018
• Status: Active Grant

• Current Assignee: Ikorongo Technology, LLC (Concert Technology Corporation)
• Original Assignee: Ikorongo Technology, LLC (Concert Technology Corporation)
• Inventors: Svendsen, Hugh Blake
• Primary Examiner(s): Whipple, Brian
• Application Number:
  US16/251,880
• Time in Patent Office: 214 Days
• Field of Search: None
• CPC Class Codes: G06F 16/535 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

Methods, systems, and devices are described for identifying images which may be of interest to a user based on their current geographic location. In some embodiments, a check is first performed to determine if the current geographic location is a location-of-interest. Images are searched that are in geographical proximity to the current geographic location of the user to identify images-of-interest. The images-of-interest may be designated in part based on actions taken by subjects having had interactions with the images. The user is notified based on the discovery of one or more images-of-interest. The one or more images-of-interest may be presented to the user through the use of map overlays and/or augmented reality techniques.

Claims

1. A server device comprising:

a communications interface operable to;

couple the server device to a plurality of mobile devices, the plurality of mobile devices including a first mobile device associated with a first user account of a first user and a plurality of other mobile devices associated with other user accounts of a plurality of other users; and

a processor and memory coupled to the communications interface and operable to;

identify a current geographic location of the first mobile device of the plurality of mobile devices as a location-of-interest based on a location affinity score;

identify an image captured in geographical proximity to the location-of-interest as an image-of-interest based on a first user profile of the first user account; and

send, to the first mobile device of the plurality of mobile devices, first information identifying the image-of-interest.

2. The server device of claim 1 further comprising:

the processor and the memory further operable to;

identify the image captured in geographical proximity to the location-of-interest as the image-of-interest in response to identifying the current geographic location of the first mobile device of the plurality of mobile devices as the location-of-interest; and

send, to the first mobile device of the plurality of mobile devices, the first information identifying the image-of-interest in response to identifying the image captured in geographical proximity to the location-of-interest as the image-of-interest.

3. The server device of claim 1 further comprising:

the processor and the memory, in building the first user profile of the first user account, the first user profile including subject affinities, further operable to;

retrieve a plurality of images from a first image collection linked to the first user account;

retrieve social graph information for the first user account; and

analyze the plurality of images from the first image collection and the social graph information to determine the subject affinities between the first user of the first mobile device and the other users of the other mobile devices.

4. The server device of claim 3 further comprising:

the processor and the memory, in determining the subject affinities of the first user profile, further operable to;

analyze symmetric social network connections between the first user and ones of other users;

analyze asymmetric social network connections between the first user and the ones of other users;

analyze occurrences of subject faces of the plurality of other users appearing in the plurality of images in the first image collection; and

analyze co-occurrences of a subject face of the first user of the first mobile device and other subject faces of the plurality of other users of the other mobile devices occurring the plurality of images in the first image collection.

5. The server device of claim 1 further comprising:

the processor and the memory in building the first user profile of the first user account, the first user profile including a geographical location history, further operable to;

collect geographic location data for the first mobile device on a periodic basis;

store the geographic location data in a tracking database; and

determine a home location using the geographic location data.

6. The server device of claim 1 further comprising:

the processor and the memory, in determining the location affinity score, further operable to;

determine a distance between the current geographical location and a home geographical location;

determine a number of days since the current geographical location was visited;

determine a total number of times that the current geographical location was visited; and

determine the location affinity score based on the distance between the current geographical location and the home geographical location, the number of days since the current geographical location was visited, and the total number of times that the current geographical location was visited.

7. The server device of claim 6 further comprising:

the processor and the memory, in determining if the current geographical location of a first device represents the location-of-interest, further operable to;

compute the location affinity score to be proportional to the distance between the current geographical location and the home geographical location a last time that the current geographical location was visited and inversely proportional to the total number of times that the current geographical location was visited.

8. The server device of claim 6 further comprising:

the processor and the memory further operable to;

modify the location affinity score based on an exclusion bias applied to the current geographic location, wherein the exclusion bias is determined from taking a sum of one or more geographic shapes in which the current geographic location falls, each shape derived from a user profile of a user; and

modify the location affinity score based on a promotional bias applied to the current geographic location, wherein the promotional bias is determined from taking the sum of one or more geographic shapes in which the current geographic location falls, each of the one or more geographic shapes specified by an advertiser and assigned a value based on a remuneration received from the advertiser.

9. The server device of claim 6 further comprising:

the processor and the memory further operable to;

perform a comparison of the location affinity score to a location threshold value; and

based on the comparison, determine that the image is the image-of-interest.

10. The server device of claim 1 further comprising:

the processor and the memory in identifying one or more images-of-interest in the geographical proximity to the location-of-interest further operable to;

designate a search area based on the location-of-interest; and

identify the image as having been captured within the search area surrounding the location-of-interest as the image-of-interest.

11. The server device of claim 10 wherein a size of the search area is designated based on a speed of travel of the first mobile device as measured over a time interval.

12. The server device of claim 10 wherein a shape of the search area is designated based on a direction of travel of the first mobile device as measured over a time interval.

13. The server device of claim 10 wherein a size of the search area is designated based on an altitude of travel of the first mobile device as measured over a time interval.

14. The server device of claim 1 further comprising:

the processor and the memory, in determining if the image represents the image-of-interest, further operable to;

determine an image affinity score; and

based on the image affinity score, determine if the image is the image-of-interest.

15. The server device of claim 14 further comprising:

the processor and the memory, in determining the image affinity score, further operable to;

determine subjects associated with the image by identifying;

a first other user having captured the image;

one or more second other users appearing as subject faces in the image; and

one or more third other users contributing comments to the image; and

determine action weights by;

designating a first action weight for the one or more second other users appearing as subject faces in the image;

designating a second action weight for the one or more third other users contributing comments to the image; and

designating a third action weight for the one or more third other users contributing comments to the image; and

compute the image affinity score by;

determining a first partial score based on a first subject affinity of the first other user and the first action weight;

determining a second partial score based on second subject affinities of the one or more second other users and the second action weight; and

determining a third partial score based on third subject affinities of the one or more third other users and the third action weight; and

determining the image affinity score based on the first partial score, the second partial score, and the third partial score.

16. The server device of claim 15 further comprising:

the processor and the memory further operable to;

scale the subject affinities of the one or more second other users appearing as the subject faces in the image based on a size of a subject face in relation to dimensions of the image and a location of the subject face within the image.

17. The server device of claim 15 further comprising:

the processor and the memory, in determining the image affinity score, further operable to;

determine a distance between the current geographical location and a capture location of the image; and

modify the image affinity score based on the distance.

18. The server device of claim 15 further comprising:

the processor and the memory, in determining the image affinity score, further operable to;

modify the image affinity score based on an exclusion bias applied to a geographic capture location of the image, wherein the exclusion bias is determined from taking a sum of one or more geographic shapes in which the geographic capture location of the image falls, each of the one or more shapes derived from a user profile of a user; and

modify the image affinity score based on a promotional bias applied to the geographic capture location of the image, wherein the promotional bias is determined from taking the sum of one or more geographic shapes in which the geographic capture location of the image falls, each of the one or more geographic shapes specified by an advertiser and assigned a value based on a remuneration received from the advertiser.

19. The server device of claim 15 further comprising:

the processor and the memory, in determining the image affinity score, further operable to;

compute the image affinity score for the image to be;

proportional to the subject affinity score; and

inversely proportional to a distance between the current geographical location and a geographic capture location.

20. The server device of claim 15 further comprising:

the processor and the memory, in determining if the image represents the image-of-interest, further operable to;

perform a comparison of the image affinity score to an image threshold value; and

based on the comparison, determine that the image is the image-of-interest.

21. The server device of claim 1 further comprising:

the processor and the memory, in sending the first information identifying the image-of-interest, further operable to;

receive, from the first mobile device of the plurality of mobile devices, second information identifying user interactions with the image-of-interest at the first mobile device; and

adjust parameter weights of subject affinity sources and subject actions based on the second information identifying the user interactions.

22. The server device of claim 21 further comprising:

the processor and the memory, in sending the first information identifying the image-of-interest, further operable to;

send promotional information associated with the image to the first mobile device, the promotional information including one or more adornments configured for presentation with the image.

23. The server device of claim 21 further comprising:

the processor and the memory, in sending the first information identifying the image-of-interest, further operable to;

receive, from the first mobile device, user interaction feedback, the user interaction feedback including;

time difference between a user device of a user receiving a notification identifying the image,

time spent by the user device of the user interacting with the image,

comments added using the user device of the user,

likes applied using the user device of the user, and

dislikes applied using the user device of the user.

24. The server device of claim 23 further comprising:

the processor and the memory further operable to;

receive, from the plurality of other mobile devices associated with the other user accounts of the plurality of other users, a plurality of other images; and

identify, from the plurality of other images, the image-of-interest.

25. The server device of claim 1 wherein the image-of-interest is one of one or more images-of-interest and the location-of-interest is one of one or more locations-of-interest.

26. A method of operating a server device comprising:

identifying a current geographic location of a mobile device as a location-of-interest based on a location affinity score;

identifying an image captured in geographical proximity to the location-of-interest as an image-of-interest based on a user profile of a user account associated with the mobile device; and

sending, to the mobile device, information identifying the image-of-interest.

27. A non-transient computer readable medium storing program codes that when executed by a processor of a server device render the server device operable to:

identify a current geographic location of a mobile device as a location-of-interest based on a location affinity score;

identify an image captured in geographical proximity to the location-of-interest as an image-of-interest based on a user profile of a user account associated with the mobile device; and

send, to the mobile device, information identifying the image-of-interest.