Method, System, and Computer Program Product for Obtaining Images to Enhance Imagery Coverage

• US 20130095855A1
• Filed: 10/13/2011
• Published: 04/18/2013
• Est. Priority Date: 10/13/2011
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bort, David
• Application Number:
  US13/272,556
• Publication Number:
  US 20130095855A1
• Time in Patent Office: Days
• US Class Current: 455/456.2
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data

Abstract

Systems, methods, computer programs, and user interfaces are provided to identify a number of target geographic elements failing to satisfy an image threshold based on spatial data, generate a number of image requests, each of the image requests being associated with a target geographic element of the target geographic elements failing to satisfy the image threshold, transmit an image request of the plurality of image requests to a mobile user device, the image request including a geographic location of the target geographic element, receive an image of the target geographic element from the mobile user device, and store the image in an image repository so that an imagery coverage includes the image of the target geographic element.

Claims

1. A method of obtaining images to enhance imagery coverage, the method comprising:

identifying by one or more processors a plurality of target geographic elements that fail to satisfy an image threshold based on spatial data;

generating by the one or more processors a plurality of image requests, each of the plurality of image requests being associated with a target geographic element of the plurality of target geographic elements;

transmitting by the one or more processors an image request of the plurality of image requests to a mobile user device, the image request comprising a geographic location of the target geographic element;

receiving by the one or more processors an image of the target geographic element from the mobile user device; and

storing the image in an image repository so that the imagery coverage includes the image of the target geographic element.

2. The method of claim 1, further comprising:

determining that the image satisfies criteria of the target geographic element, the criteria comprising at least one criterion of a group consisting of a resolution criterion, a location criterion, a composition criterion, a quality criterion, and a time criterion,

wherein the image is associated with the target geographic element after determining that the image satisfies the criteria.

3. The method of claim 1, further comprising:

receiving an initial location of the mobile user device from the mobile user device; and

transmitting the image request from the plurality of image requests based on the initial location so that a user of the mobile user device is within a predetermined distance of the geographic location.

4. The method of claim 3, wherein the image request further comprises a user reward that is determined based on a distance between the initial location and a target location of the image.

5. The method of claim 1, further comprising:

determining a plurality of revised target geographic elements failing to satisfy the image threshold based on the image; and

generating a plurality of revised image requests, each of the plurality of revised image requests being associated with one of the plurality of revised target geographic elements.

6. The method of claim 1, further comprising:

transmitting candidate geographic elements to users of a map service; and

receiving user requests for the image of the target geographic element from the users of the map service.

7. The method of claim 6, wherein the image request further comprises a user reward that is determined based on a quantity of the users submitting the user requests for the image of the target geographic element.

8. The method of claim 1, wherein the geographic location includes geographic coordinates determined based on a signal from a positioning device.

9. The method of claim 1, wherein the target geographic element is a target point of interest, wherein the image is stored after determining that the image depicts the target point of interest.

10. The method of claim 9, wherein determining that the image depicts the target point of interest comprises:

receiving orientation information and an image location of the image from the mobile user device; and

determining the image depicts the target point of interest based on the orientation information and the image location.

11. The method of claim 9, wherein determining that the image depicts the target point of interest comprises:

performing object recognition on the image to identify the target point of interest in the image.

12. The method of claim 1, wherein the target geographic element is one selected from a group consisting of a target point of interest and a target geographic area.

13. The method of claim 1, wherein the target geographic element is a target geographic area, and wherein the image threshold specifies a minimum quantity of images for the target geographic area.

14. A method of obtaining images, the method comprising:

receiving at a user device an image request associated with a target geographic element, the image request comprising guidance for obtaining an image of the target geographic element;

displaying the guidance for obtaining the image on a video display of the user device, the guidance overlaying a video stream from a camera of a user;

capturing the image of the target geographic element;

determining a location of the user device; and

transmitting the image and the location to an application server.

15. The method of claim 14, wherein displaying the guidance for obtaining the image comprises:

performing object recognition of a stored frame of the video stream to identify a target location of the image request; and

presenting a target highlight over the target location in the video stream.

16. The method of claim 15, further comprising:

determining an orientation of the camera; and

repositioning the target highlight to remain over the target location as the orientation of the camera changes.

17. The method of claim 15, further comprising:

determining an orientation of the camera; and

displaying a direction highlight based on the orientation for directing the camera towards the target location.

18. The method of claim 15, further comprising sending an initial location of the user device to the application server, wherein the image request further comprises a user reward that is determined based on a distance between the initial location and the target location of the image.

19. The method of claim 18, further comprising:

displaying target annotations comprising a description of the user reward on the video display.

20. The method of claim 18, wherein the user reward is a social reward of a social networking service.

21. The method of claim 14, wherein the location is a global location determined based on a global positioning system signal.

22. A system, comprising:

one or more memories;

one or more processors, each operatively connected to at least one of the one or more memories;

a device interface stored on the one or more memories, the device interface being executed by the one or more processors to;

transmit an image request of a plurality of image requests to a mobile user device, the image request comprising guidance for obtaining an image of a target geographic element of a plurality of target geographic elements; and

receive the image of the target geographic element from the mobile user device;

a target manager module stored on the one or more memories, the target manager module being executed by the one or more processors to;

identify the plurality of target geographic elements that fail to satisfy an image threshold based on spatial data; and

generate the plurality of image requests, each of the plurality of image requests being associated with the target geographic element; and

an image repository in which the image of the target geographic element is stored so that an imagery coverage of the image repository includes the image.

23. The system of claim 22, further comprising an image manager module stored on the memory, the image manager module being executed by the one or more processors to:

determine that the image satisfies criteria of the target geographic element, the criteria comprising at least one criterion of a group consisting of a resolution criterion, a location criterion, a composition criterion, a quality criterion, and a time criterion,

wherein the image is associated with the target geographic element after determining that the image satisfies the criteria.

24. The system of claim 22, further comprising a location manager module stored on the memory, the location manager module being executed by the one or more processors to:

receive an initial location from the mobile user device; and

transmitting to the mobile user device the image request from the plurality of image requests based on the initial location.

25. The system of claim 24, the location manager module being further executed by the processor to generate a user reward based on a distance between the initial location and a target location of the image.

26. The system of claim 22, the target manager module being further executed by the one or more processors to:

determine a plurality of revised target geographic elements failing to satisfy the image threshold based on the image; and

generate a plurality of revised image requests, each of the plurality of revised image requests being associated with one of the plurality of revised target geographic elements.

27. The system of claim 22, wherein the target geographic element is a target point of interest, wherein the image is stored after the target manager module is further executed by the processor to determine that the image comprises the target point of interest.

28. The system of claim 22, wherein the image threshold specifies a minimum quantity of images for the target geographic element.

29. The system of claim 22, further comprising the user device to:

receive the image request associated with the target geographic element from the device interface;

display the guidance for obtaining the image on a video display of the user device, the guidance overlaying a video stream from a camera of the user device;

capture the image for the image request;

determine a location of the user device; and

transmit the image and the location to the device interface.

30. A non-transitory computer readable medium having computer-executable program instructions embodied therein causing one or more computer processors to:

identify a plurality of target geographic elements that fail to satisfy an image threshold based on spatial data;

generate a plurality of image requests, each of the plurality of image requests being associated with a target geographic element of the plurality of target geographic elements;

transmit an image request of the plurality of image requests to a mobile user device, the image request comprising guidance for obtaining an image of the target geographic element;

receive the image of the target geographic element; and

store the image of the target geographic element in an image repository so that an imagery coverage of the image repository includes the image.

31. The computer readable medium of claim 30, the computer-executable program instructions further causing the computer processor to:

determine that the image satisfies criteria of the target geographic element, the criteria comprising at least one criterion of a group consisting of a resolution criterion, a location criterion, a composition criterion, a quality criterion, and a time criterion,

wherein the image is associated with the target geographic element after the determining that the image satisfies the criteria.

32. The computer readable medium of claim 30, the computer-executable program instructions further causing the computer processor to:

receive an initial location from the mobile user device; and

select the image request from the plurality of image requests based on the initial location.

33. The computer readable medium of claim 30, the computer-executable program instructions further causing the computer processor to:

determine a plurality of revised target geographic elements failing to satisfy the image threshold based on the image; and

generate a plurality of revised image requests, each of the plurality of revised image requests being associated with one of the plurality of revised target geographic elements.

34. The computer readable medium of claim 30, wherein the target geographic element is a target point of interest, wherein the image is stored after determining that the image comprises the target point of interest.

35. The computer readable medium of claim 34, wherein the computer processor determines that the image comprises the target point of interest by:

receiving orientation information and an image location of the image from the mobile user device; and

determining the image comprises the target point of interest based on the orientation information and the image location.

36. The computer readable of claim 34, wherein the computer processor determines that the image comprises the target point of interest by:

performing object recognition on the image to identify the target point of interest in the image.

37. A non-transitory computer readable medium having computer-executable program instructions embodied therein causing a computer processor to:

receive at a user device an image request associated with a target geographic element, the image request comprising guidance for obtaining an image of the target geographic element;

display the guidance for obtaining the image on a video display of the user device, the guidance overlaying a video stream from a camera of the user device;

capture the image for the image request;

determine a location of the user device; and

transmit the image and the location to an application server.