System and method for providing live imagery associated with map locations

• US 9,836,826 B1
• Filed: 09/14/2016
• Issued: 12/05/2017
• Est. Priority Date: 01/30/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Filip, Daniel Joseph
• Primary Examiner(s): Elahi, Shan
• Application Number:
  US15/264,937
• Time in Patent Office: 447 Days
• Field of Search: 348149
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G09B 29/007 using computer methods
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Near real-time imagery of a given location may be provided to user upon request. Most popularly viewed geographic locations are determined, and a 360 degree image capture device is positioned at one or more of the determined locations. The image capture device may continually provide image information, which is processed, for example, to remove personal information and filter spam. Such image information may then be provided to users upon request. The image capture device continually captures multiple views of the given location, and the requesting user can select which perspective to view.

Claims

1. A computer-implemented method comprising:

receiving, by one or more servers, live images of one or more remote geographical locations from at least one image capture device positioned at each of the one or more geographical locations, wherein the one or more geographical locations are remote from the one or more servers, the received live images including a 360 degree field of view around the at least one image capture device;

receiving, by the one or more servers, a request from a user device for live images corresponding to a given one of the one or more remote geographical locations;

providing, by the one or more servers, live images to the user device for display, the live images corresponding to the given remote geographical location;

continually receiving, by the one or more servers, input regarding a point of view selected for the requested live images, the point of view corresponding to a portion of the 360 degree field of view around the at least one image capture device; and

continually updating, by the one or more servers, the provided live images corresponding to the given remote geographical location based on received input regarding the selected point of view.

2. The method of claim 1, further comprising processing, by the one or more computing devices, the received live images wherein the processing includes automatically detecting and obscuring personal information from the received live images.

3. The method of claim 2, wherein obscuring the detected personal information comprises blurring the detected personal information.

4. The method of claim 3, wherein the personal information includes at least one of human faces and license plate numbers.

5. The method of claim 2, wherein processing the received live images comprises detecting and filtering spam data, the filtering including at least one of removing unauthorized images or obscuring unauthorized content from the received live images.

6. The method of claim 1, wherein:

receiving the request for live images includes receiving at least one of position and direction information associated with the requested images; and

determining the point of view associated with the requested live images is based on the at least one of position and direction information.

7. The method of claim 6, wherein the at least one of position and direction information is received through manipulation of icons, entered text, or speech commands.

8. The method of claim 6, wherein the at least one of position and direction information is received through a user'"'"'s navigation through a depiction of the location.

9. A system comprising:

at least one image capture device positioned at a geographical location;

one or more processors in communication with the image capture device, wherein the geographical location is remote from the one or more processors, the one or processors programmed to;

receive live images of the remote geographical location from the at least one image capture device, the received live images including a 360 degree field of view around the at least one image capture device;

receive a request from a user device for live images corresponding to the remote geographical location;

provide live images corresponding to remote geographical location to the user device for display;

continually receiving input from the user device regarding a point of view selected for the requested live images, the point of view corresponding to a portion of the 360 degree field of view around the at least one image capture device; and

continually updating the provided live images corresponding to the remote geographical location based on the received input regarding the selected point of view.

10. The system of claim 9, wherein the one or more processors are further programmed to process the received live images, wherein the processing includes automatically detecting and obscuring personal information from the received live images.

11. The system of claim 10, wherein obscuring the detected personal information comprises blurring the detected personal information.

12. The system of claim 11, wherein the personal information includes at least one of human faces and license plate numbers.

13. The system of claim 10, wherein processing the received live images comprises detecting and filtering spam data, the filtering including at least one of removing unauthorized images or obscuring unauthorized content from the received live images.

14. The system of claim 9, wherein:

receiving the request for live images includes receiving at least one of position and direction information associated with the requested images; and

determining the point of view associated with the requested live images is based on the at least one of position and direction information.

15. The system of claim 14, wherein the at least one of position and direction information is received through manipulation of icons, entered text, or speech commands.

16. The system of claim 14, wherein the at least one of position and direction information is received through a user'"'"'s navigation through a depiction of the location.

17. A non-transitory computer-readable medium storing information and instructions executable by a processor for performing a method of providing live images, the method comprising:

receiving, at the processor, live images of a remote geographical location from at least one image capture device, the received live images including a 360 degree field of view around the at least one image capture device;

receiving a request for live images from a user device, the live images corresponding to the remote geographical location;

providing live images corresponding to the remote geographical location to the user device for display;

continually determining a point of view selected by the user device for the requested live images, the point of view corresponding to a portion of the 360 degree field of view around the at least one image capture device; and

continually updating the provided live images corresponding to the remote geographical location based on the selected point of view.

18. The non-transitory computer-readable medium of claim 17, wherein:

receiving the request for live images includes receiving at least one of position and direction information associated with the requested images; and

determining the point of view associated with the requested live images is based on the at least one of position and direction information.

19. The non-transitory computer-readable medium of claim 18, wherein the at least one of position and direction information is received through manipulation of icons, entered text, or speech commands.

20. The non-transitory computer-readable medium of claim 18, wherein the at least one of position and direction information is received through a user'"'"'s navigation through a depiction of the location.