Systems and methods for generating three-dimensional image models using game-based image acquisition

• US 9,662,564 B1
• Filed: 12/30/2013
• Issued: 05/30/2017
• Est. Priority Date: 03/11/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Hensel, Chase, Zhao, Ze Hong, Chen, Liyong
• Primary Examiner(s): Drennan, Barry
• Assistant Examiner(s): Pringle-Parker, Jason
• Application Number:
  US14/143,498
• Time in Patent Office: 1,247 Days
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/35 Details of game servers
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player

Abstract

Embodiments include a method of generating a three-dimensional (3D) image model using a game-based image acquisition. The method including determining a location of a user device, identifying images to be acquired to generate a 3D model of an area surrounding the location, displaying a virtual gaming view that includes targets corresponding to locations of the images to be acquired, wherein the targets move within the virtual gaming view relative to movement of the user device, and a goal of a game includes moving the user device to align a field of view of a camera of the user device with the targets, in response to determining that the field of view of the camera aligns with a target, acquiring an image depicting an image scene corresponding to the field of view of the camera, and generating a 3D image model of an area surrounding the location using the image.

Claims

1. A computer-implemented method of generating a three-dimensional (3D) image model using a game-based image acquisition environment, the method comprising:

identifying a game score of a game;

determining an initial geographical location of a user device;

identifying images to be acquired to generate a 3D image model of an area surrounding the location;

displaying, in a graphical user interface of the user device, a virtual gaming view comprising two or more targets corresponding to locations of the images to be acquired, each target comprising a graphical object, wherein a position of the targets move within the virtual gaming view relative to movement of the user device, and wherein a goal of the game includes moving the user device to align a field of view of a camera of the user device with the one or more targets;

in response to determining that the field of view of the camera aligns with a first target, acquiring a first image depicting a first image scene corresponding to the field of view of the camera;

in response to determining that the field of view of the camera aligns with a second target, acquiring a second image depicting a second image scene corresponding to the field of view of the camera;

generating the 3D image model of the area surrounding the location using the first and second images;

storing, in memory, the 3D image model in association with the location; and

when it is determined that the field of view of the camera aligns with a given one of the two or more targets, updating the game score of the game based on the alignment.

2. The method of claim 1, further comprising:

determining a first updated game score based on the acquisition of the first image;

displaying the first updated score in the virtual gaming environment;

determining a second updated game score based on the acquisition of the second image; and

displaying the second updated score in the virtual gaming environment.

3. The method of claim 1, wherein determining that the field of view of the camera aligns with a target comprises determining a position of the user device, and determining that the camera is directed to a location of an image to be acquired based at least in part on the position of the user device.

4. The method of claim 1, wherein determining that the field of view of the camera aligns with a target is provided in response to a user input to engage a target.

5. The method of claim 3, wherein the user input to engage a target comprises user selection of a shoot button configured to simulate shooting of the target.

6. The method of claim 1, further comprising displaying a target location guide indicating locations of targets relative to a current position of the user device, wherein the target location guide is updated in response to movement of the user device.

7. The method of claim 1, wherein generating a 3D image model of an area surrounding the location using the first and second images comprises stitching together a plurality of images to generating the 3D image model of an area surrounding the location, the plurality of images including the first and second images.

8. A system comprising:

one or more memories storing instructions; and

one or more processors coupled to the one or more memories and configured to execute the instructions stored thereon to cause the following steps for generating a three-dimensional (3D) image model using a game-based image acquisition environment;

identifying a game score of a game;

determining an initial geographical location of a user device;

identifying images to be acquired to generate the 3D image model of an area surrounding the location;

displaying, in a graphical user interface of the user device, a virtual gaming view comprising two or more targets corresponding to locations of the images to be acquired, each target comprising a graphical object, wherein a position of the targets move within the virtual gaming view relative to movement of the user device, and wherein a goal of the game includes moving the user device to align a field of view of a camera of the user device with the one or more targets;

in response to determining that the field of view of the camera aligns with a first target, acquiring a first image depicting a first image scene corresponding to the field of view of the camera;

in response to determining that the field of view of the camera aligns with a second target, acquiring a second image depicting a second image scene corresponding to the field of view of the camera;

generating the 3D image model of the area surrounding the location using the first and second images;

storing, in memory, the 3D image model in association with the location; and

when it is determined that the field of view of the camera aligns with a given one of the two or more targets, updating the game score of the game based on the alignment.

9. The system of claim 8, the steps further comprising:

determining a first updated game score based on the acquisition of the first image;

displaying the first updated score in the virtual gaming environment;

determining a second updated game score based on the acquisition of the second image; and

displaying the second updated score in the virtual gaming environment.

10. The system of claim 8, wherein determining that the field of view of the camera aligns with a target comprises determining a position of the user device, and determining that the camera is directed to a location of an image to be acquired based at least in part on the position of the user device.

11. The system of claim 8, wherein determining that the field of view of the camera aligns with a target is provided in response to a user input to engage a target.

12. The system of claim 11, wherein the user input to engage a target comprises user selection of a shoot button configured to simulate shooting of the target.

13. The system of claim 8, the steps further comprising displaying a target location guide indicating locations of targets relative to a current position of the user device, wherein the target location guide is updated in response to movement of the user device.

14. The system of claim 8, wherein generating a 3D image model of an area surrounding the location using the first and second images comprises stitching together a plurality of images to generating the 3D image model of an area surrounding the location, the plurality of images including the first and second images.

15. A non-transitory computer readable medium comprising program instructions stored thereon that are executable by a processor to cause the following steps for generating a three-dimensional (3D) image model using a game-based image acquisition environment:

identifying a game score of a game;

determining an initial geographical location of a user device;

identifying images to be acquired to generate a 3D image model of an area surrounding the location;

displaying, in a graphical user interface of the user device, a virtual gaming view comprising two or more targets corresponding to locations of the images to be acquired, each target comprising a graphical object, wherein a position of the targets move within the virtual gaming view relative to movement of the user device, and wherein a goal of the game includes moving the user device to align a field of view of a camera of the user device with the one or more targets;

in response to determining that the field of view of the camera aligns with a first target, acquiring a first image depicting a first image scene corresponding to the field of view of the camera;

in response to determining that the field of view of the camera aligns with a second target, acquiring a second image depicting a second image scene corresponding to the field of view of the camera;

generating the 3D image model of the area surrounding the location using the first and second images;

storing, in memory, the 3D image model in association with the location; and

when it is determined that the field of view of the camera aligns with a given one of the two or more targets, updating the game score of the game based on the alignment.

16. The medium of claim 15, the steps further comprising:

determining a first updated game score based on the acquisition of the first image;

displaying the first updated score in the virtual gaming environment;

determining a second updated game score based on the acquisition of the second image; and

displaying the second updated score in the virtual gaming environment.

17. The medium of claim 15, wherein determining that the field of view of the camera aligns with a target comprises determining a position of the user device, and determining that the camera is directed to a location of an image to be acquired based at least in part on the position of the user device.

18. The medium of claim 15, wherein determining that the field of view of the camera aligns with a target is provided in response to a user input to engage a target.

19. The medium of claim 18, wherein the user input to engage a target comprises user selection of a shoot button configured to simulate shooting of the target.

20. The medium of claim 15, the steps further comprising displaying a target location guide indicating locations of targets relative to a current position of the user device, wherein the target location guide is updated in response to movement of the user device.