SYSTEM AND METHOD FOR AUGMENTING AN IMAGE WITH STYLIZED FEATURES

• US 20180293439A1
• Filed: 03/23/2018
• Published: 10/11/2018
• Est. Priority Date: 04/05/2017
• Status: Active Grant

• Current Assignee: Direct Cursus Technology LLC
• Original Assignee: Yandex Europe AG (Yandex N.V.)
• Inventors: Slesarev, Anton Viktorovich, Korzunov, Anton Vasilyevich, Tokarev, Roman Borisovich
• Granted Patent: US 10,643,071 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/20084 Artificial neural networks [ANN]
• CPC Class Codes: G06T 2207/30184 Infrastructure
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/174 involving the use of two or more images
• CPC Class Codes: G06V 10/82 using neural networks
• CPC Class Codes: G06V 20/176 Urban or other man-made structures
• CPC Class Codes: G06V 20/39 Urban scenes

Abstract

A system and method is provided for augmenting an image with stylized features. An exemplary method includes identifying, in a first image, a first version of an object having a first set of graphical features and identifying, in a second image, a second version of the object having a second set of graphical features. Moreover, the method includes extracting the first and second sets of graphical features from the first and second images, respectively, and generating a third set of graphical features by calculating differences between the first and second sets of graphical features. Finally, using the third set of graphical features, the method includes augmenting the first version of the object in the first image.

Claims

1. A method for augmenting an image, the method comprising:

identifying, in a first image, a first version of an object having a first set of graphical features;

identifying, in a second image, a second version of the object having a second set of graphical features, wherein the first and second version of the object represent the same object;

extracting the first and second sets of graphical features from the first and second images, respectively;

generating a third set of graphical features by calculating differences between the first set of graphical features of the first version of the object and the second set of graphical features of the second version of the object; and

augmenting the first version of the object in the first image based on the third set of graphical features.

2. The method according to claim 1, further comprising:

providing a graphical filter based on a stylization of a graphical view of the first image; and

transforming the third set of graphical features based on the graphical filter.

3. The method according to claim 2, wherein the augmenting of the first version of the object in the first image is based on the transformed third set of graphical features.

4. The method according to claim 1, further comprising causing the first image to be displayed after the augmenting of the first version of the object in the first image.

5. The method according to claim 1, wherein the generating of the third set of graphical features comprises generating a null third set of graphical features if the second version of the object is not included in the second image.

6. The method according to claim 5, wherein the augmenting of the first version of the object in the first image comprises removing the object from the first image in response to the null third set of graphical features.

7. The method according to claim 1, further comprising determining changes in at least one of a color, shape, size and texture of the object between the first version and the second version of the object based on the third set of graphical features.

8. The method according to claim 7, wherein the augmenting of the first version of the object in the first image comprises stylizing the object based on the determined changes in the at least one of a color, shape, size and texture of the object.

9. A system for augmenting a digital image, the system comprising:

a database configured to store a first image including a first version of an object having a first set of graphical features; and

a processor configured to;

receive a second image including a second version of the object having a second set of graphical features, wherein the first and second version of the object represent the same object,

extract the first and second sets of graphical features from the first and second images, respectively;

generate a third set of graphical features by calculating differences between the first set of graphical features of the first version of the object and the second set of graphical features of the second version of the object; and

augment the first version of the object in the first image based on the third set of graphical features.

10. The system according to claim 9, wherein the processor is further configured to:

generate a graphical filter based on a stylization of a graphical view of the first image; and

transform the third set of graphical features based on the graphical filter.

11. The system according to claim 10, wherein the processor is further configured to augment the first version of the object in the first image based on the transformed third set of graphical features.

12. The system according to claim 9, wherein the processor is further configured to cause the first image to be displayed after the augmenting of the first version of the object in the first image.

13. The system according to claim 9, wherein the processor is further configured to generate the third set of graphical features as a null third set of graphical features if the second version of the object is not included in the second image.

14. The system according to claim 13, wherein the processor is further configured to augment the first version of the object in the first image by removing the object from the first image in response to the null third set of graphical features.

15. The system according to claim 9, wherein the processor is further configured to determine changes in at least one of a color, shape, size and texture of the object between the first version and the second version of the object based on the third set of graphical features.

16. The system according to claim 15, wherein the processor is further configured to augment the first version of the object in the first image by stylizing the object based on the determined changes in the at least one of a color, shape, size and texture of the object.

17. The system according to claim 9, wherein the second image is generated based on image data obtained by a satellite.

18. A non-transitory computer readable medium comprising computer executable instructions for augmenting an image, including instructions for:

identifying, in a first image, a first version of an object having a first set of graphical features;

identifying, in a second image, a second version of the object having a second set of graphical features, wherein the first and second version of the object represent the same object;

extracting the first and second sets of graphical features from the first and second images, respectively;

generating a third set of graphical features by calculating differences between the first set of graphical features of the first version of the object and the second set of graphical features of the second version of the object; and

augmenting the first version of the object in the first image based on the third set of graphical features.

19. The non-transitory computer readable medium according to claim 18, further comprising instructions for:

providing a graphical filter based on a stylization of a graphical view of the first image; and

transforming the third set of graphical features based on the graphical filter.

20. The non-transitory computer readable medium according to claim 18, wherein the augmenting of the first version of the object in the first image is based on the transformed third set of graphical features.