MODIFICATION OF IMAGES AND ASSOCIATED TEXT

• US 20170091224A1
• Filed: 09/29/2015
• Published: 03/30/2017
• Est. Priority Date: 09/29/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Shioya, Tomohiro, Tada, Masami, Watanabe, Shoichiro
• Granted Patent: US 9,984,100 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/70 Labelling scene content, e.g. deriving syntactic or semantic representations

Abstract

A computer-implemented method includes receiving an image. The image includes one or more objects and one or more text portions. The computer-implemented method further includes identifying the one or more objects. The computer-implemented method further includes, for each of the one or more objects identified, extracting an object tag. The computer-implemented method further includes, for each of the one or more text portions, extracting a text tag. The computer-implemented method further includes, for each text tag, determining whether the text tag describes any of the one or more objects based on the object tag extracted from each object to yield a determination. The computer-implemented method further includes, responsive to the determination: performing an image process to that of the one or more objects, and performing a text process to that of the one or more text portions. A corresponding computer program product and computer system are also disclosed.

Claims

1. A computer-implemented method comprising:

receiving an image, said image comprising one or more objects and one or more text portions;

identifying said one or more objects of said image;

for each of said one or more objects identified, extracting an object tag;

for each of said one or more text portions, extracting a text tag;

for each said text tag;

determining whether said text tag describes any of said one or more objects based on said object tag extracted from each of said one or more objects to yield a determination; and

responsive to said determination;

performing an image process to that of said one or more objects; and

performing a text process to that of said one or more text portions.

2. The computer-implemented method of claim 1, wherein performing an image process to said one or more objects of said image is responsive to selecting at least one of said object or said object tag.

3. The computer-implemented method of claim 1, wherein performing a text process to said one or more text portions of said image is responsive to selecting at least one of said object or said object tag.

4. The computer-implemented method of claim 1, wherein performing an image process to said one or more objects of said image is based on contextual information of said one or more objects of said image.

5. The computer-implemented method of claim 1, wherein performing an image process to said one or more objects of said image is based on selection data of each said object or each said object tag.

6. The computer-implemented method of claim 1, wherein each said object tag is displayed in a tag list.

7. The computer-implemented method of claim 1, wherein responsive to successfully determining said text tag describes any of said one or more objects, said object tag extracted from said object is displayed with visual emphasis in said tag list.

8. The computer-implemented method of claim 1, wherein said text process comprises generating text based on at least one user selection from said one or more objects or said one or more object tags.

9. The computer-implemented method of claim 8, wherein said user selection indicates an assignment of a speech part to each said object based on a selection sequence.

10. A computer program product, the computer system comprising:

one or more computer processors;

one or more computer readable storage media;

computer program instructions;

said computer program instructions being stored on said one or more computer readable storage media for execution by said one or more computer processors; and

said computer program instructions comprising instructions to;

receive an image, said image comprising one or more objects and one or more text portions;

identify said one or more objects of said image;

for each of said one or more objects identified, extract an object tag;

for each of said one or more text portions, extract a text tag;

for each said text tag;

determining whether said text tag describes any of said one or more objects based on said object tag extracted from each of said one or more objects to yield a determination; and

responsive to said determination;

performing an image process to that of said one or more objects; and

performing a text process to that of said one or more text portions.

11. The computer program product of claim 10, wherein said instructions to perform an image process to said one or more objects of said image is responsive to selecting at least one of said object or said object tag.

12. The computer program product of claim 10, wherein said instructions to perform a text process to said one or more text portions of said image is responsive to selecting at least one of said object or said object tag.

13. The computer program product of claim 10, wherein said instructions to perform an image process to said one or more objects of said image is based on contextual information of said one or more objects of said image.

14. The computer program product of claim 10, wherein said instructions to perform an image process to said one or more objects of said image is based on selection data of each said object or each said object tag.

15. The computer program product of claim 10, wherein each said object tag is displayed in a tag list.

16. The computer program product of claim 10, wherein said instructions to perform a text process to each said text process comprises generating text based on at least one user selection from said one or more objects or said one or more object tags.

17. The computer program product of claim 16, wherein said user selection indicates an assignment of a speech part to each said object based on a selection sequence.

18. A computer system, the computer system comprising:

one or more computer processors;

one or more computer readable storage media;

computer program instructions;

said computer program instructions being stored on said one or more computer readable storage media;

said computer program instructions comprising instructions to;

receive an image, said image comprising one or more objects and one or more text portions;

identify said one or more objects of said image;

for each of said one or more objects identified, extract an object tag;

for each of said one or more text portions, extract a text tag;

for each said text tag;

determining whether said text tag describes any of said one or more objects based on said object tag extracted from each of said one or more objects to yield a determination; and

responsive to said determination;

performing an image process to that of said one or more objects; and

performing a text process to that of said one or more text portions.

19. The computer system of claim 18, wherein instructions to perform an image process to said one or more objects of said image is responsive to selecting at least one of said object or said object tag.

20. The computer system of claim 18, wherein said instructions to perform a text process to said one or more text portions of said image is responsive to selecting at least one of said object or said object tag.

21. The computer system of claim 18, wherein said instructions to perform an image process to said one or more objects of said image is based on contextual information of said one or more objects of said image.

22. The computer system of claim 18, wherein said instructions to perform an image process to said one or more objects of said image is based on selection data of each said object or each said object tag.

23. The computer system of claim 18, wherein each said object tag is displayed in a tag list.

24. The computer system of claim 18, wherein said instructions to perform a text process comprises generating text based on at least one user selection from said one or more objects or said one or more object tags.

25. The computer system of claim 24, said user selection indicates an assignment of a speech part to each said object based on a selection sequence.