Modification of images and associated text

• US 9,984,100 B2
• Filed: 09/29/2015
• Issued: 05/29/2018
• Est. Priority Date: 09/29/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Shioya, Tomohiro, Tada, Masami, Watanabe, Shoichiro
• Primary Examiner(s): Vu, Kim
• Assistant Examiner(s): DELANEY, MOLLY K
• Application Number:
  US14/868,726
• Publication Number:
  US 20170091224A1
• Time in Patent Office: 973 Days
• Field of Search: None
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/70 Labelling scene content, e.g. deriving syntactic or semantic representations

Abstract

A computer-implemented method includes receiving an image. The image includes one or more objects and one or more text portions. The computer-implemented method further includes identifying the one or more objects. The computer-implemented method further includes, for each of the one or more objects identified, extracting an object tag. The computer-implemented method further includes, for each of the one or more text portions, extracting a text tag. The computer-implemented method further includes, for each text tag, determining whether the text tag describes any of the one or more objects based on the object tag extracted from each object to yield a determination. The computer-implemented method further includes, responsive to the determination: performing an image process to that of the one or more objects, and performing a text process to that of the one or more text portions. A corresponding computer program product and computer system are also disclosed.

Claims

1. A computer program product, the computer program product comprising:

one or more computer processors;

one or more non-transitory computer readable storage devices;

computer program instructions;

said computer program instructions being stored on said one or more non-transitory computer readable storage devices for execution by said one or more computer processors; and

said computer program instructions comprising instructions to;

perform a text process to an image, wherein the text process comprises instructions to;

assign a type of speech part to one or more objects included in an image, wherein said type of speech part assigned to each of said one or more objects is based, at least in part, on a selection sequence of said one or more objects; and

generate text corresponding to each of said one or more objects selected based, at least in part, on said type of speech part assigned to each of said one or more objects.

2. The computer program product of claim 1, wherein said instructions to generate text corresponding to each of said one or more objects selected is further based on contextual information associated with each of said one or more objects.

3. The computer program product of claim 1, further comprising instructions to:

identify said one or more objects included in said image; and

extract an object tag for each object of said one or more objects.

4. The computer program product of claim 3, wherein said instructions to generate text corresponding to each of said one or more objects selected is further based on said object tag extracted for each object.

5. The computer program product of claim 3, wherein each object tag extracted for said one or more objects is displayed in a tag list.

6. The computer program product of claim 5, further comprising instructions to perform a first image process on a first object included in said image based, at least in part, on a selection of a first object tag displayed in said tag list.

7. The computer program product of claim 1, further comprising instructions to perform a second image process on a second object included in said image based, at least in part, on a selection of said second object.

8. The computer program product of claim 7, wherein said instruction to perform said second image process is further based, at least in part, on contextual information associated with said second object.

9. The computer program product of claim 7, wherein said instructions to perform said second image process is further based, at least in part, on historical selection data associated with said second object.