IMAGE PROCESSING DEVICE, IMAGE PROCESSING DEVICE CONTROL METHOD, PROGRAM, AND INFORMATION STORAGE MEDIUM

• US 20150149883A1
• Filed: 05/16/2012
• Published: 05/28/2015
• Est. Priority Date: 05/16/2012
• Status: Active Grant

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: Rakuten, Inc. (Rakuten Group, Inc.)
• Inventors: Masuko, Soh
• Granted Patent: US 9,996,516 B2
• Time in Patent Office: Days
• US Class Current: 715/232
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation

Abstract

Provided is an image processing device capable of displaying an annotation in an appropriate position. An image obtaining unit obtains an image. An annotation target information obtaining unit obtains annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image. An annotation information obtaining unit obtains annotation information indicating an annotation. A display position determination unit determines a display position of the annotation based on the position or the area of the annotation target. A data output unit outputs data on the image with the annotation displayed in the display position determined by the display position determination unit.

Claims

1. An image processing device, comprising:

an image obtaining unit that obtains an image;

an annotation target information obtaining unit that obtains annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image;

an annotation information obtaining unit that obtains annotation information indicating an annotation;

a display position determination unit that determines a display position of the annotation based on a position or an area of the annotation target; and

a data output unit that outputs data on the image with the annotation displayed in the display position determined by the display position determination unit.

2. The image processing device according to claim 1, wherein another annotation is already added to the image, and

the display position determination unit comprises a unit that determines the display position of the annotation based on the position or the area of the annotation target and a display position of the other annotation.

3. The image processing device according to claim 1, wherein

another annotation is already added to the image, and

the display position determination unit comprises a unit that determines the display position of the annotation based on the position or the area of the annotation target and a position or an area of an annotation target corresponding to the other annotation.

4. The image processing device according to claim 1, wherein annotation is already added to the image, and

the display position determination unit comprises a unit that determines the display position of the annotation and a new display position of the other annotation based on the position or the area of the annotation target and a position or an area of an annotation target corresponding to the other annotation.

5. The image processing device according to claim 1, wherein the display position determination unit comprises:

a unit that determines, as to each of a plurality of kinds of annotation types, a display position of an annotation belonging to the type in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the type, and

a unit that determines, when the annotation information is obtained by the annotation obtaining unit, a display position of an annotation indicated by the annotation information based on a display position candidate corresponding to a type to which the annotation belongs.

6. The image processing device according to claim 5, wherein

the plurality of kinds of annotation types are set based on at least one of a length, a display color, a display size, and a writing direction of an annotation.

7. The image processing device according to claim 5, wherein

the display position determination unit, comprises:

a unit that determines, as to each of a plurality of kinds of length information concerning a length of an annotation, a display position of an annotation having a length indicated by the length information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the length information, and

a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a length of the annotation.

8. The image processing device according to claim 5, wherein

the display position determination unit comprises:

a unit that determines, as to each of a plurality of kinds of display color information concerning a display color of an annotation, a display position of an annotation having a display color indicated by the display color information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the display color information, and

a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a display color of the annotation.

9. The image processing device according to claim 5, wherein

the display position determination unit comprises:

a unit that determines, as to each of a plurality of kinds of display size information concerning a display size of an annotation, a display position of an annotation having a display size indicated by the display size information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the display size information, and

a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a display size of the annotation.

10. The image processing device according to claim 5, wherein

the display position determination unit comprises:

a unit that determines, as to each of a plurality of kinds of writing direction information concerning a writing direction of an annotation, a display position of an annotation having a writing direction indicated by the writing direction information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the writing direction information, and

a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a writing direction of the annotation.

11. The image processing device according to claim 5, wherein

another annotation is already added to the image, and

the display position determination unit comprises:

a unit that determines, as to each of a plurality of kinds of annotation types, the display position of the annotation and a new display position of the other annotation assuming a case where the annotation belongs to the type, based on the position or the area of the annotation target and a position or an area of an annotation target corresponding to the other annotation, and obtains the determined display position as a display position candidate corresponding to the type, and

a unit that determines, when the annotation information is obtained by the annotation obtaining unit, a display position of an annotation indicated by the annotation information and the new display position of the other annotation based on a display position candidate corresponding to a type to which the annotation belongs.

12. The image processing device according to claim 1, wherein

the display position determination unit comprises a unit that determines the display position of the annotation based on at least one of a size and a shape of the area of the annotation target.

13. The image processing device according to claim 1, wherein

the display position determination unit comprises a unit that determines the display position of the annotation based on the position or the area of the annotation target and at least one of a length, a display color, a display size, and a writing direction of the annotation.

14. The image processing device according to claim 1, further comprising:

a unit that obtains an edge amount of a pixel of the image, wherein

the display position determination unit comprises a unit that determines the display position of the annotation based on the edge amount of the pixel of the image and the position or the area of the annotation target.

15. The image processing device according to claim 1, further comprising:

a unit that obtains a saliency map of the image, wherein

the display position determination unit comprises a unit that determines the display position of the annotation based on the saliency map and the position or the area of the annotation target.

16. The image processing device according to claim 1, further comprising:

a unit that specifies an annotation target candidate included in the image; and

a unit that determines the display position of the annotation in a case where it is assumed that the annotation is added to the annotation target candidate, based on a position or an area of the annotation target candidate, and obtains the determined display position as the display position candidate, wherein

the display position determination unit comprises a unit that determines the display position of the annotation based on the display position candidate, when the annotation target indicated by the annotation target information corresponds to the annotation target candidate.

17. An image processing device control method, comprising:

obtaining an image;

obtaining annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image;

obtaining annotation information indicating an annotation;

determining a display position of the annotation based on a position or an area of the annotation target; and

outputting data on the image with the annotation displayed in the determined display position.

18. (canceled)

19. A non-transitory computer readable information storage medium storing a program for causing a computer to:

obtain an image;

obtain annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image;

obtain annotation information indicating an annotation;

determine a display position of the annotation based on a position or an area of the annotation target; and

output data on the image with the annotation displayed in the determined display position.