IMAGE DISPLAY APPARATUS AND IMAGE DISPLAY METHOD

• US 20110273474A1
• Filed: 07/22/2011
• Published: 11/10/2011
• Est. Priority Date: 01/30/2009
• Status: Abandoned Application

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: IWAYAMA, Naomi
• Application Number:
  US13/188,804
• Publication Number:
  US 20110273474A1
• Time in Patent Office: Days
• US Class Current: 345/636
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body

Abstract

A PC displaying an image on a display unit accepts handwriting input to the image, and displays the accepted handwriting on the image. The PC detects object regions including a certain object in the image and comment placement regions corresponding to respective object regions. If the starting position of the first stroke of handwriting is included in any one of the object regions, the PC determines that the accepted handwriting is directed to the object region. When the input of the handwriting to the object region is finished, the PC identifies a display region for the handwriting and changes the size of the input handwriting so as to display the input handwriting in the comment placement region corresponding to the object region. The PC displays the size-changed handwriting in the identified display region and further displays a comment balloon surrounding the displayed handwriting.

Claims

1. An image display apparatus comprising:

an image display unit to display an image on a screen;

a handwriting acceptance unit to accept handwriting input to the image;

a handwriting display unit to display the handwriting on the image;

a detection unit to detect one or more object regions including respective one or more certain objects included in the image;

an object region display unit to display information indicating the object region on the image;

a determination unit to determine whether the handwriting is directed to any one of the object regions or not on the basis of the handwriting and the object region;

an object identification unit that, in a case where the determination unit determines that the handwriting is directed to any one of the object regions, identifies an identified region being the object region to which the handwriting is directed;

a placement region identification unit to identify a placement region for placing the handwriting to the identified region;

a calculator to calculate a scaling ratio in a scaling process executed on the handwriting for displaying the handwriting in the placement region;

a scaling unit to execute the scaling process on the handwriting according to the scaling ratio;

a display region extraction unit to extract a display region for displaying handwriting after the scaling process from the placement region; and

a scaled handwriting display unit to display the handwriting after the scaling process in the display region.

2. The image display apparatus according to claim 1, further comprising:

a placement region detector to detect a candidate region in which handwriting to the object region is placed; and

a storing unit to associate the candidate region with the object region and to store the associated regions,

wherein the placement region identification unit selects the placement region from among the candidate regions when the identified region is identified.

3. The image display apparatus according to claim 1, further comprising an association display unit to display a symbol for associating the handwriting displayed by the scaled handwriting display unit and the identified region with each other on the image.

4. The image display apparatus according to claim 1, wherein the detection unit detects a region including a face included in the image.

5. The image display apparatus according to claim 1,

wherein the determination unit determines whether the handwriting is handwriting to any one of the object regions or not on the basis of whether a starting position of a first stroke of handwriting accepted by the handwriting acceptance unit is in any one of the object regions or not, and

the object identification unit identifies that the handwriting is directed to the object region that is determined by the determination unit to include the starting position of the first stroke of the handwriting.

6. The image display apparatus according to claim 5, further comprising

a determination region display unit to regard a prescribed extent in each object region as a determination region and to display information indicating the determination region,

wherein the determination unit determines whether the handwriting is directed to anyone of the object regions or not on the basis of whether the starting position of the first stroke of handwriting accepted by the handwriting acceptance unit is in the determination region or not.

7. The image display apparatus according to claim 1, further comprising:

a discrimination unit that, in a case where the determination unit determines that the handwriting is directed to any one of the object regions, discriminates whether the first stroke of the handwriting accepted by the handwriting acceptance unit has a prescribed length or not;

a determination region display unit that, in a case where the discrimination unit discriminates that the first stroke of the handwriting has at least the prescribed length, displays information indicating a prescribed determination region at a finishing position of the first stroke of the handwriting; and

a monitoring unit that, in a case where the determination region display unit displays information indicating the prescribed determination region, monitors whether or not the handwriting acceptance unit accepts the handwriting whose input is started in the prescribed determination region,

wherein the handwriting acceptance unit, in a case of accepting the handwriting whose input is started in the prescribed determination region, accepts the handwriting whose input is started in the prescribed determination region as handwriting to the identified region.

8. The image display apparatus according to claim 7,

wherein the monitoring unit monitors whether or not the handwriting acceptance unit accepts the handwriting whose input is started in the prescribed determination region in a prescribed time after the determination region display unit displays the information indicating the prescribed determination region, and

the determination region display unit, in a case where the handwriting acceptance unit does not accept the handwriting whose input is started in the prescribed determination region in a prescribed time after displaying the information indicating the prescribed determination region, finishes displaying the information indicating the prescribed determination region.

9. The image display apparatus according to claim 1,

wherein the determination unit determines that the handwriting accepted by the handwriting acceptance unit is directed to any one of the object regions, and subsequently, in a case where the handwriting acceptance unit does not accept the handwriting for a prescribed time, determines that input of the handwriting is finished, and

the calculator, in a case where the determination unit determines that the input of the handwriting is finished, calculates the scaling ratio.

10. The image display apparatus according to claim 1, further comprising:

a character string recognition unit to execute character string recognition on the handwriting accepted by the handwriting acceptance unit; and

a character string determination unit for determining whether or not the handwriting is a character string on the basis of a result of the character string recognition,

wherein, in a case where the character string determination unit determines that the handwriting is a character string, the calculator calculates the scaling ratio.

11. The image display apparatus according to claim 1, further comprising:

a character string recognition unit to execute character string recognition on the handwriting accepted by the handwriting acceptance unit; and

a character string determination unit for determining whether the handwriting is a character string or not on the basis of a result of the character string recognition,

wherein, in a case where the character string determination unit determines that the handwriting is a character string, the display region extraction unit extracts a display region in which the character string recognized by the character string recognition unit is displayed from the placement region, and,

the scaled handwriting display unit displays the character string recognized by the character string recognition unit in the display region extracted by the display region extraction unit using prescribed font information.

12. The image display apparatus according to claim 1, further comprising:

a handwriting storing unit to associate the handwriting accepted by the handwriting acceptance unit and information indicating the placement region with each other and to store the associated handwriting and the information in association with the handwriting after the scaling process;

an operation discrimination unit to discriminate whether or not a prescribed operation is performed on the handwriting after the scaling process stored in the handwriting storing unit;

an input handwriting display unit that, in a case where the operation discrimination unit discriminates that the prescribed operation is performed, displays handwriting that is accepted by the handwriting acceptance unit and stored in the handwriting storing unit in association with the handwriting after the scaling process, on the image; and

a change acceptance unit to accept a change on the handwriting displayed by the input handwriting display unit,

wherein the handwriting acceptance unit accepts the handwriting after the change accepted by the change acceptance unit on the handwriting displayed by the input handwriting display unit,

the calculator calculates the scaling ratio in the scaling process that is executed on the changed handwriting for display in the placement region that is stored in the handwriting storing unit in association with the handwriting after the scaling process in which the operation discrimination unit discriminates that the handwriting after the change accepted by the handwriting acceptance unit has been subjected to a prescribed operation,

the scaling unit executes the scaling process on the changed handwriting according to the scaling ratio calculated by the calculator, and

the display region extraction unit extracts a display region in which the handwriting after the scaling process is displayed, from the placement region stored in the handwriting storing unit.

13. The image display apparatus according to claim 1, further comprising imaging unit to take an image.

14. An image display method including:

displaying an image on a display unit;

accepting handwriting input to the displayed image;

displaying the accepted handwriting on the image;

detecting one or more object regions including respective one or more prescribed objects included in the image;

displaying information indicating the detected object region on the image;

determining whether the handwriting is directed to any one of the detected object regions or not on the basis of the accepted handwriting and the detected object region;

identifying an identified region being the object region to which the handwriting is directed when the handwriting is directed to any one of the object regions;

identifying a placement region for placing the handwriting to the identified region;

calculating a scaling ratio in a scaling process executed on the handwriting for displaying the handwriting in the identified placement region;

executing the scaling process on the handwriting according to the calculated scaling ratio;

extracting a display region for displaying handwriting after the scaling process from the identified placement region; and

displaying the handwriting after the scaling process in the extracted display region.

15. A storing medium storing a computer program causing a computer to execute processes of:

displaying an image on a display unit,

accepting handwriting input to the displayed image,

displaying the accepted handwriting on the image,

detecting one or more object regions including respective one or more prescribed objects included in the image;

displaying information indicating the detected object region on the image;

determining whether the handwriting is directed to any one of the detected object regions or not on the basis of the accepted handwriting and the detected object region;

identifying an identified region being the object region to which the handwriting is directed when the handwriting is directed to any one of the object regions;

identifying a placement region for placing the handwriting to the identified region;

calculating a scaling ratio in a scaling process executed on the handwriting for displaying the handwriting in the identified placement region;

executing the scaling process on the handwriting according to the calculated scaling ratio;

extracting a display region for displaying handwriting after the scaling process from the identified placement region; and

displaying the handwriting after the scaling process in the extracted display region.