Image processing apparatus and image processing method

• US 10,699,390 B2
• Filed: 03/28/2018
• Issued: 06/30/2020
• Est. Priority Date: 09/30/2015
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Yamamoto, Kazuhiko
• Primary Examiner(s): Bost, Dwayne D
• Assistant Examiner(s): Brinich, Stephen M
• Application Number:
  US15/938,293
• Publication Number:
  US 20180218480A1
• Time in Patent Office: 825 Days
• Field of Search: 382282-284, 382276, 382293-297
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/265 Mixing

Abstract

An image processing apparatus includes a processor and a memory having stored thereon instructions executable by the processor to cause the image processing apparatus to perform: calculating, with respect to each of a plurality of captured images obtained by successively capturing a subject, an evaluation index as an index as to whether a capturing condition is appropriate or not for each of a plurality of partial images of the each of the plurality of captured images corresponding to different areas of the subject; selecting the plurality of partial images corresponding to the different areas of the subject from the plurality of captured images based on the evaluation indices of the partial images; and synthesizing the plurality of selected partial images in positions corresponding to partial images in a reference image obtained by capturing the subject.

Claims

1. An image processing apparatus comprising:

a memory storing instructions; and

a processor that implements the instructions to;

zone a plurality of capture partial images, which have been obtained by successively capturing portions of a musical score containing a plurality of staffs disposed parallel to each other, each including every aggregation of a predetermined number of adjoining staffs;

calculate an evaluation index regarding whether a capturing condition is appropriate or not for each of the plurality of captured partial images corresponding to different areas of the musical score;

select partial images, among the plurality of captured partial images, based on the evaluation indices of the plurality of captured partial images; and

synthesize the selected partial images in positions corresponding to respective partial images in a reference image obtained by capturing the musical score.

2. The image processing apparatus according to claim 1, wherein:

the processor implements the instructions to detect a plurality of musical characters from the plurality of captured partial images and a plurality of musical characters respectively disposed in predetermined positions of the plurality of staffs, and

the evaluation index of each of the plurality of captured partial image corresponds to a ratio of the staffs in a staff area intersecting a musical character array of the plurality of musical characters in positions of the musical characters.

3. The image processing apparatus according to claim 1, wherein the selected partial images are synthesized to the reference image so that corresponding ones of feature points extracted from the reference image and feature points extracted from the selected partial images coincide with each other.

4. The image processing apparatus according to claim 1, wherein the processor implements the instructions to:

successively calculate the evaluation index for each of the plurality of captured partial images, each constituting a moving image obtained by capturing the musical score while capturing the moving image;

successively select each partial image based on the evaluation index while capturing the moving image; and

successively synthesize each partial image to the reference image while capturing the moving image.

5. An image processing method comprising:

zoning a plurality of captured partial images, which have been obtained by successively capturing portions of a musical score containing a plurality of staffs disposed parallel to each other, each including every aggregation of a predetermined number of adjoining staffs;

calculating an evaluation index regarding whether a capturing condition is appropriate or not for each of the plurality of captured partial images corresponding to different areas of the musical score;

selecting partial images, among the plurality of captured partial images, based on the evaluation indices of the plurality of captured partial images; and

synthesizing the selected partial images in positions corresponding to respective partial images in a reference image obtained by capturing the musical score.

6. The image processing method according to claim 5, further comprising:

detecting a plurality of musical characters from the plurality of captured partial images and a plurality of musical characters respectively disposed in predetermined positions of the plurality of staffs; and

wherein the evaluation index of each of the plurality of captured partial image corresponds to a ratio of the staffs in a staff area intersecting a musical character array of the plurality of musical characters in positions of the musical characters.

7. The image processing method according to claim 5, the selected partial images are synthesized to the reference image so that corresponding ones of feature points extracted from the reference image and feature points extracted from the selected partial images coincide with each other.

8. The image processing method according to claim 5, further comprising:

successively calculating the evaluation index for each of the plurality of captured partial images, each constituting a moving image obtained by capturing the musical score while capturing the moving image;

successively selecting each partial image based on the evaluation index while capturing the moving image; and

successively synthesizing each partial image to the reference image while capturing the moving image.