ADDING METADATA APPARATUS

• US 20120062597A1
• Filed: 03/14/2011
• Published: 03/15/2012
• Est. Priority Date: 09/14/2010
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation), Toshiba Digital Solutions Corporation (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Mori, Kouichirou
• Granted Patent: US 9,076,069 B2
• Time in Patent Office: Days
• US Class Current: 345/636
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/23109 by placing content in organized collections, e.g. EPG data repository details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/6547 comprising parameters, e.g. for client setup
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/44504 Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits

Abstract

An adding metadata apparatus includes a first acquisition unit which acquires a first image, first metadata, and a first position within the first image, the first position being for displaying the first metadata; an extraction unit which extracts local features from the first image; a calculation unit which searches for a group of the local features within a predetermined distance from the first position, and calculates a representative point of the group; a search unit which matches the first image with a plurality of images stored in a database by using the local features, and searches for a second image which coincides with the local features; and a registration unit which calculates a second position, within the second image, corresponding to the representative point, and registers the second position and the first metadata as metadata for the second image.

Claims

1. An adding metadata apparatus comprising:

a first acquisition unit which acquires a first image, first metadata, and a first position within the first image, the first position being for displaying the first metadata;

an extraction unit which extracts local features from the first image;

a calculation unit which searches for a group of the local features within a predetermined distance from the first position, and calculates a representative point of the group;

a search unit which matches the first image with a plurality of images stored in a database by using the local features, and searches for a second image which coincides with the local features; and

a registration unit which calculates a second position, within the second image, corresponding to the representative point, and registers the second position and the first metadata as metadata for the second image.

2. The adding metadata apparatus according to claim 1, further comprising:

a second acquisition unit which acquires second metadata attached to the second image; and

a display unit which displays the second image, and wherein

said display unit displays the first metadata and the second metadata on the second image.

3. The adding metadata apparatus according to claim 1, further comprising:

a second acquisition unit which acquires second metadata attached to the second image; and

a display unit which displays the first image, and wherein

said display unit displays the first metadata and the second metadata on the first image.

4. The adding metadata apparatus according to claim 1, wherein

said calculation unit obtains the representative point as a position of a local feature point within a predetermined distance from the position in the first image acquired by said first acquisition unit.

5. The adding metadata apparatus according to claim 1, wherein

said calculation unit obtains the representative point as a center of gravity position of the group of the local features.

6. The adding metadata apparatus according to claims 1, further comprising

an input unit inputting the first metadata or the first position by a user.

7. The adding metadata apparatus according to claim 6, wherein

said input unit specifies a position to which the user attaches metadata, by using said input device including a touch panel or a pointing device.

8. An adding metadata method comprising:

acquiring a first image, first metadata, and a first position within the first image, the first position being for displaying the first metadata;

extracting local features from the first image;

searching for a group of the local features within a predetermined distance from the first position, and calculating a representative point of the group by a calculation unit;

matching the first image with a plurality of images stored in a database by using the local features, and searching for a second image which coincides with the local features; and

calculating a second position, within the second image, corresponding to the representative point, and registering the second position and the first metadata as metadata for the second image.

9. The adding metadata method according to claim 8, further comprising:

acquiring second metadata attached to the second image; and

displaying the second image; and

wherein

the first metadata and the second metadata on the second image are displayed.

10. The adding metadata method according to claim 8, further comprising:

acquiring second metadata attached to the second image; and

displaying the first image, and wherein

the first metadata and the second metadata on the first image are displayed.

11. The adding metadata method according to claim 8, wherein

said calculating the representative point step by the calculation unit further includes obtaining the representative point as a position of a local feature point within a predetermined distance from the position in the first image.

12. The adding metadata method according to claim 8, wherein

said calculating a representative point step by a calculation unit further includes obtaining the representative point as a center of gravity position of the group of the local features.

13. The adding metadata method according to claims 8, further comprising

inputting the first metadata or the first position using an input unit by a user.

14. The adding metadata method according to claim 13, wherein

said inputting step further includes specifying a position to which the user attaches metadata, by using the input device including a touch panel or a pointing device.

15. An attaching metadata method comprising:

acquiring a first image, metadata to be attached to the first image and a target position of the first image into which the metadata is attached;

extracting local features of the first image

searching a model image having the local features similar to the local features extracted from the first image

acquiring a group of local feature points around the target point in the first image;

obtaining the local feature points in the model image searched as similar, said local future points corresponding to the group of local feature points in the first image; and

attaching the metadata of the first image at the local feature points in the model image as metadata for the second image, said local feature points obtained by said obtaining step.

16. The attaching metadata method according to claims 15, further comprising

obtaining local feature points of a new image, said local feature points corresponding to the local feature points of the model image, when the new image is acquired and the new image is substantially similar to the model image;

obtaining a representative point of the local feature points of the acquired new image; and

attaching the metadata of the model image to the representative point of the acquired new image.