Database searching and retrieval using phoneme and word lattice

• US 7,257,533 B2
• Filed: 09/22/2005
• Issued: 08/14/2007
• Est. Priority Date: 03/05/1999
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Garner, Philip Neil, Charlesworth, Jason Peter Andrew, Rajan, Jebu Jacob
• Primary Examiner(s): Storm; Donald L.
• Application Number:
  US11/231,739
• Publication Number:
  US 20060015339A1
• Time in Patent Office: 691 Days
• Field of Search: None
• US Class Current: 704/249
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G10L 15/187 Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams

Abstract

A data structure is provided for annotating data files within a database. The annotation data comprises a phoneme and word lattice which allows the quick and efficient searching of data files within the database in response to a user'"'"'s input query. The structure of the annotation data is such that it allows the input query to be made by voice and can be used for annotating various kinds of data files, such as audio data files, video data files, multimedia data files etc. The annotation data may be generated from the data files themselves or may be input by the user either from a voiced input or from a typed input.

Claims

1. A method of searching a data file including annotation data, in response to an input query, the method comprising:

generating query data corresponding to the input query;

searching the data file based on at least one query datum and the annotation data; and

outputting search results in dependence upon the result of said searching step,

wherein the query data is a lattice containing phoneme and word data.

2. A method according to claim 1, wherein said annotation data defines a phoneme and word lattice comprising:

(i) data for defining a plurality of nodes within the phoneme and word lattice and a plurality of links connecting the nodes within the phoneme and word lattice;

(ii) data for associating a plurality of phonemes of the phoneme data with a respective plurality of links; and

(iii) data for associating at least one word with at least one of said links connecting the nodes within the phoneme and word lattice.

3. An apparatus for searching a data file including annotation data, in response to an input query, the apparatus comprising:

a generator operable to generate query data corresponding to the input query;

a searcher operable to search the data file based on at least one query datum and the annotation data; and

an output operable to output search results in dependence upon the result of said searcher,

wherein the query data is a lattice containing phoneme and word data.

4. An apparatus according to claim 3, wherein said annotation data defines a phoneme and word lattice comprising:

(i) data defining a plurality of nodes within the phoneme and word lattice and a plurality of links connecting the nodes within the phoneme and word lattice;

(ii) data associating a plurality of phonemes of the phoneme data with a respective plurality of links; and

(iii) data associating at least one word with at least one of said links connecting the nodes within the phoneme and word lattice.

5. A computer program product comprising machine-readable program code recorded on a machine-readable recording medium, for controlling the operation of a data processing apparatus on which the program code executes to perform a method of searching a data file including annotation data, in response to an input query, the method comprising:

generating query data corresponding to the input query;

searching the data file based on at least one query datum and the annotation data; and

outputting search results in dependence upon the results of said searching step,

wherein the query data is a lattice containing phoneme and word data.