Method for determining at least one relevant single image of a dental subject

• US 9,549,668 B2
• Filed: 10/30/2013
• Issued: 01/24/2017
• Est. Priority Date: 10/30/2012
• Status: Active Grant

• Current Assignee: Sirona Dental Systems GmbH (Sirona Dental Systems Incorporated)
• Original Assignee: Sirona Dental Systems GmbH (Sirona Dental Systems Incorporated)
• Inventors: Schmitt, Bernhard
• Primary Examiner(s): Baker, Charlotte M
• Application Number:
  US14/439,826
• Publication Number:
  US 20150289756A1
• Time in Patent Office: 1,182 Days
• Field of Search: 704/235, 704/275, 705/3, 455/556.1, 455/414.1, 455/466, 455/555, 455/566, 348/66, 348/E5.025, 434/263, 600/109, 600/112, 433/29
• US Class Current: 1/1
• CPC Class Codes: A61B 1/000094 extracting biological structures
• CPC Class Codes: A61B 1/04 combined with photographic or television appliances
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61C 9/004 Means or methods for taking digitized impressions
• CPC Class Codes: A61C 9/0053 Optical means or methods, e.g. scanning the teeth by a laser or light beam
• CPC Class Codes: A61C 9/006 projecting one or more stripes or patterns on the teeth
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 21/007 characterised by the process used
• CPC Class Codes: G10L 25/57 for processing of video signals
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

The invention relates to a method for determining at least one relevant single image, wherein a plurality of single optical images are generated during a continuous optical measurement (3) of a dental subject (1) to be recorded. During the optical measurement (3) an audio recording is generated by means of a microphone (4) and at least one speech sequence (12; 15; 28) spoken by a user (6) is recorded. The relevant single image (7; 8; 24) is then selected within a specified sequence duration between a start time (17, 18) and an end time of the speech sequence (12; 15; 28).

Claims

1. A method of selecting an image from a plurality of images, comprising:

receiving a plurality of optical images generated during an optical measurement of a dental object by a dental camera;

receiving audio data corresponding to an audio recording generated during the optical measurement;

selecting, based on the audio data and the plurality of optical images, an image from the plurality of optical images,

wherein the selected image was recorded between a start time and an end time of a speech sequence included in the audio recording and was recorded at a time during the speech sequence when a movement of the dental camera relative to the dental object was a local minimum.

2. The method as recited in claim 1, further comprising:

filtering background noise from the audio data to improve the audio quality of the speech sequence.

3. The method as recited in claim 2, wherein the filtering continues within a previously defined variable time.

4. The method as recited in claim 1, wherein a maximum duration of the speech sequence is predefined.

5. The method as recited in claim 1, wherein the speech sequence corresponds to the duration of a contiguous flow of speech, and wherein brief interruptions of the flow of speech that are shorter than a predefined interruption duration are ignored.

6. The method as recited in claim 5, wherein the predefined interruption duration is no more than two seconds.

7. The method as recited in claim 1, wherein the optical measurement of the dental object is by an optical three-dimensional stripe projection method, and

wherein the plurality of optical images of the dental object are combined into a three-dimensional overall recording.

8. The method as recited in claim 1, further comprising:

converting status information and/or finding information included in the speech sequence to text form.

9. The method as recited in claim 8, further comprising:

assigning the text form of the status information and/or finding information to the selected image.

10. The method as recited in claim 1, further comprising:

selecting, based on the audio data and the plurality of optical images, another image from the plurality of optical images,

wherein the other selected image was recorded between another start time and another end time of another speech sequence included in the audio recording and was recorded at a time during the other speech sequence when a movement of the dental camera relative to the dental object was a local minimum; and

displaying the selected image and the other selected image on a display device.

11. The method as recited in claim 10, further comprising:

determining respective positions of the selected image and the other selected image relative to the dental object using anatomical information included in the speech sequence and anatomical information included in the other speech sequence; and

displaying the selected image and the other selected image at their respective positions relative to a virtual model of the dental object.

12. The method as recited in claim 1, further comprising:

sorting the selected image into one or more categories of status information and/or finding information.

13. The method as recited in claim 1, wherein the plurality of optical images respectively correspond to individual frames of a video recording.

14. An apparatus for selecting an image from a plurality of images, comprising:

a computer configured to;

receive a plurality of optical images generated during an optical measurement of a dental object by a dental camera,

receive audio data corresponding to an audio recording generated during the optical measurement, and

select, based on the audio data and the plurality of optical images, an image from the plurality of optical images,

wherein the selected image was recorded between a start time and an end time of a speech sequence included in the audio recording and was recorded at a time during the speech sequence when a movement of the dental camera relative to the dental object was a local minimum.

15. The apparatus as recited in claim 14, wherein the computer is further configured to combine the plurality of optical images of the dental object into a three-dimensional overall recording.

16. The apparatus as recited in claim 14, wherein the computer is further configured to convert status information and/or finding information included in the speech sequence to text form.

17. The apparatus as recited in claim 16, wherein the computer is further configured to assign the text form of the status information and/or finding information to the selected image.

18. The apparatus as recited in claim 14, further comprising:

a display device,

wherein the computer is further configured to;

select, based on the audio data and the plurality of optical images, another image from the plurality of optical images, wherein the other selected image was recorded between another start time and another end time of another speech sequence included in the audio recording and was recorded at a time during the other speech sequence when a movement of the dental camera relative to the dental object was a local minimum, and

cause the display device to display the selected image and the other selected image.

19. The apparatus as recited in claim 18, wherein the computer is further configured to:

determine respective positions of the selected image and the other selected image relative to the dental object using anatomical information included in the speech sequence and anatomical information included in the other speech sequence, and

cause the display unit to display the selected image and the other selected image at their respective positions relative to a virtual model of the dental object.