Monitor display apparatus

• US 6,738,516 B1
• Filed: 06/16/1999
• Issued: 05/18/2004
• Est. Priority Date: 06/18/1998
• Status: Expired due to Term

• Current Assignee: Minolta Corporation Limited (Konica Minolta Inc.)
• Original Assignee: Minolta Corporation Limited (Konica Minolta Inc.)
• Inventors: Nakanishi, Motohiro, Hagimori, Hitoshi, Kondo, Takashi, Ban, Shinichi
• Primary Examiner(s): MARIAM, DANIEL G
• Application Number:
  US09/333,995
• Time in Patent Office: 1,798 Days
• Field of Search: 382/100, 382/103, 382/131, 382/154, 382/181, 382/190, 382/254, 382/275, 382/276, 382/286, 382/291, 382/309, 382/311, 345/419, 345/420, 345/424, 345/700, 356/12, 356/14, 356/601, 356/602, 356/603, 356/608, 356/611, 378/4
• US Class Current: 382/190
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 10/16 using multiple overlapping images; Image stitching
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 40/166 using acquisition arrangements

Abstract

An image is displayed on a monitor after recognizing, based on 3-D data obtained by measuring an object in three dimensions, an error region which is an unmeasurable portion of the object in a measured range. A partial image is extracted corresponding to the error region from a 2-D image obtained by imaging the object. Then the partial image is highlighted on the display. This allows the operator to elect to use, or not, the image in forming a 3-D model of the imaged object, e.g., the face of the operator.

Claims

1. A monitor display apparatus comprising:

a display for displaying an image;

means for recognizing, based on 3-D data obtained by measuring an object in three dimensions, an error region which is an unmeasurable portion of said object in a measured range;

means for extracting a partial image corresponding to said error region from a 2-D image obtained by shooting said object; and

display control means for displaying a monitor image representing at least the size and position of said partial image on said display.

2. The monitor display apparatus according to claim 1, wherein said display control means displays said 2-D image with said partial image being enhanced as the monitor image.

3. The monitor display apparatus according to claim 1, wherein said means for recognizing includes means for determining that a quantity of received light, means for comparing said quantity against a threshold, and means for designating a region as an error region when said determined quantity is less than said threshold.

4. The monitor display apparatus according to claim 1, wherein said means for extracting includes means for determining correspondence between said error region in said 3-D data and said 2-D image.

5. The monitor display apparatus according to claim 1, wherein said display control means includes means for changing color in said error region.

6. The monitor display apparatus according to claim 1, wherein said display control means includes means for flashing said error region.

7. The monitor display apparatus according to claim 1, further comprising means for measuring an object in three dimensions to obtain said 3-D data, wherein said measuring means includes:

a non-contacting 3-D measuring unit;

a 2-D imaging unit; and

a measurement-system controller.

8. The monitor display apparatus according to claim 7, wherein said measuring means includes a light scanner and a light sensor.

9. A monitor display apparatus comprising:

a display for displaying an image;

means for recognizing, based on 3-D data obtained by measuring a head in three dimensions, an error region which is an unmeasurable portion of said head; and

display control means for displaying, on said display, a 2-D image obtained by shooting said head after performing specific surface image processing with respect to a region thereof corresponding to skin which is also a portion corresponding to said error region.

10. The monitor display apparatus according to claim 9, wherein said display control means displays the monitor image obtained by performing specific image processing with respect to said region thereof corresponding to skin which is also a portion corresponding to said error region.

11. The monitor display apparatus according to claim 9, wherein said display control means displays said 2-D image with said region thereof corresponding to skin which is also a portion corresponding to said error region, being enhanced as the monitor image.

12. The monitor display apparatus according to claim 9, wherein said means for recognizing includes means for determining that a quantity of received light, means for comparing said quantity against a threshold, and means for designating a region as an error region when said determined quantity is less than said threshold.

13. The monitor display apparatus according to claim 9, wherein said means for extracting includes means for determining correspondence between said error region in said 3-D data and said 2-D image.

14. The monitor display apparatus according to claim 9, wherein said display control means includes means for changing color in said error region.

15. The monitor display apparatus according to claim 9, wherein said display control means includes means for flashing said error region.

16. The monitor display apparatus according to claim 9, wherein said display control means includes means for compensating for data in said error region.

17. The monitor display apparatus according to claim 9, further comprising means for measuring an object in three dimensions to obtain said 3-D data, wherein said measuring means includes:

a non-contacting 3-D measuring unit;

a 2-D imaging unit; and

a measurement-system controller.

18. The monitor display apparatus according to claim 17, wherein said measuring means includes a light scanner and a light sensor.

19. A method of display an image, comprising:

displaying an image;

recognizing, based on 3-D data obtained by measuring an object in three dimensions, an error region which is an unmeasurable portion of said object in a measured range;

extracting a partial image corresponding to said error region from a 2-D image obtained by shooting said object; and

displaying a monitor image representing at least the size and position of said partial image on said display.

20. The method according to claim 19, wherein said display step includes displaying said 2-D image with said partial image being enhanced as the monitor image.

21. The method according to claim 19, wherein said recognizing step includes determining that a quantity of received light, comparing said quantity against a threshold, and designating a region an error region as when said determined quantity is less than said threshold.

22. The method according to claim 19, wherein said extracting includes determining correspondence between said error region in said 3-D data and said 2-D image.

23. The method according to claim 19, wherein said displaying step includes displaying a 2-D image obtained by shooting said head after performing specific image processing with respect to a region thereof corresponding to skin which is also a portion corresponding to said error region.

24. The method according to claim 19, further comprising measuring an object in three dimensions to obtain said 3-D data, wherein said measuring includes measuring said object in three dimensions without contacting the object and imaging said object in two dimensions.

25. The method according to claim 24, wherein said measuring includes scanning light and sensing scanned light reflected from said object.