Display apparatus with image-capturing function, image processing apparatus, image processing method, and image display system

• US 8,953,057 B2
• Filed: 05/22/2007
• Issued: 02/10/2015
• Est. Priority Date: 05/22/2006
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Kajita, Yoshiki, Katayama, Akihiro, Uchiyama, Shinji, Suzuki, Masahiro, Tsujimoto, Takuya
• Primary Examiner(s): CUTLER, ALBERT H
• Application Number:
  US11/751,772
• Publication Number:
  US 20070268316A1
• Time in Patent Office: 2,821 Days
• Field of Search: 348/230.1
• US Class Current: 348/222.1
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/36 characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory

Abstract

A display apparatus with an image-capturing function includes an outputting unit configured to output an image signal to an external apparatus, an inputting unit configured to input an image signal from the external apparatus, an image-capturing unit, a display unit, an image-capture-distortion corrector configured to perform image-capture-distortion correction on an image signal captured by the image-capturing unit, a display-distortion corrector configured to perform display-distortion correction, and a controller configured to control whether or not the image-capture-distortion corrector is to perform the image-capture-distortion correction, and whether or not the display-distortion corrector is to perform the display-distortion correction. Therefore, distortion caused by the image-capturing system and display system of the display apparatus with an image-capturing function can be appropriately corrected in the overall system including the display apparatus with an image-capturing function and the external apparatus.

Claims

1. A display apparatus with an image-capturing function, comprising:

an outputting unit configured to output an image signal to an external apparatus;

an inputting unit configured to input an image signal from the external apparatus;

an image-capturing unit;

a display unit;

a corrector configured to perform image-capture-distortion correction and display-distortion correction on an image signal captured by the image-capturing unit;

a controller configured to control the corrector to perform the image capture-distortion correction if a correction mode of the image capture-distortion is set, control the corrector to perform the display distortion correction if a correction mode of the display distortion is set, and perform the image capture-distortion correction and the display distortion correction at the same time if a correction mode of the image capture-distortion and the correction mode of the display-distortion are set;

an image combining unit configured to combine an external input image input from the inputting unit with an image captured using the image-capturing unit; and

a setting unit configured to set a type of distortion correction performed by the corrector and to determine whether or not the image combining unit is to perform image combining,

wherein the controller performs the control according to the settings made by the setting unit,

wherein the corrector performs the image-capture-distortion correction using a first correction table that contains image-capture-distortion correction data and performs the display-distortion correction using a second correction table that contains display-distortion correction data by a single circuit in a time-sharing processing,

wherein when the image combining unit performs image combining to generate a combined image, the corrector performs image-capture inverse distortion correction on the external input image by applying distortion equal to image-capture distortion caused by the image-capturing unit, and the corrector performs image-capture-distortion correction and display-distortion correction on the combined image.

2. A display apparatus with an image-capturing function, comprising:

an outputting unit configured to output an image signal to an external apparatus;

an inputting unit configured to input an image signal from the external apparatus;

an image-capturing unit;

a display unit;

a corrector configured to perform image-capture-distortion correction and display-distortion correction on an image signal captured by the image-capturing unit;

a controller configured to control the corrector to perform the image capture-distortion correction if a correction mode of the image capture-distortion is set, control the corrector to perform the display distortion correction if a correction mode of the display distortion is set, and perform the image capture-distortion correction and the display distortion correction at the same time if a correction mode of the image capture-distortion and the correction mode of the display-distortion are set;

an image combining unit configured to combine an external input image input from the inputting unit with an image captured using the image-capturing unit; and

a setting unit configured to set a type of distortion correction performed by the corrector and to determine whether or not the image combining unit is to perform image combining,

wherein the controller performs the control according to the settings made by the setting unit,

wherein the corrector performs the image-capture-distortion correction using a first correction table that contains image-capture-distortion correction data and performs the display-distortion correction using a second correction table that contains display-distortion correction data by a single circuit in a time-sharing processing,

wherein if the image combining unit performs image combining to generate a combined image, the corrector performs display-distortion correction on the external input image, and the corrector performs image-capture-distortion correction and display-distortion correction on the captured image.