Combined display-camera for an image processing system

• US 7,034,866 B1
• Filed: 11/22/2000
• Issued: 04/25/2006
• Est. Priority Date: 11/22/2000
• Status: Expired due to Term

• Current Assignee: Uniloc 2017 LLC (SoftBank Group Corp.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Pashley, Michael D., Janssen, Peter J., Strubbe, Hugo J., Brodsky, Tomas, Lee, Mi-Suen, Colmenarez, Antonio J.
• Primary Examiner(s): MOE, AUNG SOE
• Application Number:
  US09/718,246
• Time in Patent Office: 1,980 Days
• Field of Search: 348/207.99, 348/333.1, 348/211.11, 348/211.12, 348/218.1, 348/14.16, 348/14.07, 348/14.01, 348/340, 359/443, 359/454, 359/460, 359/456, 359/453, 359/744, 250/208.1
• US Class Current: 348/211.12
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 3/155 Control of the image-sensor operation, e.g. image processing within the image-sensor
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact

Abstract

An image processing system includes a combined display-camera having an array of interspersed display elements and camera elements, arranged substantially in a common plane of a flat panel or other display. Each of at least a subset of the camera elements has one or more imaging angles associated therewith, with the one or more imaging angles being selected to provide a desired imaging operation for the combined display-camera. The imaging angles of the camera elements can be selected to provide an imaging operation which approximates that of a lens-based single-camera system, a pin-hole camera system or other type of system. Each of the camera elements may include multiple image sensors, such that different imaging angles can be set for the different image sensors of a given camera element, and different perspectives of a scene can be generated in the image processing system.

Claims

1. An apparatus for use in an image processing system, the

apparatus comprising:

a combined display-camera having a plurality of display elements and a plurality of camera elements, the display elements and camera elements comprising respective elements that are arranged substantially in a common plane with the display elements being interspersed with the camera elements, and wherein each of at least a subset of the camera elements has two or more imaging angles associated therewith, the two or more imaging angles being selected to provide a desired imaging operation for the combined display-camera.

2. The apparatus of claim 1 wherein at least a subset of the display elements comprise liquid crystal display elements.

3. The apparatus of claim 1 wherein at least a subset of the camera elements comprise charge-coupled device image sensors.

4. The apparatus of claim 1 wherein at least a subset of the camera elements comprise photosensors.

5. The apparatus of claim 1 wherein a given one of the camera elements comprises at least a portion of a pair of collimated plates, and wherein an imaging angle is selected for the given camera element by establishing a corresponding positioning of holes in the collimated plates.

6. The apparatus of claim 1 wherein the combined display-camera comprises a flat panel display.

7. The apparatus of claim 1 wherein at least a subset of the plurality of display elements and at least a subset of the plurality of camera elements are arranged in an array which includes more display elements than camera elements.

8. The apparatus of claim 1 wherein the two or more imaging angles are selected to provide an imaging operation for the combined display-camera which approximates that of a lens-based single-camera system.

9. The apparatus of claim 1 wherein the two or more imaging angles are selected to provide an imaging operation for the combined display-camera which approximates that of a pin-hole camera system.

10. The apparatus of claim 1 wherein the two or more imaging angles for a given one of the camera elements comprises a set of angles including a horizontal angle ${\alpha }_{}$

x=tan-1⁡

(xd)

and a vertical angle ${\mathrm{\alpha <br><br>}}_y={\tan }^{-1}<br><br>\left(\frac{y}{d}\right),$

where x and y denote the horizontal and vertical distances from the camera element to the optical axis of the combined display-camera, and d is the distance from an image plane of the combined display-camera to a desired virtual focus point of the combined display-camera.

11. The apparatus of claim 1 wherein each of at least a subset of the camera elements has a plurality of image sensors associated therewith, such that different imaging angles can be set for the different image sensors of a given camera element, and different perspectives of a scene can be generated in the image processing system.

12. A method for use in an image processing system, the method comprising the steps of:

providing a combined display-camera having a plurality of display elements and a plurality of camera elements, the display elements and camera elements comprising respective elements that are arranged substantially in a common plane with the display elements being interspersed with the camera elements, and wherein each of at least a subset of the camera elements has two or more imaging angles associated therewith; and

selecting from the two or more imaging angles to provide a desired imaging operation for the combined display-camera.

13. An article of manufacture comprising a storage medium for storing one or more programs for use in an image processing system, the image processing system including a combined display-camera having a plurality of display elements and a plurality of camera elements, the display elements and camera elements comprising respective elements that are arranged substantially in a common plane with the display elements being interspersed with the camera elements, and wherein each of at least a subset of the camera elements has two or more imaging angles associated therewith, wherein from the two or more programs when executed by a processor implement the step of selecting the one or more imaging angles to provide a desired imaging operation for the combined display-camera.