Visual point position control apparatus

• US 5,101,268 A
• Filed: 12/03/1990
• Issued: 03/31/1992
• Est. Priority Date: 12/05/1989
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ohba, Akio
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): Murrell, Jeffrey S.
• Application Number:
  US07/623,110
• Time in Patent Office: 484 Days
• Field of Search: 358/3, 358/88, 358/903, 358/180, 358/93, 350/130, 350/136, 354/112, 352/86, 352/43, 340/729, 364/522, 364/474.24, 364/474.37, 359/470, 359/462
• US Class Current: 348/43
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 7/55 from multiple images
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/207 using a single 2D image sensor
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

The positions of the visual points of images picked up by first and second cameras are controlled by producing a first model of a picked up plane of the image of an object in a three-dimensional coordinate system based on coordinates of the image pickup elements of the first camera and an image pickup angle of the first camera relative to an image of the object picked up, producing a second model of a picked up plane of the image of the object in the three-dimensional coordinate system based on coordinates of the image pickup elements of the second camera and an image pickup angle of the second camera relative to an image of the object picked up, mapping image data output from the first camera onto the first model, mapping image data output from the second camera onto the second model, mathematically rotating and moving the first and second models onto which image data are mapped within an angle α formed by the first and second cameras in the three-dimensional coordinate system by angles β and (α- β), and mixing the image data mapped onto the first model and the image data mapped onto the second model by a mixing ratio corresponding to the rotation angles of the first and second models.

Claims

1. A visual point position control apparatus for controlling positions of the visual points of images picked up by first and second cameras, comprising:

a) first producing means, based on coordinates of picture elements of image pickup elements of the first camera and an image pickup angle of the first camera relative to an image of an object picked up, for producing a first model of a picked up plane of the image of the object in a three-dimensional coordinate system;

b) second producing means, based on coordinates of picture elements of image pickup elements of the second camera and an image pickup angle of the second camera relative to an image of the object picked up, for producing a second model of a picked up plane of the image of the object in a three-dimensional coordinate system;

c) first mapping means for mapping image data output from the first camera onto the first model produced by the first producing means;

d) second mapping means for mapping image data output from the second camera onto the second model produced by the second producing means;

e) moving means for computationally rotating and moving the first and second models onto which image data are mapped within an angle α

, formed by the visual point positions of the first and second cameras in the three-dimensional coordinate system, by angles β and

(α

- β

), respectively; and

f) mixing means for mixing the image data mapped onto the first model and the image data mapped onto the second model by a mixing ratio corresponding to the rotation angles β and

(α

- β

) of the first and second models.

2. A visual point position control apparatus according to claim 1, further comprising display means for displaying an image on the basis of image data output from the mixing means.

3. A visual point position control apparatus as claimed in claim 1, wherein the moving means includes input means for inputting the angle β

.

4. A visual pint position control apparatus as claimed in claim 1, wherein the moving means includes displacement detecting means supplied with the image data output from the first mapping means and the image data output from the second mapping means to thereby detect a displacement between these images and the moving means rotates the first and second models such that the displacement becomes zero.

5. A visual point position control apparatus as claimed in claim 4, wherein the displacement detecting means comprises:

a) corresponding point detecting means for detecting a corresponding point of the image output from the first mapping means and the image output from the second mapping means; and

b) distance vector producing means, based on an output signal of the corresponding point detecting means, for producing a distance vector between the image output from the first mapping means and the image output from the second mapping means.

6. A visual point position control apparatus as claimed in claim 1, wherein the mixing means comprises:

a) first multiplying means for multiplying the image data mapped onto the first model with a weighting coefficient w;

b) second multiplying means for multiplying the image data mapped onto the second model with a weighting coefficient (1-w); and

c) adding means for adding together an output signal of the first multiplying means and an output signal of the second multiplying means.

7. A visual point position control means as claimed in claim 6, wherein the mixing means changes the coefficient w with the changes of the angles β

and (α

- β

) and increases the ratio in which the coefficient is changed with a decrease of the difference between the angles β and

(α

- β

).

8. A visual point position control apparatus for controlling positions of the visual points of images picked up by first and second cameras, comprising:

a) first memory means for storing image data output from the first camera;

b) second memory means for storing an output signal of the first memory means;

c) third memory means for storing image data output from the second camera;

d) fourth memory means for storing an output signal of the third memory means;

e) corresponding point detecting means for detecting a corresponding point of a first image picked up by the first camera and a second image picked up by the second camera;

f) distance vector producing means for producing a distance vector connecting corresponding points of the first and second images on the basis of an output signal from the corresponding point detecting means;

g) input means for inputting a desired image pickup angle β

;

h) moving means, based on an output signal of the distance vector producing means and an output signal of the input means, produces read addresses of the first and third memory means and write addresses of the second and fourth memory means and rotating an image output from the first camera by the angle β

within an angle α

formed by the visual point positions of the first and second cameras and rotating an image output from the second camera by the angle (α

-β

); and

i) synthesizing means for synthesizing image data output from the second memory means and image data output from the fourth memory means by a ratio corresponding to the angle β

.

9. A visual point position control apparatus according to claim 8, further comprising display means for displaying an image on the basis of image data output from the synthesizing means.

10. A visual point position control apparatus as claimed in claim 8, wherein the synthesizing means comprising:

a) first multiplying means for multiplying output data of the second memory means with a weighting coefficient w;

b) second multiplying means for multiplying output data of the fourth memory means with a weighting coefficient (1-w); and

c) adding means for adding an output signal of the first multiplying means and an output signal of the second multiplying means.

11. A visual point position control apparatus as claimed in claim 10, wherein in the first multiplying means and the second multiplying means the coefficient w is changed with changes of the angle β

and the angle (α

- β

), respectively, and the ratio in which the coefficient w is changed is increased with a decrease of the difference between the angles β and

(α

- β

).