Apparatus for processing image

• US 4,956,706 A
• Filed: 06/16/1989
• Issued: 09/11/1990
• Est. Priority Date: 06/21/1988
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ohba, Akio
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US07/367,372
• Time in Patent Office: 452 Days
• Field of Search: 358/93, 358/160, 358/180, 358/903
• US Class Current: 348/578
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

In an apparatus for processing image capable of moving the position of visual point with respect to an image displayed on a monitor, the apparatus, based on coordinates of picture elements on the image pickup device of a camera and the image pickup angle of the camera with respect to the object, produces a model of a surface of an object whose image has been picked up in a three-dimensional coordinate system, maps image data output from the camera onto the model, rotationally transforms the model with the image data mapped thereon in the three-dimensional coordinate system, and displays the models with the image data mapped thereon on the monitor.

Claims

1. An apparatus for processing an image of an object capable of moving the apparent position of the visual point from which the object is viewed with respect to an image displayed on a monitor, comprising:

a. a camera having an image pickup device for picking up an image of said object;

b. producing means for producing a model of a surface of said object in a three-dimensional coordinate system based on the coordinates of picture elements on the image pickup device of said camera and the image pickup angle of said camera with respect to said object;

c. mapping means for mapping image data output from said camera onto said model produced by said producing means;

d. transformation means for rotationally transforming said model with said image data mapped thereon in said three-dimensional coordinate system such that the apparent visual point is changed; and

e. a monitor for displaying said model with said image data mapped thereon.

2. The apparatus for processing an image according to claim 1, further comprising deformation means for deforming a specific portion of said model with said image data mapped thereon to compensate for the apparent change in height of items which do not lie flat on the surface of said object.

3. An apparatus for processing an image of an object capable of moving the apparent position of the visual point from which the object is viewed with respect to an image displayed on a monitor, comprising:

a. a camera having an image pickup device for picking up an image of said object;

b. angle measuring means for measuring the image pickup angle of said camera with respect to said object;

c. producing means for producing a model of a surface of said object in a three-dimensional coordinate system based on the coordinates of picture elements on the image pickup device of said camera and the image pickup angle of said camera with respect to said object;

d. mapping means for mapping image data output from said camera onto said model produced by said producing means;

e. transformation means for rotationally transforming said model with said image data mapped thereon in said three-dimensional coordinate system such that the apparent visual point is changed; and

f. a monitor for displaying said model with said image data mapped thereon.

4. The apparatus for processing an image according to claim 3, further comprising deformation means for deforming a specific portion of said model with said image data mapped thereon to compensate for the apparent change in height of items which do not lie flat on the surface of said object.

5. The apparatus for processing an image according to claim 3, wherein said object is of varying height and said producing means further comprises:

planar model producing means for producing a planar model by approximating to a plane the surface of said object based on coordinates of picture elements on the image pickup device of said camera and said image pickup angle; and

means for modifying said planar model based on data representative of the varying height of said surface of said object.

6. The apparatus for processing an image according to claim 5, further comprising deformation means for deforming a specific portion of said model with said image data mapped thereon to compensate for the apparent change in height of items which do not lie flat on the surface of said object.

7. An apparatus for processing an image of an object of varying height capable of moving the apparent position of the visual point from which the object is viewed with respect to an image displayed on a monitor, comprising:

a. a camera having an image pickup device for picking up an image of said object;

b. planar model producing means for producing a planar model of the surface of said object in a three-dimensional coordinate system by approximating to a plane the surface of said object based on the coordinates of picture elements on the image pickup device of said camera and the image pickup angle of said camera with respect to said object;

c. means for modifying said planar model based on data representative of the varying height of said surface of said object;

d. mapping means for mapping image data output from said camera onto said model produced by said producing means;

e. transformation means for rotationally transforming said model with said image data mapped thereon in said three-dimensional coordinate system such that the apparent visual point is changed; and

f. a monitor for displaying said model with said image data mapped thereon.

8. The apparatus for processing an image according to claim 7, further comprising deformation means for deforming a specific portion of said model with said image data mapped thereon to compensate for the apparent change in height of items which do not lie flat on the surface of said object.