Portable communication device for stereoscopic image display and transmission

• US 7,190,825 B2
• Filed: 10/24/2002
• Issued: 03/13/2007
• Est. Priority Date: 08/17/2001
• Status: Expired due to Fees

• Current Assignee: Geo-Rae Company Limited
• Original Assignee: Geo-Rae Company Limited
• Inventors: Yoon, Byoungyi
• Primary Examiner(s): MARIAM, DANIEL G
• Application Number:
  US10/280,179
• Publication Number:
  US 20030108236A1
• Time in Patent Office: 1,601 Days
• Field of Search: 382/154, 382/275, 345/419, 348/47, 348/51, 348/52
• US Class Current: 382/154
• CPC Class Codes: G03B 35/20 using two or more projectors
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/246 Calibration of cameras
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

In a method and system of correcting deformation of a 3-D image, display of different sense of distance as a photographing ratio of the left and right cameras (11 and 12) to the object (60) changes according to the movement of the object or magnification and reduction photographing of the object by the cameras, and display of a 3-D image partially deformed as the distance between the left and right eyes (51 and 52)) of a viewer changes, are corrected by the magnification and reduction control of the left and right images by the left and right image magnifying and reducing apparatus (21 and 22) and the movement of the left and right images (41 and 42). Thus, an actual shape of the object is displayed so that the quality of a 3-D image is improved.

Claims

1. An information communication system, comprising:

a first portable device comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras being configured to produce and transmit a first stereoscopic image, the pair of display screens being configured to receive and display a second stereoscopic image; and

a second portable device configured to communicate with the first portable device and comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras of the second device being configured to produce and transmit the second stereoscopic image to the first portable device, the pair of display screens of the second device being configured to receive the first stereoscopic image from the first portable device and display the first stereoscopic image;

wherein each of the pairs of stereoscopic cameras is spaced at a predetermined distance apart from each other,

wherein each of the first and second stereoscopic images comprises a pair of two-dimensional plane images produced by each of the pairs of the stereoscopic cameras, respectively,

and wherein at least one of the first and second portable devices further comprises;

an input portion configured to provide the distance (W_a) between the center points of a viewer'"'"'s eyes;

a computing device configured to determine an amount of movement for each of the displayed two-dimensional plane images based on the provided W_a value such that the W_a value is substantially the same as the distance between the center points of the displayed images; and

a display driver configured to move the displayed images based on the determined amount of movement.

2. An information communication system, comprising:

a first portable device comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras being configured to produce and transmit a first stereoscopic image, the pair of display screens being configured to receive and display a second stereoscopic image; and

a second portable device configured to communicate with the first portable device and comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras of the second device being configured to produce and transmit the second stereoscopic image to the first portable device, the pair of display screens of the second device being configured to receive the first stereoscopic image from the first portable device and display the first stereoscopic image;

wherein each of the pairs of stereoscopic cameras is spaced at a predetermined distance apart from each other,

wherein each of the first and second stereoscopic images comprises a pair of two-dimensional plane images produced by each of the pairs of the stereoscopic cameras, respectively,

and wherein at least one of the first and second portable devices further comprises;

an input portion configured to provide the distance (W_a) between the center points of a viewer'"'"'s eyes;

a computing device configured to determine an amount of movement for each of the displayed two-dimensional images based on the provided W_a value such that the W_a value is substantially the same as the distance between the center points of the displayed images; and

a servo mechanism configured to move the respective display screens based on the determined amount of movement.

3. The system of claim 2, wherein the servo mechanism comprises:

a servo controller configured to determine an adjustment amount based on the determined amount of movement; and

a horizontal motor configured to adjust the distance between the display screens based on the determined adjustment amount.

4. An information communication system, comprising:

a first portable device comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras being configured to produce and transmit a first stereoscopic image, the pair of display screens being configured to receive and display a second stereoscopic image; and

a second portable device configured to communicate with the first portable device and comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras of the second device being configured to produce and transmit the second stereoscopic image to the first portable device, the pair of display screens of the second device being configured to receive the first stereoscopic image from the first portable device and display the first stereoscopic image;

wherein each of the pairs of stereoscopic cameras is spaced at a predetermined distance apart from each other,

wherein each of the first and second stereoscopic images comprises a pair of two-dimensional plane images produced by each of the pairs of the stereoscopic cameras, respectively,

and wherein at least one of the first and second portable devices comprises;

an input portion configured to provide adjusting data for space magnification, the space magnification relating to a size of a scene that is imaged by one of the pairs of stereoscopic cameras; and

a camera control portion configured to adjust the distance between the one pair of stereoscopic cameras based on the provided adjusting data.

5. An information communication system, comprising:

a first portable device comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras being configured to produce and transmit a first stereoscopic image, the pair of display screens being configured to receive and display a second stereoscopic image; and

a second portable device configured to communicate with the first portable device and comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras of the second device being configured to produce and transmit the second stereoscopic image to the first portable device, the pair of display screens of the second device being configured to receive the first stereoscopic image from the first portable device and display the first stereoscopic image;

wherein each of the pairs of stereoscopic cameras is spaced at a predetermined distance apart from each other,

wherein each of the first and second stereoscopic images comprises a pair of two-dimensional plane images produced by each of the pairs of the stereoscopic cameras, respectively,

and wherein each of the first and second portable devices comprises;

a receiver configured to receive adjusting data for space magnification, the space magnification relating to a size of a scene that is imaged by one of the pairs of stereoscopic cameras; and

a camera control portion configured to adjust the distance between the one pair of stereoscopic cameras based on the received adjusting data.

6. The system of claim 5, wherein at least one of the first and second portable devices is configured to display the received space magnification adjusting data.

7. The system of claim 5, wherein at least one of the first and second portable devices comprises a voice providing portion that provides a voice signal representing the received space magnification adjusting data.

8. An information communication system, comprising:

a first portable device comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras being configured to produce and transmit a first stereoscopic image, the pair of display screens being configured to receive and display a second stereoscopic image; and

a second portable device configured to communicate with the first portable device and comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras of the second device being configured to produce and transmit the second stereoscopic image to the first portable device, the pair of display screens of the second device being configured to receive the first stereoscopic image from the first portable device and display the first stereoscopic image;

wherein each of the pairs of stereoscopic cameras is spaced at a predetermined distance apart from each other,

wherein each of the first and second stereoscopic images comprises a pair of two-dimensional plane images produced by each of the pairs of the stereoscopic cameras, respectively,

and wherein each of the first and second portable devices comprises;

an input portion configured to provide adjusting data for space magnification, the space magnification relating to a size of a scene that is imaged in one of the first and second portable devices; and

a transmitter configured to transmit the space magnification adjusting data to the other portable device.

9. An information communication system, comprising:

a first portable device comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras being configured to produce and transmit a first stereoscopic image, the pair of display screens being configured to receive and display a second stereoscopic image; and

a second portable device configured to communicate with the first portable device and comprising a pair of stereoscopic cameras and a pair of display screens, the pair of stereoscopic cameras of the second device being configured to produce and transmit the second stereoscopic image to the first portable device, the pair of display screens of the second device being configured to receive the first stereoscopic image from the first portable device and display the first stereoscopic image;

wherein each of the pairs of stereoscopic cameras is spaced at a predetermined distance apart from each other,

wherein each of the first and second stereoscopic images comprises a pair of two-dimensional plane images produced by each of the pairs of the stereoscopic cameras, respectively,

wherein the first portable device is configured to transmit the first stereoscopic image, and first and second photographing ratios (A1;

B1;

C1, A2;

B2;

C2) for the image produced in the first portable device to the second device, respectively, wherein A1 and A2, and B1 and B2 are defined as horizontal and vertical lengths of a scene imaged by the stereoscopic cameras of the first device, respectively, and C1 and C2 are defined as distances between object lenses of the stereoscopic cameras and the scene, respectively; and

wherein the second device is configured to receive and display the received image such that each screen ratio (D1;

E1;

F1, D2;

E2;

F2) of the display screens of the second device is substantially the same as each photographing ratio (A1;

B1;

C1, A2;

B2;

C2), wherein D1 and D2, and E1 and E2 are defined as horizontal and vertical lengths of the two-dimensional plane images displayed in each of the display screens of the second device, respectively, and F1 and F2 are defined as distances between the display screens of the second device and viewing points.

10. The system of claim 9, wherein the viewing points comprise points where each of a viewer'"'"'s eyes is located at a substantially perpendicular angle with regard to the center points of the displayed images, respectively.

11. A portable communication apparatus, comprising:

a pair of stereoscopic cameras configured to produce a stereoscopic image of a first scene;

a transmitter configured to transmit the first stereoscopic image;

a receiver configured to receive a stereoscopic image of a second scene different from the first scene;

a pair of display screens configured to display the image of the second scene, wherein each stereoscopic image comprises a pair of two-dimensional plane images;

an input portion configured to provide the distance (W_a) between the center points of a viewer'"'"'s eyes;

a computing device configured to determine an amount of movement for the displayed two-dimensional plane images based on the provided W_a value such that the W_a value is substantially the same as the distance between the center points of the displayed images; and

a display driver configured to move the pair of displayed images based on the determined amount of movement.

12. A portable communication apparatus, comprising:

a pair of stereoscopic cameras configured to produce a stereoscopic image of a first scene;

a transmitter configured to transmit the first stereoscopic image;

a receiver configured to receive a stereoscopic image of a second scene different from the first scene;

a pair of display screens configured to display the image of the second scene, wherein each stereoscopic image comprises a pair of two-dimensional plane images;

an input portion configured to provide the distance (W_a) between the center points of a viewer'"'"'s eyes;

a computing device configured to determine an amount of movement for the displayed two-dimensional plane images based on the W_a value such that the W_a value is substantially the same as the distance between the center points of the displayed images; and

a servo mechanism configured to move the pair of display screens based on the determined amount of movement.

13. The apparatus of claim 12, wherein the servo mechanism comprises:

a servo controller configured to determine an adjust amount based on the determined amount of movement; and

a horizontal motor configured to adjust the distance between the display screens based on the determined adjust amount.

14. A portable communication apparatus, comprising:

a pair of stereoscopic cameras configured to produce a stereoscopic image of a first scene;

a transmitter configured to transmit the first stereoscopic image;

a receiver configured to receive a stereoscopic image of a second scene different from the first scene;

a pair of display screens configured to display the image of the second scene, wherein each stereoscopic image comprises a pair of two-dimensional plane images;

an input device configured to provide adjusting data for space magnification, the space magnification relating to a size of a scene to be imaged by the stereoscopic cameras; and

a camera control portion configured to adjust the distance between the stereoscopic cameras based on the provided adjusting data.

15. A portable communication apparatus, comprising:

a pair of stereoscopic cameras configured to produce a stereoscopic image of a first scene;

a transmitter configured to transmit the first stereoscopic image;

a receiver configured to receive a stereoscopic image of a second scene different from the first scene;

a pair of display screens configured to display the image of the second scene, wherein each stereoscopic image comprises a pair of two-dimensional plane images;

a receiver configured to receive adjusting data for space magnification, the space magnification relating to a size of a scene to be imaged by the pair of stereoscopic cameras; and

a camera control portion configured to adjust the distance between the pair of stereoscopic cameras based on the received adjusting data.

16. A portable communication apparatus, comprising:

a pair of stereoscopic cameras configured to produce a stereoscopic image of a first scene;

a transmitter configured to transmit the first stereoscopic image;

a receiver configured to receive a stereoscopic image of a second scene different from the first scene;

a pair of display screens configured to display the image of the second scene, wherein each stereoscopic image comprises a pair of two-dimensional plane images;

an input portion configured to provide adjusting data for space magnification, the space magnification relating to a size of a scene to be imaged by another pair of stereoscopic cameras; and

a transmitter configured to transmit the space magnification adjusting data to the another pair of stereoscopic cameras.

17. A portable communication apparatus, comprising:

a pair of stereoscopic cameras configured to produce a stereoscopic image of a first scene;

a transmitter configured to transmit the first stereoscopic image;

a receiver configured to receive a stereoscopic image of a second scene different from the first scene; and

a pair of display screens configured to display the image of the second scene, wherein each stereoscopic image comprises a pair of two-dimensional plane images;

wherein the receiver is configured to receive the stereoscopic image of the second scene, and first and second photographing ratios (A1;

B1;

C1, A2;

B2;

C2) for the stereoscopic image of the second scene produced in another pair of stereoscopic cameras, respectively,

wherein A1 and A2, and B1 and B2 are defined as horizontal and vertical lengths of a scene imaged by the another pair of stereoscopic cameras, respectively, and C1 and C2 are defined as distances between object lenses of the another pair of stereoscopic cameras and the scene, respectively; and

wherein the display screens are configured to display the received stereoscopic image such that each screen ratio (D1;

E1;

F1, D2;

E2;

F2) of the display screens is substantially the same as each photographing ratio (A1;

B1;

C1, A2;

B2;

C2), wherein D1 and D2, and E1 and E2 are defined as horizontal and vertical lengths of the two-dimensional plane images displayed in each of the display screens, respectively, and F1 and F2 are defined as distances between the display screens and viewing points.

18. The apparatus of claim 17, wherein the viewing points comprise points where each of a viewer'"'"'s eyes is located at a substantially perpendicular angle with regard to the center points of the displayed images, respectively.