STEREOSCOPIC DISPLAY DEVICE AND PARALLAX IMAGE CORRECTING METHOD

• US 20160219260A1
• Filed: 01/21/2016
• Published: 07/28/2016
• Est. Priority Date: 01/22/2015
• Status: Active Grant

• Current Assignee: Tianma Microelectronics Company Limited
• Original Assignee: NLT Technologies, Ltd. (Tianma Microelectronics Company Limited)
• Inventors: SATO, Tetsushi, SHIGEMURA, Koji
• Granted Patent: US 10,448,005 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/317 using slanted parallax optics
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A disclosed stereoscopic display device includes: a naked-eye stereoscopic display that projects respectively-different images into observer'"'"'s left eye and right eye aligned in a first direction based on input images corresponding to two viewpoints; a flat-plate-shaped spatial imaging device that includes a plurality of optical reflection devices reflecting light transmitted from an object on a first reflection surface and a second reflection surface that are orthogonal to each other, the spatial imaging device emitting light that is emitted from the naked-eye stereoscopic display and is incident to an incident surface from an emission surface to an observer side; and an image processing unit that interchanges portions corresponding to reverse viewing areas in which depth parallax and popup parallax of the input images corresponding to the two viewpoints are reversed in a case where, in an image projecting one input image, an image projecting the other input image is mixed.

Claims

1. A stereoscopic display device comprising:

a naked-eye stereoscopic display that projects respectively-different images into an observer'"'"'s left eye and right eye aligned in a first direction based on input images corresponding to two viewpoints;

a spatial imaging device of a flat-plate shape that includes a plurality of optical reflection devices reflecting light transmitted from an object on a first reflection surface and a second reflection surface that are orthogonal to each other; and

an image processing unit that interchanges portions corresponding to reverse viewing areas in which depth parallax and popup parallax of the input images corresponding to the two viewpoints are reversed and outputs resultant images to the naked-eye stereoscopic display in a case where, in an image projecting one input image, an image projecting the other input image is mixed,

wherein the spatial imaging device emits light that is emitted from the naked-eye stereoscopic display and is incident to an incident surface from an emission surface to an observer side, and

wherein the naked-eye stereoscopic display includes a main lobe that is a front stereoscopic viewing area near a normal line passing through the center of a display surface and a side lobe that is a stereoscopic viewing area disposed on an outer side of the main lobe in the first direction.

2. The stereoscopic display device according to claim 1, further comprising a viewpoint position detecting unit that detects a viewpoint position of the observer,

wherein, in a case where, in the image projecting one input image, the image projecting the other input image is mixed, the image processing unit interchanges portions corresponding to the reverse viewing areas in accordance with the viewpoint position of the observer detected by the viewpoint position detecting unit and outputs the resultant images to the naked-eye stereoscopic display.

3. The stereoscopic display device according to claim 2, wherein

the viewpoint position detecting unit includes

an observer imaging unit capturing the observer, and

a both-eye position detecting unit detecting positions of both eyes from a captured image,

the stereoscopic display device further comprises a relative position calculating unit specifying a positional relation between the special imaging device and the observer based on the positions of both eyes detected by the both-eye position detecting unit, and

the image processing unit interchanges the portions corresponding to the reverse viewing areas and outputs the resultant images to the naked-eye stereoscopic display in accordance with the positional relation specified in a case where, in the image projecting one input image, the image projecting the other input image is mixed.

4. The stereoscopic display device according to claim 1, wherein the image processing unit includes:

a parallax image area extracting unit that extracts the reverse viewing areas based on a predetermined condition; and

an image data interchanging unit that interchanges images of portions corresponding to the reverse viewing areas.

5. The stereoscopic display device according to claim 4, wherein a boundary line of the reverse viewing areas has an angle with respect to an arrangement direction of pixels included in the naked-eye stereoscopic display.

6. The stereoscopic display device according to claim 4, wherein the image processing unit further includes:

a depth information extracting unit that extracts depth information of each portion of a display target object based on the input images corresponding to the two viewpoints; and

a parallax amount adjusting unit that adjusts parallax amounts of the input images corresponding to the two viewpoints based on the predetermined condition.

7. The stereoscopic display device according to claim 6, wherein the parallax amount adjusting unit sets a parallax amount of a portion near a boundary between an image of a portion corresponding to the reverse viewing area and an image adjacent to the image to be less than a parallax amount of a portion other than the portion near the boundary.

8. The stereoscopic display device according to claim 6, wherein the parallax amount adjusting unit sets a parallax amount of image of a portion corresponding to the reverse viewing areas to be more than a parallax amount of an image of a portion other than the portions corresponding to the reverse viewing areas.

9. The stereoscopic display device according to claim 4, wherein the predetermined condition include at least one of an angle formed by a visual line direction of the observer and a normal direction of the spatial imaging device, a distance between the naked-eye stereoscopic display and the spatial imaging device, a distance between the spatial imaging device and the observer, and optical characteristics of the spatial imaging device.

10. A parallax image correcting method using a stereoscopic display device including:

a naked-eye stereoscopic display that projects respectively-different images into an observer'"'"'s left eye and right eye aligned in a first direction based on input images corresponding to two viewpoints; and

a spatial imaging device of a flat-plate shape that includes a plurality of optical reflection devices reflecting light transmitted from an object on a first reflection surface and a second reflection surface that are orthogonal to each other,

the naked-eye stereoscopic display including a main lobe that is a front stereoscopic viewing area near a normal line passing through the center of a display surface and a side lobe that is a stereoscopic viewing area disposed on an outer side of the main lobe in the first direction, and

the spatial imaging device emitting light that is emitted from the naked-eye stereoscopic display and is incident to an incident surface from an emission surface to an observer side,

the parallax image correcting method using the stereoscopic display device comprising;

determining whether reverse viewing areas in which depth parallax and popup parallax are reversed are present in a case where, in an image projecting one input image, an image projecting the other input image is mixed;

interchanging portions of the input images corresponding to the two viewpoints that correspond to the reverse viewing areas; and

outputting resultant images to the naked-eye stereoscopic display in a case where the reverse viewing areas are present.

11. The parallax image correcting method using the stereoscopic display device according to claim 10, further comprising:

detecting a viewpoint position of the observer; and

determining whether or not the reverse viewing areas are present in accordance with the detected viewpoint position of the observer in a case where, in the image projecting one input image, the image projecting the other input image is mixed;

specifying the reverse viewing areas in accordance with the detected viewpoint position of the observer;

interchanging portions corresponding to the specified reverse viewing areas; and

outputting the resultant images to the naked-eye stereoscopic display in a case where the reverse viewing areas are present.

12. The parallax image correcting method using the stereoscopic display device according to claim 11, further comprising:

capturing an image of the observer;

detecting positions of both eyes from a captured image;

specifying a positional relation between the special imaging device and the observer based on the detected positions of both eyes; and

interchanging the portions corresponding to the reverse viewing areas in accordance with the specified positional relation and outputting the resultant images to the naked-eye stereoscopic display in accordance with the positional relation specified in a case where, in the image projecting one input image, the image projecting the other input image is mixed.

13. The parallax image correcting method using the stereoscopic display device according to claim 10, further comprising:

extracting the reverse viewing areas based on a predetermined condition; and

interchanging images of portions corresponding to the reverse viewing areas in the input images corresponding to the two viewpoints.

14. The parallax image correcting method using the stereoscopic display device according to claim 13, wherein a boundary line of the reverse viewing areas has an angle with respect to an arrangement direction of pixels included in the naked-eye stereoscopic display.

15. The parallax image correcting method using the stereoscopic display device according to claim 13, further comprising:

extracting depth information of each portion of a display target object based on the input images corresponding to the two viewpoints before the extraction of the reverse viewing areas; and

adjusting parallax amounts of the input images corresponding to the two viewpoints based on the predetermined condition.

16. The parallax image correcting method using the stereoscopic display device according to claim 15, further comprising setting a parallax amount of a portion near a boundary between an image of a portion corresponding to the reverse viewing area and an image adjacent to the image to be less than a parallax amount of a portion other than the portion near the boundary.

17. The parallax image correcting method using the stereoscopic display device according to claim 15, further comprising setting a parallax amount of image of a portion corresponding to the reverse viewing areas to be more than a parallax amount of an image of a portion other than the portions corresponding to the reverse viewing areas.

18. The parallax image correcting method using the stereoscopic display device according to claim 13, wherein the predetermined condition include at least one of an angle formed by a visual line direction of the observer and a normal direction of the spatial imaging device, a distance between the naked-eye stereoscopic display and the spatial imaging device, a distance between the spatial imaging device and the observer, and optical characteristics of the spatial imaging device.