THREE-DIMENSIONAL DISPLAY DEVICE, THREE-DIMENSIONAL IMAGE CAPTURING DEVICE, AND POINTING DETERMINATION METHOD

• US 20130106694A1
• Filed: 12/21/2012
• Published: 05/02/2013
• Est. Priority Date: 06/29/2010
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: TANAKA, Koichi, HAYASHI, Junji
• Granted Patent: US 9,086,742 B2
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: G03B 35/18 by simultaneous viewing
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: H04N 13/183 On-screen display [OSD] information, e.g. subtitles or menus
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

The object is to appropriately determine a user'"'"'s pointing position even when a pointing image for receiving user'"'"'s pointing is three-dimensionally displayed. There are included a three-dimensional display unit 13 that displays a three-dimensional pointing image for receiving a user'"'"'s pointing, the three-dimensional pointing image including a right-eye pointing image and a left-eye pointing image; a pointing position detection unit 16 that detects the user'"'"'s pointing position on the display surface of the three-dimensional display unit 13; a dominant-eye information setting unit 17 that sets a piece of dominant-eye information representing a dominant-eye of the user; a pointing position detection area determination unit 18 that determines a detection area of the pointing position on the display surface of the three-dimensional display unit 13 based on at least the dominant-eye information; and a determination unit 19 that determines whether the pointing position detected by the pointing position detection unit 16 is within the detection area to receive the user'"'"'s pointing corresponding to the three-dimensional pointing image.

Claims

1. A three-dimensional display device, comprising:

a three-dimensional display unit that displays a three-dimensional pointing image for receiving a user'"'"'s pointing, the three-dimensional pointing image including a right-eye pointing image and a left-eye pointing image;

a pointing position detection unit that detects the user'"'"'s pointing position on a display surface of the three-dimensional display unit;

a dominant-eye information obtaining unit that obtains a piece of dominant-eye information representing a dominant-eye of the user;

a detection area determination unit that determines a detection area of the pointing position on the display surface of the three-dimensional display unit based on at least the dominant-eye information; and

a determination unit that determines whether the pointing position detected by the pointing position detection unit is within the detection area to thereby receive the user'"'"'s pointing corresponding to the three-dimensional pointing image.

2. The three-dimensional display device according to claim 1, wherein the detection area determination unit changes at least one of the position, the size and the shape of the detection area in accordance with the existence or absence of the dominant-eye information.

3. The three-dimensional display device according to claim 2, wherein, when the dominant-eye information exists, the detection area determination unit causes the size of the detection area to be smaller than the size of the detection area in the case of the absence of the dominant-eye information.

4. The three-dimensional display device according to claim 1, wherein, when the dominant-eye information exists, the detection area determination unit changes at least one of the position, the size and the shape of the detection area depending on the user'"'"'s dominant-eye at the right side or left side.

5. The three-dimensional display device according to claim 4, wherein, when the dominant-eye information exists, the detection area determination unit disposes the detection area closer to a display position of a pointing image of the dominant-eye in the right-eye pointing image and the left-eye pointing image.

6. The three-dimensional display device according to claim 1, wherein, when the dominant-eye information exists, the detection area determination unit determines the detection area so that at least a part of the pointing image corresponding to the dominant-eye in the right-eye pointing image and the left-eye pointing image is included.

7. The three-dimensional display device according to claim 1, wherein, when the dominant-eye information is absent, the detection area determination unit determines the detection area so that at least a part of the right-eye pointing image and at least a part of the left-eye pointing image are included.

8. The three-dimensional display device according to claim 1, wherein the dominant-eye information obtaining unit calculates the dominant-eye information which represents the dominant-eye of the user and the strength level of the dominant-eye based on the user'"'"'s pointing position detected by the pointing position detection unit in a state that the three-dimensional pointing image is displayed on the three-dimensional display unit and a parallax amount of the three-dimensional pointing image.

9. The three-dimensional display device according to claim 8, wherein the dominant-eye information is calculated by displaying the three-dimensional pointing image several times on the three-dimensional display unit while varying the parallax amount to detect the user'"'"'s pointing position several times with the pointing position detection unit.

10. The three-dimensional display device according to claim 8, wherein the dominant-eye information is calculated by displaying the three-dimensional pointing image several times on the three-dimensional display unit while varying the display position to detect the user'"'"'s pointing position several times with the pointing position detection unit.

11. The three-dimensional display device according to claim 8, wherein the dominant-eye information is calculated by displaying several three-dimensional pointing images on the three-dimensional display unit while varying the display position to detect the user'"'"'s pointing position several times with the pointing position detection unit.

12. The three-dimensional display device according to claim 1, wherein the dominant-eye information obtaining unit receives an input operation of the information on the dominant-eye of the user.

13. The three-dimensional display device according to claim 1, comprising:

a stereoscopic effect setting unit that receives a setting input operation of the magnitude of a stereoscopic effect of the three-dimensional pointing image; and

a three-dimensional pointing image generation unit that generates the three-dimensional pointing image with the parallax amount corresponding to the magnitude of the set and input stereoscopic effect, wherein

the three-dimensional display unit displays a three-dimensional display image generated by the three-dimensional pointing image generation unit, and

the detection area determination unit determines the detection area based on the parallax amount corresponding to the magnitude of the stereoscopic effect.

14. The three-dimensional display device according to claim 1, further including a user change detection unit that detects a change of the user who has input the pointing through the pointing position detection unit.

15. The three-dimensional display device according to claim 14, wherein the user change detection unit calculates the number of times or frequency when the pointing position detected by the pointing position detection unit is out of the range of a detection area determined by the detection area determination unit to detect a change of the user based on the calculation result.

16. The three-dimensional display device according to claim 14, wherein the user change detection unit creates a piece of history information on the pointing position detected by the pointing position detection unit and detects a change of the user based on the history information on the pointing position.

17. The three-dimensional display device according to claim 16, wherein the user change detection unit detects a change of the user by detecting a change of the dominant-eye or the strength level of the dominant-eye based on the history information on the pointing position.

18. The three-dimensional display device according to claim 14, comprising a control unit that executes at least any one of:

calibration processing in which, when a change of the user has been detected by the user change detection unit, the dominant-eye information of a new user is obtained and at least one difference in the position, the size and the shape of the detection area with respect to the display area of the left-eye pointing image and the right-eye pointing image is determined;

detection mode switching processing to switch the mode from a first detection mode in which the detection area is determined based on the dominant-eye information to a second detection mode in which the detection area is set to a default having a larger size than the default at the time of the first detection mode;

display mode switching processing to switch the mode from a first display mode in which the three-dimensional pointing image is displayed, to a second display mode in which a plane pointing image is displayed; and

alarm processing to output an alarm.

19. The three-dimensional display device according to claim 14, comprising a selection reception unit that, when a change of the user has been detected, receives from the user a selection of a process to be executed.

20. A three-dimensional image capturing device, comprising:

the three-dimensional display device set forth in claim 1; and

a three-dimensional imaging unit that obtains a three-dimensional image by taking an image of an object from multiple view points, wherein

the three-dimensional image capturing device synthesizes the three-dimensional image and the three-dimensional pointing image with each other to three-dimensionally display the synthesized image by the three-dimensional display unit.

21. A pointing determination method using a three-dimensional display unit that displays a three-dimensional pointing image for receiving a user'"'"'s pointing, the three-dimensional pointing image including a right-eye pointing image and a left-eye pointing image;

a pointing position detection unit that detects the user'"'"'s pointing position on a display surface of the three-dimensional display unit; and

a dominant-eye information obtaining unit that obtains a piece of dominant-eye information representing a dominant-eye of the user,

the pointing determination method comprising;

a detection area determination step to determine a detection area of the pointing position on the display surface of the three-dimensional display unit based on the dominant-eye information obtained by the dominant-eye information obtaining unit;

a pointing position detection step to detect the user'"'"'s pointing position on the surface of the three-dimensional display unit with the pointing position detection unit; and

a determination step to determine whether the pointing position detected by the pointing position detection unit is within the detection area.

22. The pointing determination method according to claim 21, comprising a step to calculate the dominant-eye information representing the dominant-eye of the user and the strength level of the dominant-eye based on the user'"'"'s pointing position which has been detected by the pointing position detection unit in a state that the three-dimensional pointing image is displayed on the three-dimensional display unit and based on a parallax amount of the three-dimensional pointing image.

23. The pointing determination method according to claim 22, comprising a step to receive an input operation of the dominant-eye information of the user.

24. The pointing determination method according to claim 21, performing at least any one of:

calibration processing in which a change of the user who has input the pointing through the pointing position detection unit is detected, and, when a change of the user has been detected, the dominant-eye information of a new user is obtained and at least one difference in the position, the size and the shape of the detection area with respect to a display area of the left-eye pointing image and the right-eye pointing image is determined;

detection mode switching processing to switch the mode from a first detection mode in which the detection area is determined based on the dominant-eye information to a second detection mode in which the detection area is set to a default having a larger size than the default at the time of the first detection mode;

display mode switching processing to switch the mode from a first display mode in which the three-dimensional pointing image is displayed, to a second display mode in which a plane pointing image is displayed; and

alarm processing to output an alarm.

25. A programmable non-transitory recording medium tangibly storing a pointing program which is executable by a digital processing device and readable by a machine to execute the pointing determination method set forth in claim 21.