IMAGE INTERACTION SYSTEM, METHOD FOR DETECTING FINGER POSITION, STEREO DISPLAY SYSTEM AND CONTROL METHOD OF STEREO DISPLAY

• US 20140176676A1
• Filed: 09/30/2013
• Published: 06/26/2014
• Est. Priority Date: 12/22/2012
• Status: Abandoned Application

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Lin, Shang-Yi, Lee, Tien-You, Chen, Chia-Chen
• Application Number:
  US14/040,735
• Publication Number:
  US 20140176676A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/371 for tracking viewers with different interocular distances; for tracking rotational head movements around the vertical axis

Abstract

The disclosure provides a stereo display system including a stereo display, a depth detector, and a computing processor. The stereo display displays a left eye image and a right eye image, such that a left eye and a right eye of a viewer generate a parallax to view a stereo image. The depth detector captures a depth data of a three-dimensional space. The computing processor controls image display of the stereo display. The computing processor analyzes an eyes position of the viewer according to the depth data, and when the viewer moves horizontally, vertically, or obliquely in the three-dimensional space relative to the stereo display, the computing processor adjusts the left eye image and the right eye image based on variations of the eyes position. Furthermore, an image interaction system, a method for detecting finger position, and a control method of stereo display are also provided.

Claims

1. A stereo display system comprising:

a stereo display configured to display a left eye image and a right eye image, such that a left eye and a right eye of a viewer generate a parallax to view a stereo image;

a depth detector configured to capture a depth data of a three-dimensional space; and

a computing processor coupled to the stereo display and the depth detector and configured to control image display of the stereo display, wherein the computing processor analyzes an eyes position of the viewer according to the depth data, and when the viewer moves horizontally, vertically, or obliquely in the three-dimensional space relative to the stereo display, the computing processor adjusts the left eye image and the right eye image based on variations of the eyes position.

2. The stereo display system as recited in claim 1, wherein the computing processor computes an appearance position of the stereo image appeared in the three-dimensional space according to the eyes position and a display position of the left eye image and the right eye image displayed in the stereo display.

3. The stereo display system as recited in claim 2, wherein when the viewer moves horizontally or vertically in the three-dimensional space relative to the stereo display, the computing processor adjusts the display position of the left eye image and the right eye image displayed in the stereo display, so as to maintain a constant distance between the appearance position and the eyes position.

4. The stereo display system as recited in claim 2, wherein when the viewer moves horizontally or vertically in the three-dimensional space relative to the stereo display, the computing processor adjusts the display position of the left eye image and the right eye image displayed in the stereo display, so that the appearance position is fixed on a preset position.

5. The stereo display system as recited in claim 2, wherein when the viewer moves obliquely in the three-dimensional space relative to the stereo display, the computing processor adjusts the display position of the left eye image and the right eye image displayed in the stereo display, such that the stereo image faces the eyes position.

6. The stereo display system as recited in claim 2, wherein the computing processor defines coordinates of a first vector, a second vector and a third vector in the three-dimensional space, and the computing processor computes a coordinate of the appearance position on the first vector according to the following formula:

7. The stereo display system as recited in claim 6, wherein the computing processor computes the coordinate of the appearance position on the second vector and the third vector according to the follow formula:

8. The stereo display system as recited in claim 1, wherein when a disparity between the left eye image and the right eye image is set to a target value, the stereo display gradually increases the disparity between the left eye image and the right eye image to the target value during an initial display period.

9. The stereo display system as recited in claim 1, wherein the computing processor analyzes the depth data within a preset region to obtain the eyes position.

10. The stereo display system as recited in claim 1, wherein the computing processor detects a dynamic motion to select a locating region corresponding to the dynamic motion, and the computing processor analyzes the depth data within the locating region to obtain the eyes position.

11. The stereo display system as recited in claim 1, wherein the computing processor detects a static posture to select a locating region corresponding to the static posture, and the computing processor analyzes the depth data within the locating region to obtain the eyes position.

12. The stereo display system as recited in claim 1, wherein the computing processor is further configured to detect a touch event and control image display of the stereo display according to the touch event.

13. The stereo display system as recited in claim 12, wherein the computing processor compares an appearance position of the stereo image appeared in the three-dimensional space with a position of a touch media to determine whether the appearance position overlaps with the position of the touch media, and when the appearance position overlaps with the position of the touch media, the computing processor deter lines the touch event occurs.

14. The stereo display system as recited in claim 13, wherein when the appearance position overlapping with the position of the touch media is determined, and the touch media stays in a movement status, the computing processor continuously detects a movement locus of the touch media according to the depth data, and the computing processor controls the stereo display according to the movement locus.

15. The stereo display system as recited in claim 13, wherein the computing processor identifies whether the touch media is a specific touch media, and the computing processor determines the touch event does not occur when the stereo image is not touched by the specific touch media.

16. The stereo display system as recited in claim 15, wherein the computing processor compares the touch media with at least one preset template to identify whether the touch media is the specific touch media.

17. The stereo display system as recited in claim 15, wherein the computing processor compares the touch media with at least one dynamic motion to identify whether the touch media is the specific touch media.

18. The stereo display system as recited in claim 15, wherein when the specific touch media is at least one finger, the computing processor analyzes a position of the at least one finger according to a hand outline.

19. The stereo display system as recited in claim 15, wherein when the specific touch media is at least one finger, the computing processor divides a position of a hand into a plurality of identification regions and compares the depth data of the identification regions with an identification condition to analyze a position of the at least one finger.

20. The stereo display system as recited in claim 12, wherein the stereo display system is an interactive stereo display system.

21. A control method of a stereo display comprising:

displaying a left eye image and a right eye image, such that a left eye and a right eye of a viewer generate a parallax to view a stereo image;

capturing a depth data of a three-dimensional space;

analyzing an eyes position of the viewer according to the depth data; and

adjusting the left eye image and the right eye image based on variations of the eyes position when the viewer moves horizontally, vertically, or obliquely in the three-dimensional space relative to the stereo display.

22. The control method of the stereo display recited in claim 21, wherein the step of displaying the left eye image and the right eye image comprises:

gradually increasing a disparity between the left eye image and the right eye image to a target value during an initial display period when the disparity between the left eye image and the right eye image is set to the target value.

23. The control method of the stereo display recited in claim 21, wherein the step of analyzing the eyes position of the viewer according to the depth data comprises:

analyzing the depth data within a preset region to obtain the eyes position.

24. The control method of the stereo display recited in claim 21, wherein the step of analyzing the eyes position of the viewer according to the depth data comprises:

detecting a dynamic motion;

selecting a locating region corresponding to the dynamic motion; and

analyzing the depth data within the locating region to obtain the eyes position.

25. The control method of the stereo display recited in claim 21, wherein the step of analyzing the eyes position of the viewer according to the depth data comprises:

detecting a static posture;

selecting a locating region corresponding to the static posture; and

analyzing the depth data within the locating region to obtain the eyes position.

26. The control method of the stereo display recited in claim 21, wherein the step of adjusting the left eye image and the right eye image based on the variations of the eyes position comprises:

computing an appearance position of the stereo image appeared in the three-dimensional space according to the eyes position and a display position of the left eye image and the right eye image displayed in the stereo display.

27. The control method of the stereo display recited in claim 26, wherein the step of adjusting the left eye image and the right eye image based on the variations of the eyes position when the viewer moves horizontally or vertically in the three-dimensional space relative to the stereo display further comprises:

adjusting the display position of the left eye image and the right eye image displayed in the stereo display, so as to maintain a constant distance between the appearance position and the eyes position.

28. The control method of the stereo display recited in claim 26, wherein the step of adjusting the left eye image and the right eye image coordinating with variations of the eyes position when the viewer moves horizontally or vertically in the three-dimensional space relative to the stereo display further comprises:

adjusting the display position of the left eye image and the right eye image displayed in the stereo display, so that the appearance position is fixed on a preset position.

29. The control method of the stereo display recited in claim 26, wherein the step of adjusting the left eye image and the right eye image based on the variations of the eyes position when the viewer moves obliquely in the three-dimensional space relative to the stereo display further comprises:

adjusting the display position of the left eye image and the right eye image displayed in the stereo display, such that the stereo image faces the eyes position.

30. The control method of the stereo display recited in claim 26, wherein the step of computing the appearance position of the stereo image appeared in the three-dimensional space comprises:

defining coordinates of a first vector, a second vector and a third vector in the three-dimensional space;

computing a coordinate of the appearance position on the first vector according to the following formula;

31. The control method of the stereo display recited in claim 21, wherein after the step of adjusting the left eye image and the right eye image based on the variations of the eyes position, the control method further comprises:

detecting a touch event; and

controlling image display of the stereo display according to the touch event.

32. The control method of the stereo display recited in claim 31, wherein the step of detecting the touch event comprises:

comparing an appearance position of the stereo image appeared in the three-dimensional space with a position of a touch media;

determining whether the appearance position overlaps with the position of the touch media; and

determining the touch event occurs when the appearance position overlaps with the position of the touch media.

33. The control method of the stereo display recited in claim 32, wherein when the appearance position overlaps with the position of the touch media, the step of detecting the touch event further comprises:

detecting a movement locus of the touch media continuously according to the depth data; and

controlling image display of the stereo display according to the movement locus.

34. The control method of the stereo display recited in claim 32 wherein the step of detecting the touch event further comprises:

identifying whether the touch media is a specific touch media; and

determining the touch event does not occur when the stereo image is not touched by the specific touch media.

35. The control method of the stereo display recited in claim 34, wherein the step of identifying whether the touch media is a specific touch media comprises:

comparing the touch media with at least one preset template to identify whether the touch media is the specific touch media.

36. The control method of the stereo display recited in claim 34, wherein the step of identifying whether the touch media is a specific touch media comprises:

comparing the touch media with at least one dynamic motion to identify whether the touch media is the specific touch media.

37. The control method of the stereo display recited in claim 34, wherein when the specific touch media is at least one finger, the step of detecting the touch event further comprises:

analyzing a position of the at least one finger according to a hand outline.

38. A stereo display system comprising:

a stereo display configured to display a left eye image and a right eye image, such that a left eye and a right eye of a viewer generate a parallax to view a stereo image;

a depth detector configured to capture a depth data of a three-dimensional space; and

a computing processor coupled to the stereo display and the depth detector and configured to control image display of the stereo display, wherein the computing processor analyzes an eyes position of the viewer according to the depth data and computes an appearance position of the stereo image appeared in the three-dimensional space according to the eyes position and a display position of the left eye image and the right eye image displayed in the stereo display,

wherein the computing processor performs the following steps;

defining coordinates of a first vector, a second vector and a third vector in the three-dimensional space;

computing a coordinate of the appearance position on the first vector according to a formula of

39. The stereo display system as recited in claim 38, wherein the computing processor adjusts the display position of the left eye image and the right eye image displayed in the stereo display, so as to maintain a constant distance between the appearance position and the eyes position.

40. The stereo display system as recited in claim 38, wherein the computing processor adjusts the display position of the left eye image and the right eye image displayed in the stereo display when the viewer moves horizontally or vertically in the three-dimensional space relative to the stereo display, such that the appearance position is fixed on a preset position.

41. The stereo display system as recited in claim 38, wherein the computing processor adjusts the display position of the left eye image and the right eye image displayed in the stereo display when the viewer moves obliquely in the three-dimensional space relative to the stereo display, such that the stereo image faces the eyes position.

42. A method for detecting a finger position, adapted to detect the finger position of a user, the method comprising:

capturing an image data;

obtaining a position of a hand region according to an image intensity information of the image data;

dividing the hand region into a plurality of identification regions by at least one mask; and

determining whether the identification regions satisfy with an identification condition to detect the finger position of the user.

43. The method for detecting the finger position as recited in claim 42, wherein the step of obtaining the position of the hand region according to the image intensity information of the image data comprises:

setting a threshold value;

determining whether a variation of the image intensity information of the image data during a preset period exceeds the threshold value; and

defining a region of the image data corresponding to the variation of the image intensity information exceeding the threshold value as the hand region.

44. The method for detecting the finger position as recited in claim 42, wherein the step of obtaining the position of the hand region according to the image intensity information of the image data comprises:

setting an image intensity range; and

comparing the image intensity information of the image data to the image intensity range, and defining a region of the image data locating in the image intensity range as the hand region.

45. The method for detecting the finger position as recited in claim 42, wherein the step of obtaining the position of the hand region according to the image intensity information of the image data comprises:

calculating an average value and a variance of the image intensity information based on the image data; and

defining the hand region according to a calculation result.

46. The method for detecting the finger position as recited in claim 42, wherein the step of determining whether the identification regions satisfy with the identification condition to detect the finger position of the user comprises:

determining whether an area of the hand region within each of the identification regions is larger than or equal to a minimum threshold area and smaller than or equal to a maximum threshold area;

when the area of the hand region within one of the identification regions is larger than or equal to the minimum threshold area and smaller than or equal to the maximum threshold area, determining the one of the identification regions satisfies with a first identification condition;

determining whether an overlap length of the hand region within each of the identification regions and a closed curve of the least one mask smaller than or equal to a length threshold value;

when the overlap length of the hand region within one of the identification regions and the closed curve of the least one mask smaller than or equal to the length threshold value, determining the one of the identification regions satisfies with a second identification condition;

determining whether the area of the hand region within each of the identification regions satisfies with the first identification condition;

determining whether the overlap length of the hand region within each of the identification regions and the closed curve of the least one mask satisfies with the second identification condition; and

defining the hand regions within the identification regions simultaneously satisfying with the first identification condition and the second identification condition as the finger position.

47. The method for detecting the finger position as recited in claim 42, further comprising:

analyzing a center position of a palm according to a center point of the hand region; and

defining a fingertip coordinate according to the finger position and the center position of the palm.

48. The method for detecting the finger position as recited in claim 47, wherein the step of analyzing the center position of the palm according to the center point of the hand region comprises:

defining a comparison circle, wherein a center position of the comparison circle is preset on the center point of the hand region;

gradually adjusting a diameter and the center position of the comparison circle, such that the comparison circle is adjusted to a maximum inscribed circle which is inscribed in a hand outline; and

when the comparison circle is adjusted to the maximum inscribed circle in the hand outline, defining the center position of the comparison circle as the center position of the palm.

49. The method for detecting the finger position as recited in claim 47, further comprising:

identifying a gesture action of the user according to the center position of the palm and the number of the identification regions corresponding to the finger position.

50. The method for detecting the finger position as recited in claim 47, further comprising:

identifying a gesture action of the user according to the center position of the palm and a movement locus of the identification regions corresponding to the finger position.

51. An image interaction system, comprising:

a display configured to display an interactive image;

a video camera configured to capture an image of a user to generate an image data; and

a computing processor coupled to the display and the video camera and configured to control frame display of the display,

wherein the computing processor obtains a position of a hand region according to an image intensity information of the image data captured by the video camera, divides the hand region into a plurality of identification regions by at least one mask, and determines whether the identification regions satisfy with an identification condition to detect the finger position of the user.

52. The image interaction system as recited in claim 51, wherein the computing processor compares the image intensity information of the image data to an image intensity range, and defines a region of the image data locating in the image intensity range as the hand region.

53. The image interaction system as recited in claim 51, wherein the computing processor calculates an image intensity distribution according to the image intensity information of the image data, compares the image intensity distribution to a hand image intensity information range, and defines a region of the image data locating in hand image intensity information range as the hand region.

54. The image interaction system as recited in claim 51, wherein the computing processor determines whether a variation of the image intensity information of the image data during a preset period exceeds a threshold value, and defines a region of the image data corresponding to the variation of the image intensity information exceeding the threshold value as the hand region.

55. The image interaction system as recited in claim 51, wherein the computing processor determines whether an area of the hand region within each of the identification regions is larger than or equal to a minimum threshold area and smaller than or equal to a maximum threshold area, and when the area of the hand region within one of the identification regions is larger than or equal to the minimum threshold area and smaller than or equal to the maximum threshold area, the computing processor determines the one of the identification regions satisfies with a first identification condition,

wherein the computing processor determines whether an overlap length of the hand region within each of the identification regions and a closed curve of the least one mask smaller than or equal to a length threshold value, and when the overlap length of the hand region within one of the identification regions and the closed curve of the least one mask smaller than or equal to the length threshold value, the computing processor determines the one of the identification regions satisfies with a second identification condition,

wherein the computing processor determines whether the area of the hand region within each of the identification regions satisfies with the first identification condition, and determines whether the overlap length of the hand region within each of the identification regions and the closed curve of the least one mask satisfies with the second identification condition, wherein the computing processor defines the hand regions within the identification regions simultaneously satisfying with the first identification condition and the second identification condition as the finger position.

56. The image interaction system as recited in claim 51, wherein the computing processor further analyzes a center position of a palm according to a center point of the hand region, and defines a fingertip coordinate according to the finger position and the center position of the palm.

57. The image interaction system as recited in claim 56, wherein the computing processor defines a comparison circle that a center position is preset on the center point of the hand region, and gradually adjusts a diameter and the center position of the comparison circle, such that the comparison circle is adjusted to a maximum inscribed circle which is inscribed in a hand outline, wherein when the comparison circle is adjusted to the maximum inscribed circle in the hand outline, the computing processor defines the center position of the comparison circle as the center position of the palm.

58. The image interaction system as recited in claim 56, wherein the computing processor identifies a gesture action of the user according to the center position of the palm and the number of the identification regions corresponding to the finger position.

59. The image interaction system as recited in claim 56, wherein the computing processor identifies a gesture action of the user according to the center position of the palm and a movement locus of the identification regions corresponding to the finger position.

60. The image interaction system as recited in claim 51, wherein the video camera is a depth detector and the display is a stereo display, the image data captured by the depth detector comprises a depth data, the stereo display is configured to display a left eye image and a right eye image, such that a left eye and a right eye of a viewer generate a parallax to view a stereo image,

wherein the computing processor analyzes an eyes position of the viewer according to the depth data, and when the viewer moves horizontally, vertically, or obliquely in the three-dimensional space relative to the stereo display, the computing processor adjusts the left eye image and the right eye image based on variations of the eyes position.