STEREO IMAGE INTERACTION SYSTEM

• US 20110012830A1
• Filed: 08/31/2009
• Published: 01/20/2011
• Est. Priority Date: 07/20/2009
• Status: Abandoned Application

• Current Assignee: JTouch Corporation
• Original Assignee: JTouch Corporation
• Inventors: YEH, Yu-Chou
• Application Number:
  US12/550,467
• Publication Number:
  US 20110012830A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A stereo image interaction system includes a stereo image capturing module, a stereo image processing unit, a system host, and a stereo image display module. When the stereo image display module displays a stereo image, the stereo image capturing module obtains a motion image of an operation body, the stereo image processing unit obtains a motion characteristic from the motion image and transmits the motion characteristic to a central processing unit (CPU), and the CPU calculates a real-time motion of the stereo image under the motion characteristic. At this time, the stereo image displayed by the stereo image display module changes along with the motion characteristic, so that a virtual stereo image is displayed in a physical space, and the operation body is enabled to directly perform a real-time interaction on the stereo image. Furthermore, the displayed stereo image may be a first stereo image captured by the stereo image capturing module or a second stereo image pre-stored by a storage unit in the system host.

Claims

1. A stereo image interaction system, particularly a stereo image interaction system capable of displaying a stereo image and controlling the stereo image by using a touch body, the system comprising:

a stereo image capturing module, provided with one or more stereo image capturing units, for obtaining a plurality of object images of a predetermined object, and obtaining a motion image of an operation body;

a stereo image processing unit, electrically connected to the stereo image capturing units, for synthesizing the object images into a first stereo image, and obtaining a motion characteristic from the motion image;

a system host, comprising a central processing unit (CPU) electrically connected to the stereo image processing unit, and a storage unit electrically connected to the CPU, wherein;

the storage unit is used for storing the first stereo image; and

the CPU is electrically connected to the stereo image processing unit, for calculating a real-time motion of the stereo image under the motion characteristic; and

a stereo image display module, electrically connected to the CPU, for displaying the real-time motion of the stereo image.

2. The stereo image interaction system according to claim 1, wherein a plurality of operation bodies is configured, the stereo image capturing module obtains motion images of the operation bodies, and the stereo image processing unit generates a corresponding number of motion characteristics according to the motion images.

3. The stereo image interaction system according to claim 1, wherein the stereo image capturing units are charge coupled devices (CCDs) or photo-sensitive devices formed by complementary metal oxide semiconductors (CMOSs).

4. The stereo image interaction system according to claim 3, wherein the stereo image capturing units are CCDs selected from a group consisting of linear CCDs, interline transfer CCDs, full-frame CCDs, and frame-transfer CCDs.

5. The stereo image interaction system according to claim 1, wherein the stereo image processing unit is in a form of an integrated circuit (IC) electrically connected to the CPU, or in a form of firmware recorded in the CPU, or in a form of software read and computed by the CPU, or in a form of an electronic circuit constituted by active and passive devices.

6. The stereo image interaction system according to claim 1, wherein the stereo image display module comprises a stereo imaging unit and a display unit,

the display unit is electrically connected to the CPU, for displaying the stereo image;

and

the stereo imaging unit is disposed on a surface of the display unit, for converting the stereo image into a multi-image, and the multi-image is made to generate the stereo image after being perceived by eyes.

7. The stereo image interaction system according to claim 6, wherein the stereo imaging unit has a structure selected from a group consisting of an active lens structure, a lenticular lens structure, a liquid crystal (LC) lens structure, an LC barrier structure, a light grating structure, and a lenticular sheet.

8. The stereo image interaction system according to claim 6, wherein the display unit is selected from a group consisting of a cathode ray tube (CRT) display, a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, a vacuum fluorescent display (VFD), a plasma display panel (PDP), a surface conduction electron-emitter (SED) display, a field emission display (FED), and an e-paper.

9. The stereo image interaction system according to claim 8, wherein the display unit is an LCD selected from a group consisting of a twisted nematic (TN) LCD, a vertical alignment (VA) LCD, a multi-domain vertical alignment (MVA) LCD, a patterned vertical alignment (PVA) LCD, an in-plane switching (IPS) LCD, a continuous pinwheel alignment (CPA) LCD, and an optical compensated bend (OCB) LCD.

10. The stereo image interaction system according to claim 8, wherein the display unit is an OLED display selected from a group consisting of an active matrix organic light emitting diode (AMOLED) display and a passive matrix organic light emitting diode (PMOLED) display.

11. The stereo image interaction system according to claim 1, wherein the stereo image processing unit calculates the real-time motion of the stereo image in a coordinate calculating mode selected from a group consisting of a mode for calculating relative coordinates, a mode for calculating polar coordinates, a mode for calculating spherical coordinates, and a mode for calculating space coordinates.

12. The stereo image interaction system according to claim 1, wherein the first stereo image is obtained in the following steps:

scanning an appearance of the object by the stereo image capturing module to obtain a plurality of object images;

checking an integrity of the object images by the stereo image processing unit;

synthesizing the object images into the first stereo image by the stereo image processing unit;

transmitting the first stereo image to the stereo image display module by the CPU; and

displaying the first stereo image and realizing stereo image interaction by the stereo image display module.

13. The stereo image interaction system according to claim 12, wherein the step of scanning the appearance of the object by the stereo image capturing module to obtain the plurality of object images further comprises vertical scanning or horizontal scanning.

14. The stereo image interaction system according to claim 12, wherein the step of synthesizing the object images into the first stereo image by the stereo image processing unit further comprises:

calculating a size of the first stereo image by the stereo image processing unit.

15. The stereo image interaction system according to claim 14, wherein the stereo image processing unit calculates the size of the first stereo image according to a proportion of the object images obtained by the stereo image capturing module.

16. The stereo image interaction system according to claim 1, wherein the storage unit is predetermined with a second stereo image.

17. The stereo image interaction system according to claim 16, wherein the second stereo image is obtained in the following steps:

scanning an appearance of the object by the stereo image capturing module to obtain a plurality of object images;

searching the storage unit by the stereo image processing unit to obtain the second stereo image identical to the object images;

transmitting the second stereo image to the stereo image display module by the CPU; and

displaying the second stereo image and realizing stereo image interaction by the stereo image display module.

18. The stereo image interaction system according to claim 1, wherein stereo image interaction is realized in the following steps:

displaying a third stereo image by the stereo image display module;

performing a motion by the operation body in front of the stereo image;

obtaining a motion image of the operation body by the stereo image capturing module;

obtaining a motion characteristic by the stereo image processing unit according to the motion image; and

enabling the third stereo image to change along with the motion characteristic by the CPU.

19. The stereo image interaction system according to claim 18, wherein the third stereo image is the first stereo image or the second stereo image predetermined in the storage unit.

20. The stereo image interaction system according to claim 1, wherein stereo scenario interaction is realized in the following steps:

displaying a fourth stereo image by the stereo image display module;

performing a motion by the operation body in front of the stereo image;

obtaining a motion image of the operation body by the stereo image capturing module;

obtaining a motion characteristic by the stereo image processing unit according to the motion image;

calculating a motion position of the operation body on the fourth stereo image by the stereo image capturing module; and

enabling the fourth stereo image to change along with the motion characteristic and a corresponding scenario status of the fourth stereo image by the CPU.

21. The stereo image interaction system according to claim 1, wherein stereo coordinates are calculated in the following steps:

defining a stereo space and displaying the stereo image in the stereo space by the stereo image display module;

sensing a contact motion of the operation body in the stereo space by the stereo image capturing module;

obtaining a motion image of the operation body by the stereo image capturing module and calculating a motion characteristic;

obtaining coordinates of the motion characteristic by the CPU according to pre-defined coordinates in the stereo space; and

comparing the coordinates of the motion characteristic with all coordinates contained in the stereo image by the CPU to generate a corresponding coordinate change.

22. The stereo image interaction system according to claim 21, wherein the step of comparing the coordinates of the motion characteristic with all coordinates contained in the stereo image by the CPU to generate the corresponding coordinate change further comprises:

the coordinates of the motion characteristic passing through all coordinates contained in the stereo image; and

depressing a shape of the stereo image.

23. The stereo image interaction system according to claim 21, wherein the step of comparing the coordinates of the motion characteristic with all coordinates contained in the stereo image by the CPU to generate the corresponding coordinate change further comprises:

the coordinates of the motion characteristic moving away from all coordinates contained in the stereo image; and

stretching a shape of the stereo image.

24. The stereo image interaction system according to claim 1, wherein a space calculation is performed in the following steps:

generating an image of a stereo space and defining a capacity thereof by the stereo image display module;

placing one or more stereo images in the stereo space;

allocating the stereo images in the stereo space by the operation body; and

obtaining sizes of the stereo images and calculating a volume utilization ratio of the stereo space by the stereo image processing unit.

25. The stereo image interaction system according to claim 24, wherein the stereo image is the first stereo image or a second stereo image predetermined in the storage unit.

26. The stereo image interaction system according to claim 25, wherein if the stereo image is the first stereo image, after the stereo image processing unit generates the first stereo image, the CPU calculates a size of the first stereo image.

27. The stereo image interaction system according to claim 25, wherein if the stereo image is the second stereo image, the CPU obtains a size of the second stereo image when the second stereo image is stored.

28. The stereo image interaction system according to claim 24, wherein in the step of allocating the stereo images in the stereo space by the operation body, the stereo image processing unit calculates the size of the stereo images in real time according to a motion of the operation body.