VIRTUAL TOUCH SYSTEM

• US 20120092300A1
• Filed: 12/30/2010
• Published: 04/19/2012
• Est. Priority Date: 10/18/2010
• Status: Abandoned Application

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Wang, Hau-Wei, Wang, Chun-Chieh, Dong, Shu-Ping, Yang, Fu-Cheng
• Application Number:
  US12/981,492
• Publication Number:
  US 20120092300A1
• Time in Patent Office: Days
• US Class Current: 345/175
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A virtual touch system including a head-mounted see-through display device, a micro-image display, at least two micro image-capturing devices, and an image processing unit is provided. The head-mounted see-through display device has a holder and an optical lens group that allows an image light of a real scene to directly pass through and reach an observing location. The micro-image display disposed on the holder of the head-mounted see-through display device casts a display image to the observing location through the optical lens group to generate a virtual image plane, wherein the virtual image plane contains a digital information. The micro image-capturing devices disposed at the holder capture images of the real scene and a touch indicator. The image processing unit coupled to the head-mounted see-through display device recognizes the touch indicator and calculates a relative location of the touch indicator on the virtual image plane for the micro-image display.

Claims

1. A virtual touch system, comprising:

a see-through display device, having a holder and an optical lens group, wherein the optical lens group allows an image light of a real scene to directly pass through and reach an observing location;

a micro-image display, disposed on the holder, for casting a display image to the observing location through the optical lens group to generate a virtual image plane, wherein the virtual image plane comprises a digital information;

at least two micro image-capturing devices, disposed at the holder, for capturing images of the real scene and a touch indicator; and

an image processing unit, coupled to the head-mounted see-through display device, for recognizing the touch indicator and calculating a relative location of the touch indicator on the virtual image plane for the micro-image display.

2. The virtual touch system according to claim 1, wherein the digital information of the virtual image plane comprises a touch information, and a touch operation is executed according to the relative location of the touch indicator.

3. The virtual touch system according to claim 2, wherein the touch information comprises a touch option.

4. The virtual touch system according to claim 2, wherein the touch information comprises a virtual input keyboard.

5. The virtual touch system according to claim 1, wherein the micro image-capturing devices are coupled to an external network information system, and the external network information system provides the corresponding digital information according to the captured image of the real scene.

6. The virtual touch system according to claim 1, wherein the virtual image plane overlaps the real scene at the observing location.

7. The virtual touch system according to claim 1, wherein the micro image-capturing devices are disposed in a staggered way to capture images of the touch indicator from different angles, and the image processing unit determines a 3D coordinate of the touch indicator.

8. The virtual touch system according to claim 1, wherein the micro image-capturing devices are disposed in a staggered way to form an effective image capturing space image capturing space, and the image processing unit comprises a location calibration information for calibrating the captured images of the real scene and the touch indicator back to a predetermined actual location in the image capturing space.

9. The virtual touch system according to claim 1, wherein the image processing unit also calculates a relative location of the real scene on the virtual image plane.

10. The virtual touch system according to claim 1, wherein the image processing unit calculates coordinates of the real scene on an image sensing plane of the micro image-capturing devices and then on the virtual image plane.

11. The virtual touch system according to claim 1, wherein the optical lens group has a light guide structure for guiding and casting the display image of the micro-image display to the observing location.

12. The virtual touch system according to claim 1, wherein the observing location is two eyes of a user.

13. The virtual touch system according to claim 1, wherein a number of the micro image-capturing devices is two, and the micro image-capturing devices are respectively disposed on a left frame and a right frame of the holder.

14. The virtual touch system according to claim 1, wherein the micro image-capturing devices further capture images of the real scene, and the image processing unit determines a depth information of the real scene.

15. A virtual touch system, comprising:

a see-through display device, having a holder and an optical lens group;

a micro-image display, disposed on the holder, for casting a display image to an observing location through the see-through display device to generate a virtual image plane, wherein the virtual image plane comprises a touch control digital information;

at least two micro image-capturing devices, disposed at the holder, for capturing images of a touch indicator; and

an image processing unit, coupled to the see-through display device, for recognizing the touch indicator and calculating a relative location of the touch indicator on the virtual image plane for the micro-image display, so as to display the touch control digital information.

16. The virtual touch system according to claim 15, wherein the touch control digital information comprises a display image and a touch option for controlling the display image.

17. The virtual touch system according to claim 15, wherein the touch control digital information comprises a display image and a virtual input keyboard for controlling the display image.

18. The virtual touch system according to claim 15, wherein the see-through display device is head-mounted.