INTERACTIVE VIRTUAL IMAGE DISPLAY APPARATUS AND INTERACTIVE DISPLAY METHOD

• US 20140071024A1
• Filed: 11/29/2012
• Published: 03/13/2014
• Est. Priority Date: 09/11/2012
• Status: Abandoned Application

• Current Assignee: Wistron Corporation
• Original Assignee: Wistron Corporation
• Inventors: Fu, Chuan-Cheng
• Application Number:
  US13/688,214
• Publication Number:
  US 20140071024A1
• Time in Patent Office: Days
• US Class Current: 345/8
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

An interactive virtual image display apparatus configured to be worn on a head of a user includes a display unit, an image sensing module, and a control unit. The display unit forms a virtual image in front of an eye of the user. The image sensing module senses the eye. The control unit is electrically connected to the display unit and the image sensing module. The control unit receives a video signal, and drives the display unit to display the virtual image according to the video signal. The control unit has at least one operation function. The operation function controls a manner that the display unit displays the virtual image. The control unit executes the operation function corresponding to at least one action of the eye according to the at least one action of the eye sensed by the image sensing module. An interactive display method is also provided.

Claims

1. An interactive virtual image display apparatus, adapted to be worn on a head of a user, the interactive virtual image display apparatus comprising:

a display unit, forming a virtual image in front of an eye of the user;

an image sensing module, sensing the eye of the user; and

a control unit, electrically connected to the display unit and the image sensing module, wherein the control unit receives a video signal, and drives the display unit to display the virtual image according to the video signal, the control unit has at least one operation function, the operation function controls a manner that the display unit displays the virtual image, and the control unit executes the operation function corresponding to at least one action of the eye according to the at least one action of the eye sensed by the image sensing module.

2. The interactive virtual image display apparatus as claimed in claim 1, further comprising an image-taking lens, wherein the image-taking lens transmits an image of a hand of the user to the image sensing module, and the control unit executes the operation function corresponding to a gesture of the hand according to the gesture of the hand sensed by the image sensing module.

3. The interactive virtual image display apparatus as claimed in claim 2, further comprising a light path switching device, switching a light path of a light incident on the image sensing module to a first state and a second state, wherein when the light path is switched to the first state, the image sensing module captures an image of the eye, and when the light path is switched to the second state, the image sensing module captures an image of the gesture with assistance of the image-taking lens.

4. The interactive virtual image display apparatus as claimed in claim 3, wherein the light path switching device comprises a reflector adapted to move into or move away from a light path between the image sensing module and the eye, and wherein when the reflector moves into the light path between the image sensing module and the eye, a light coming from the hand passes through the image-taking lens and is reflected by the reflector and transmitted to the image sensing module, and when the reflector moves away from the light path between the image sensing module and the eye, a light coming from the eye is transmitted to the image sensing module.

5. The interactive virtual image display apparatus as claimed in claim 1, further comprising a glasses frame, wherein the display unit, the image sensing module and the control unit are all disposed on the glasses frame.

6. The interactive virtual image display apparatus as claimed in claim 1, further comprising a loudspeaker, electrically connected to the control unit, wherein the control unit receives an audio signal, and drives the loudspeaker to send a sound corresponding to the audio signal according to the audio signal, and the operation function controls a manner that the loudspeaker sends the sound.

7. The interactive virtual image display apparatus as claimed in claim 1, wherein the at least one operation function is a plurality of operation functions, the at least one action of the eye is a plurality of actions, the control unit respectively causes the actions of the eye to respectively correspond to the operation functions, and the operation functions comprise an enter-menu function, a skip-to-next-item function, an enter-execution function, a stop-and-leave function or combinations thereof.

8. An interactive virtual image display apparatus, adapted to be worn on a head of a user, the interactive virtual image display apparatus comprising:

a display unit, forming a virtual image in front of an eye of the user;

an image sensing module, sensing a hand of the user; and

a control unit, electrically connected to the display unit and the image sensing module, the control unit receives a video signal, and drives the display unit to display the virtual image according to the video signal, the control unit has at least one operation function, the operation function controls a manner that the display unit displays the virtual image, and the control unit executes the operation function corresponding to at least one gesture of the hand according to the at least one gesture of the hand sensed by the image sensing module.

9. The interactive virtual image display apparatus as claimed in claim 8, further comprising an image-taking lens, wherein the image-taking lens transmits an image of a hand of the user to the image sensing module.

10. The interactive virtual image display apparatus as claimed in claim 8, further comprising a glasses frame, wherein the display unit, the image sensing module and the control unit are all disposed on the glasses frame.

11. The interactive virtual image display apparatus as claimed in claim 8, further comprising a loudspeaker, electrically connected to the control unit, wherein the control unit receives an audio signal, and drives the loudspeaker to send a sound corresponding to the audio signal according to the audio signal, and the operation function controls a manner that the loudspeaker sends the sound.

12. The interactive virtual image display apparatus as claimed in claim 8, wherein the at least one operation function is a plurality of operation functions, the at least one gesture of a hand is a plurality of gestures, the control unit causes the gestures to respectively correspond to the operation functions, and the operation functions comprise an enter-menu function, a skip-to-next-item function, an enter-execution function, a stop-and-leave function or combinations thereof.

13. An interactive display method, comprising:

forming a virtual image in front of an eye of a user according to a video signal;

selecting to sense one of images of the eye and a hand of the user;

executing at least one operation function corresponding to at least one action of the eye according to the at least one action of the eye when the eye of the user is sensed; and

executing at least one operation function corresponding to at least one gesture of the hand according to the at least one gesture of the hand when the hand of the user is sensed,

wherein the at least one operation function controls a display manner of the virtual image.

14. The interactive display method as claimed in claim 13, further comprising sending a sound corresponding to an audio signal according to the audio signal, wherein the at least one operation function controls a manner of sensing the sound.

15. The interactive display method as claimed in claim 13, wherein the at least one operation function is a plurality of operation functions, the at least one action of the eye is a plurality of actions, the at least one gesture of the hand is a plurality of gestures, and the operation functions comprise an enter-menu function, a skip-to-next-item function, an enter-execution function, a stop-and-leave function or combinations thereof.