AUGMENTED REALITY INTERACTIVE SYSTEM AND DYNAMIC INFORMATION INTERACTIVE DISPLAY METHOD THEREOF

• US 20170053444A1
• Filed: 09/24/2015
• Published: 02/23/2017
• Est. Priority Date: 08/19/2015
• Status: Abandoned Application

• Current Assignee: National Taipei University Of Technology
• Original Assignee: National Taipei University Of Technology
• Inventors: Chou, Sheng-Kai, Huang, Shih-Chia, Chen, Bo-Hao, Hwang, Jenq-Neng
• Application Number:
  US14/864,789
• Publication Number:
  US 20170053444A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1464 3D-gesture
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/177 Augmented reality
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/213 Virtual instruments
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An augmented reality interactive system and a dynamic information interactive display method thereof are provided. The augmented reality interactive system suitable for being disposed in a transportation vehicle includes a transparent display, a motion detection unit, and a processing unit. The transparent display has a display panel pervious to light. The display panel is suitable for serving as a windshield of the vehicle, where the transparent display controls the image displayed by the display panel according to a display signal, so as to display an interactive information on the display panel. The motion detection unit detects an operation motion of a driver, so as to generate a control command. The processing unit coupled to the transparent display and the motion detection unit receives the control command, so as to generate the corresponding display signal based on the operation motion for controlling the operation of the transparent display.

Claims

1. An augmented reality interactive system, adapted to be disposed in a transportation vehicle, the augmented reality interactive system comprising:

a transparent display, having a display panel pervious to light, the display panel being adapted to serve as a windshield of the transportation vehicle, wherein the transparent display controls an image displayed on the display panel according to a display signal, so as to display interactive information associated with driving information and environment information of the transportation vehicle on the display panel;

motion detection unit, configured to detect an operation motion of an user performed within a detection range, so as to generate a control command corresponding to the operation motion, wherein the operation motion is one of a plurality of gesture motions without contacting the motion detection unit, each of the gesture motions corresponds to a different control command on the interactive information, and wherein the motion detection unit comprises an image capturing device; and

a processing unit, coupled to the transparent display and the motion detection unit, and configured to receive the control command, so as to generate the corresponding display signal based on the operation motion for controlling an operation of the transparent display.

2. The augmented reality interactive system as claimed in claim 1, further comprising:

a vehicle dynamic detection unit, coupled to the processing unit, and configured to detect the driving information of the transportation vehicle and the environment information around the transportation vehicle, wherein the processing unit controls the image displayed on the display panel according to the driving information and the environment information.

3. The augmented reality interactive system as claimed in claim 1, wherein the control command comprises at least one of an open command, a shift command, a click command and a close command.

4. The augmented reality interactive system as claimed in claim 3, wherein the processing unit opens a function list according to the open command, the function list comprises a plurality of function option icons, and the function option icons respectively correspond to different application programs or data folders.

5. The augmented reality interactive system as claimed in claim 4, wherein the processing unit shifts a display position of the function option icons on the display panel according to the shift command.

6. The augmented reality interactive system as claimed in claim 4, wherein the processing unit executes the application program or the data folder corresponding to the function option icon located in a currently selected region of the display panel according to the click command.

7. The augmented reality interactive system as claimed in claim 4, wherein the processing unit closes the currently executed application program or the data folder or closes all of background programs according to the close command.

8. The augmented reality interactive system as claimed in claim 4, wherein the processing unit adjusts a widow position and a window size of the currently executed application program on the display panel according to the operation motion.

9. The augmented reality interactive system as claimed in claim 4, wherein the processing unit shrinks a window of the currently executed application program to an edge of the display panel according to a minimization command, and continually executes the same as a background program.

10. The augmented reality interactive system as claimed in claim 9, wherein when an application program is executed and is not set as the background program, the processing unit prohibits execution of another application program, and when the currently executed application program is set as the background program, the processing unit allows execution of the another application program.

17. The augmented reality interactive system as claimed in claim 1, wherein the operation motion further comprises an eye control motion.

18. The augmented reality interactive system as claimed in claim 1, wherein the operation motion further comprises a brain wave control motion, and wherein the motion detection unit further comprises a brain wave detection device.

19. The augmented reality interactive system as claimed in claim 1, wherein the interactive information comprises a permanent function column displaying basic information, a window displaying the driving information and the environment information of the transportation, and a background program window displaying at least one background program.

11. A dynamic information interactive display method applied to a transportation vehicle, comprising:

displaying interactive information associated with driving information and environment information of the transportation vehicle through a display panel pervious to light, wherein the display panel is adapted to serve as a windshield of the transportation vehicle, and an image displayed on the display panel is controlled by a display signal;

detecting an operation motion of an user performed within a detection range through a motion detection unit, so as to generate a control command corresponding to the operation motion, wherein the operation motion is one of a plurality of gesture motions without contacting the motion detection unit, each of the gesture motions corresponds to a different control command on the interactive information, and wherein the motion detection unit comprises an image capturing device; and

receiving the control command through a processing unit, so as to generate the corresponding display signal based on the operation motion for controlling the display panel.

12. The dynamic information interactive display method applied to the transportation vehicle as claimed in claim 11, wherein the step of detecting the operation motion of the user through the motion detection unit, so as to generate the control command comprises:

detecting the gesture motion of the user;

determining whether the operation motion is complied with at least one of an open motion, a shift motion, a click motion and a close motion;

generating an open command when the motion detection unit determines that the detected operation motion is complied with the open motion;

generating a shift command when the motion detection unit determines that the detected operation motion is complied with the shift motion;

generating a click command when the motion detection unit determines that the detected operation motion is complied with the click motion; and

generating a close command when the motion detection unit determines that the detected operation motion is complied with the close motion.

13. The dynamic information interactive display method applied to the transportation vehicle as claimed in claim 12, wherein the step of receiving the control command through the processing unit, so as to generate the corresponding display signal based on the operation motion for controlling the display panel comprises:

opening a function list and displaying the function list on the display panel by the processing unit when the processing unit receives the open command, wherein the function list comprises a plurality of function option icons, and the function option icons respectively correspond to different application programs or data folders;

shifting a display position of the function option icons on the display panel by the processing unit when the processing unit receives the shift command;

executing the application program or the data folder corresponding to the function option icon located in a currently selected region of the display panel by the processing unit when the processing unit receives the click command; and

closing the currently executed application program or the data folder or closing all of background programs by the processing unit when the processing unit receives the close command.

14. The dynamic information interactive display method applied to the transportation vehicle as claimed in claim 13, wherein the step of receiving the control command through the processing unit, so as to generate the corresponding display signal based on the operation motion for controlling the display panel comprises:

shrinking a window of the currently executed application program to an edge of the display panel by the processing unit when the processing unit receives a minimization command, and continually executing the same as a background program.

15. The dynamic information interactive display method applied to the transportation vehicle as claimed in claim 14, wherein the step of receiving the control command through the processing unit, so as to generate the corresponding display signal based on the operation motion for controlling the display panel comprises:

prohibiting execution of another application program by the processing unit when an application program is executed and is not set as the background program; and

allowing execution of the another application program by the processing unit when the currently executed application program is set as the background program.

16. An augmented reality interactive system, adapted to be disposed in a transportation vehicle, the augmented reality interactive system comprising:

a transparent substrate, pervious to light and having a display function, wherein the transparent substrate is adapted to serve as a windshield of the transportation vehicle;

a motion detection unit, configured to detect an operation motion performed within a detection range, so as to generate a control command corresponding to the operation motion, wherein the operation motion is one of a plurality of gesture motions without contacting the motion detection unit, each of the gesture motions corresponds to a different control command on interactive information associated with driving information and environment information of the transportation vehicle, and wherein the motion detection unit comprises an image capturing device; and

a processing unit, coupled to the transparent substrate and the motion detection unit, and configured to receive the control command, so as to control an operation of the transparent substrate based on the operation motion.