Head-mounted display device with function of touch input and touch control method thereof

• US 10,545,345 B2
• Filed: 12/30/2015
• Issued: 01/28/2020
• Est. Priority Date: 12/30/2015
• Status: Active Grant

• Current Assignee: Shenzhen Royole Technologies Co. Ltd
• Original Assignee: Shenzhen Royole Technologies Co. Ltd
• Inventors: Han, Chao
• Primary Examiner(s): Khan, Ibrahim A
• Application Number:
  US15/751,427
• Publication Number:
  US 20180239142A1
• Time in Patent Office: 1,490 Days
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/047 using sets of wires, e.g. crossed wires
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention provides a head-mounted display device, comprising a head-mounted apparatus, a functional apparatus, and a data line coupled the head-mounted apparatus to the functional apparatus. The head-mounted apparatus comprises a display apparatus for providing a near-eye display. The functional apparatus is configured to transmit corresponding signals to the head-mounted apparatus through the data line. The head-mounted display device further comprises a touch pad and a processor. The touch pad is located on the data line, configured to generate a touch signal in response to a touch operation. The processor is configured to generate a corresponding control signal according to the touch signal. The present invention further discloses a control method of the head-mounted display device. In the head-mounted display device and the control method of the present invention, the touch panel is located on the data line to facilitate user'"'"'s input.

Claims

1. A head-mounted display device with function of touch input, wherein, the head-mounted display device comprises a head-mounted apparatus, and a functional apparatus, and a data line coupled the head-mounted apparatus and the functional apparatus, the head-mounted apparatus comprises a display apparatus for providing a near-eye display, the functional apparatus and the head-mounted apparatus perform signal transmission through the data line, the head-mounted display device further comprises:

a touch pad, located on the data line, configured to generate a touch signal in response to a touch operation;

a processor, configured to generate a corresponding control signal according to the touch signal;

the processor determines the corresponding control signal according to the touch signal of the touch pad and an output state of the head-mounted apparatus;

when the process receives the touch signal, the processor estimates whether a current output state of the head-mounted apparatus is an audio and video playing state or not;

when the current output state is not the audio and video playing state, the processor generates a control signal for menu option switching according to the touch signal corresponding to a sliding operation;

when the current output state is the audio and video playing state, the processor generates a control signal of playing the current audio and video file or pause the current audio and video file according to the touch signal corresponding to a click, or generates a control signal of awakening a menu according to the touch signal corresponding to a double-click, or generates a control signal of adjusting playing volume according to the control signal corresponding to a sliding operation.

2. The head-mounted display device according to claim 1, wherein the processor is located on the functional apparatus, the processor outputs the control signal to the head-mounted apparatus to the head-mounted apparatus to control the head-mounted apparatus to execute a corresponding function.

3. The head-mounted display device according to claim 2, wherein the functional apparatus further comprises a touch interface unit coupling the processor and the touch pad, the touch interface unit receives the touch signal generated by the touch pad and transmits the touch signal to the processor.

4. The head-mounted display device according to claim 1, wherein the processor is located on the display apparatus, the display apparatus further comprises a touch interface unit coupling the processor and the touch pad, configured to receive the touch signal generated by the touch pad and transmits the touch signal to the processor.

5. The head-mounted display device according to claims 1, wherein the head-mounted apparatus further comprises a headphone apparatus, configured for outputting audio.

6. The head-mounted display device according to claim 5, wherein the processor is located on the headphone apparatus, the headphone apparatus further comprises a touch interface unit coupling the processor to the touch pad, the touch interface unit is configured to receive the touch signal generated by the touch pad and transmits the touch signal to the processor.

7. The head-mounted display device according to claim 5, wherein the head-mounted apparatus further comprises an audio and video processor, configured to process an audio and video signal into a display signal for the display apparatus outputting and an audio signal for the headphone apparatus outputting.

8. The head-mounted display device according to claim 7, wherein the processor determines that the control signal is to open a certain audio and video file according to the touch signal, the processor controls to open a corresponding audio and video file stored in a storage unit and generates a multimedia signal mixing audio and video, and further transmits the multimedia signal to the audio and video processor through the data line, the audio and video processor receives the multimedia signal and decodes the multimedia signal into the audio signal and the display signal, and transmits to the headphone apparatus for the audio outputting, and transmits to the display apparatus for the display outputting.

9. The head-mounted display device according to claim 1, wherein the touch pad is a flexible touch pad, wrapping around a periphery of the data line.

10. The head-mounted display device according to claim 7, wherein, according to the touch signal corresponding to the sliding operation, and when the current output state of the head-mounted apparatus is the audio and video playing state, the processor further generates the control signal for controlling the corresponding function according to a sliding direction;

when the processor determines that it is a direction of sliding up and down, a control signal for adjusting volume is generated to adjust volume;

when it is determined that the sliding direction is a direction of sliding left and right, a control signal for controlling to fast forward or fast backward is generated, for controlling the audio and video file currently playing to fast forward or fast backward.

11. The head-mounted display device according to claim 7, wherein, the processor determines that it is the click when there are at least two touch points and a touching time duration of the at least two touch points is less than a first time duration;

the processor determines that it is the double-click when there are two clicks at a predefined time duration;

the processor determines whether coordinates of the touch points are changed;

if the coordinates of the touch points are changed, it is determined to be the sliding operation.

12. The head-mounted display device according to claim 2, wherein, the processor controls the touch pad to switch to be a locking state or an unlocking state when the control signal is a control signal for unlocking/locking.

13. The head-mounted display device according to claim 8, wherein, the headphone apparatus further comprises an audio drive unit and telephone receivers;

the display apparatus comprises a display drive unit, a display and an optical module, the audio and video processor receives the multimedia signal transmitted by the processor, decodes the multimedia signal into the audio signal and the display signal, and transmits the audio signal to the audio drive unit, and transmits the display signal to the display drive unit of the display apparatus coupled to the headphone apparatus, the audio drive unit drives the telephone receivers to output the corresponding volume according to the audio signal, and the display drive unit drives the display to output corresponding images according to the display signal, the optical module is configured to project the display image displayed by the display into user'"'"'s eyes according to a predefined path.

14. A touch control method of a head-mounted display device with function of touch input, wherein, the head-mounted display device comprises a head-mounted apparatus, a functional apparatus, a data line coupled the head-mounted apparatus to the functional apparatus, and a touch pad located on the data line, the method comprises:

generating a touch signal in response to a touch operation by the touch pad;

determining a corresponding function according to the touch signal and an output state of the head-mounted apparatus by the head-mounted display device;

outputting a control signal of controlling the corresponding function to control to execute the corresponding function;

wherein, the head-mounted display device determines a corresponding function according to the touch signal and an output state of the head-mounted apparatus comprises;

when a current output state is not an audio and video playing state, and the touch operation is a sliding operation, a control signal for menu option switching is outputted;

when the current output state is the audio and video playing state and the touch operation is the sliding operation, a control signal for adjusting volume menu option switching is outputted;

when the current output state is the audio and video playing state and the touch operation is a click, a control signal of pause is outputted;

when the current output state is the audio and video playing state and the touch operation is a double-click, a control signal of awakening a menu is outputted.

15. The touch control method according to claim 14, wherein, the method further comprises:

controlling the touch pad to switch to be a locking state or an unlocking state when the processor determines that the control signal is a control signal for unlocking/locking, to enable the touch pad to be touched or not touched.

16. The touch control method according to claim 14, wherein, the method further comprises:

when it is determined that the corresponding function is to open a certain audio and video file according to the touch signal, opening a corresponding audio and video file and generates a multimedia signal mixing audio and video;

transmitting the multimedia signal to the head-mounted apparatus through the data line;

decoding the multimedia signal into the audio signal and the display signal, transmitting to the headphone apparatus for the audio outputting, and transmitting to the display apparatus for the display outputting respectively.

17. A head-mounted display device with function of touch input, comprising a head-mounted apparatus, and a functional apparatus, and a data line coupled the head-mounted apparatus and the functional apparatus, the head-mounted apparatus comprises a display apparatus for providing a near-eye display, the functional apparatus and the head-mounted apparatus perform signal transmission through the data line, the head-mounted display device further comprises:

a touch pad, located on the data line, configured to generate a touch signal in response to a touch operation;

a processor, configured to generate a corresponding control signal according to the touch signal;

wherein, the headphone apparatus further comprises an audio drive unit and telephone receivers;

the display apparatus comprises a display drive unit, a display and an optical module, the audio and video processor receives a multimedia signal transmitted by the processor, decodes the multimedia signal into audio signal and display signal, and transmits the audio signal to the audio drive unit, and transmits the display signal to the display drive unit of the display apparatus coupled to the headphone apparatus, the audio drive unit drives the telephone receivers to output the corresponding volume according to the audio signal, and the display drive unit drives the display to output corresponding display images according to the display signal, the optical module is configured to project the display images displayed by the display into user'"'"'s eyes according to a predefined path.