Wearable display device use-based data processing control

• US 9,772,494 B2
• Filed: 10/02/2015
• Issued: 09/26/2017
• Est. Priority Date: 09/04/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Rabii, Khosro Mohammad
• Primary Examiner(s): Nguyen, Kevin M
• Application Number:
  US14/873,950
• Publication Number:
  US 20160025975A1
• Time in Patent Office: 725 Days
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 2203/0339 Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0444 using a single conductive element covering the whole sensing surface, e.g. by sensing the electrical current flowing at the corners
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2330/022 in absence of operation, e.g. no data being entered during a predetermined time
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/001 Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor
• CPC Class Codes: H03K 17/962 Capacitive touch switches
• CPC Class Codes: H03K 2217/96071 characterised by the detection principle
• CPC Class Codes: H03K 2217/960735 characterised by circuit details
• CPC Class Codes: Y02D 10/00 : Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Techniques are described for controlling operation of both a host device and a wearable display device connected to the host device based on a use status of the wearable display device. The techniques include automatically determining a use status of a wearable display device based on feedback from one or more touch sensors within the wearable display device that indicates whether the wearable display device is worn by a user. Based on the determined use status, the wearable display device controls its own operation (e.g., controls operation of display screens of the wearable display device, a communication session with the host device, and display processing of data received from the host device). The wearable display device also sends an indication of the use status to the host device. The host device then controls its own data processing for the wearable display device based on the indicated use status.

Claims

1. A method of controlling a host device connected to a wearable display device, the method comprising:

determining, with the wearable display device, a use status of the wearable display device;

determining, with the wearable display device, a manner in which a processor of the host device is to modify data processing to be performed by the host device; and

sending, with the wearable display device, an indication of the use status of the wearable display device to the host device to control the data processing to be performed at the host device to generate data for presentation on the wearable display device based on the indication of the use status of the wearable display device,

wherein sending the indication of the use status of the wearable display device to the host device comprises sending, based on the wearable display device not being in use, a request to the processor of the host device to modify the data processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device, and

wherein sending the request to the processor of the host device to modify data processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device comprises sending the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device to generate the data for presentation on the wearable display device.

2. The method of claim 1, wherein determining the use status of the wearable display device comprises:

generating an oscillation frequency based on feedback from one or more touch sensors of the wearable display device, wherein the oscillation frequency changes when the one or more touch sensors are in contact with the user; and

based on a comparison of the oscillation frequency and a threshold frequency value, determining whether the wearable display device is in use or not in use.

3. The method of claim 1, wherein determining the use status of the wearable display device comprises continuously determining the use status of the wearable display device.

4. The method of claim 1, further comprising controlling, with the wearable display device, operation of the wearable display device based on the use status of the wearable display device, wherein controlling operation of the wearable display device comprises controlling operation of one or more display screens of the wearable display device, a communication session with the host device, and display processing of data received from the host device.

5. The method of claim 1, wherein sending the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device comprises sending a virtual processor interrupt request to the processor of the host device.

6. The method of claim 1, wherein determining the use status of the wearable display device comprises determining that the wearable display device is in use, the method further comprising based on the wearable display device being in use:

establishing a communication session with the host device,

activating one or more display screens of the wearable display device, and

enabling display processing of data received from the host device.

7. The method of claim 1, wherein determining the use status of the wearable display device comprises determining that the wearable display device is in use, the method further comprising requesting, based on the wearable display device being in use, the processor of the host device to enable data processing at the host device to generate the data for presentation on the wearable display device.

8. The method of claim 1, wherein determining the use status of the wearable display device comprises determining that the wearable display device is not in use, the method further comprising entering a reduced power state.

9. The method of claim 1, wherein determining the use status of the wearable display device comprises determining that the wearable display device is not in use, the method further comprising one or more of disabling display processing of data received from the host device, deactivating one or more display screens of the wearable display device, and dismantling a communication session with the host device.

10. The method of claim 9, further comprising:

initiating a disconnect timer;

prior to expiration of the disconnect timer, reducing display processing of data received from the host device until the one or more display screens are deactivated; and

upon expiration of the disconnect timer, dismantling the communication session with the host device.

11. The method of claim 1, wherein the wearable display device comprises a wireless head-mounted display (WHMD) device formed as glasses that include at least one touch sensor located on a bridge of the glasses and at least two touch sensors located on temple arms of the glasses.

12. The method of claim 1, wherein sending the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device comprises sending an interrupt request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device to generate the data for presentation on the wearable display device.

13. A wearable display device connected to a host device, the wearable display device comprising:

one or more display screens; and

one or more processors configured to determine a use status of the wearable display device, determine a manner in which a processor of the host device is to modify data processing to be performed by the host device, and send an indication of the use status of the wearable display device to the host device to control the data processing to be performed at the host device to generate data for presentation on the one or more display screens of the wearable display device based on the indication of the use status of the wearable display device,

wherein the one or more processors are configured to send, based on the wearable display device not being in use, a request to the processor of the host device to modify the data processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device, and

wherein to send the request to the processor of the host device to modify processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device, the one or more processors are configured to send the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device to generate the data for presentation on the wearable display device.

14. The wearable display device of claim 13, further comprising one or more touch sensors, wherein the one or more processors are configured to:

generate an oscillation frequency based on feedback from the touch sensors of the wearable display device, wherein the oscillation frequency changes when the touch sensors are in contact with the user; and

based on a comparison of the oscillation frequency and a threshold frequency value, determine whether the wearable display device is in use or not in use.

15. The wearable display device of claim 13, wherein the one or more processors are configured to continuously determine the use status of the wearable display device.

16. The wearable display device of claim 13, wherein the one or more processors are configured to control operation of the one or more display screens of the wearable display device, a communication session with the host device, and display processing of data received from the host device.

17. The wearable display device of claim 13, wherein to send the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device, the one or more processors are configured to send a virtual processor interrupt request to the processor of the host device.

18. The wearable display device of claim 13, wherein, based on the wearable display device being in use, the one or more processors are configured to one or more of establish a communication session with the host device, activate the one or more display screens of the wearable display device, and enable display processing of data received from the host device.

19. The wearable display device of claim 13, wherein, based on the wearable display device being in use, the one or more processors are configured to request the processor of the host device to enable data processing at the host device to generate the data for presentation on the wearable display device.

20. The wearable display device of claim 13, wherein, based on the wearable display device not being in use, the one or more processors are configured to enter a reduced power state.

21. The wearable display device of claim 13, wherein, based on the wearable display device not being in use, the one or more processors are configured to one or more of disable display processing of data received from the host device, deactivate the one or more display screens of the wearable display device, and dismantle a communication session with the host device.

22. The wearable display device of claim 21, wherein the one or more processors are configured to:

initiate a disconnect timer;

prior to expiration of the disconnect timer, reduce display processing of data received from the host device until the one or more display screens are deactivated; and

upon expiration of the disconnect timer, dismantle the communication session with the host device.

23. The wearable display device of claim 13, wherein the wearable display device comprises a wireless head-mounted display (WHMD) device formed as glasses that include at least one touch sensor located on a bridge of the glasses and at least two touch sensors located on temple arms of the glasses.

24. The wearable display device of claim 13, wherein to send the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device, the one or more processors are configured to send an interrupt request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device to generate the data for presentation on the wearable display device.

25. A wearable display device connected to a host device, the wearable display device comprising:

means for determining a use status of the wearable display device;

means for determining a manner in which a processor of the host device is to modify data processing to be performed by the host device; and

means for sending an indication of the use status of the wearable display device to the host device to control the data processing to be performed at the host device to generate data for presentation on the wearable display device based on the indication of the use status of the wearable display device,

wherein the means for sending comprises means for sending, based on the wearable display device not being in use, a request to the processor of the host device to modify the data processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device, and

wherein the means for sending the request to the processor of the host device to modify processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device comprises means for sending the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device to generate the data for presentation on the wearable display device.

26. The wearable display device of claim 25, further comprising means for continuously determining the use status of the wearable display device.

27. The wearable display device of claim 25, further comprising means for controlling operation of one or more display screens of the wearable display device, a communication session with the host device, and display processing of data received from the host device.

28. The wearable display device of claim 25, wherein the means for sending the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device comprises means for sending a virtual processor interrupt request to the processor of the host device.

29. The wearable display device of claim 25, wherein the means for sending the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device comprises means for sending an interrupt request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device.

30. A non-transitory computer-readable medium comprising instructions for controlling a wearable display device connected to a host device, the instructions when executed cause one or more programmable processors to:

determine, with the wearable display device, a use status of the wearable display device;

determine, with the wearable display device, a manner in which a processor of the host device is to modify data processing to be performed by the host device; and

send, with the wearable display device, an indication of the use status of the wearable display device to the host device to control the data processing to be performed at the host device to generate data for presentation on the wearable display device based on the indication of the use status of the wearable display device,

wherein the instructions that when executed cause the one or more programmable processors to send comprise instructions that when executed cause the one or more programmable processors to send, based on the wearable display device not being in use, a request to the processor of the host device to modify the data processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device, and

wherein the instructions that when executed cause the one or more programmable processors to send the request to the processor of the host device to modify processing to be performed by the host device, in the manner determined by the wearable display device, to generate the data for presentation on the wearable display device comprise instructions that when executed cause the one or more programmable processors to send the request to the processor of the host device to one of enable, disable or reduce data processing to be performed by the host device to generate the data for presentation on the wearable display device.