Head mounted device control method and apparatus, and head mounted device

• US 9,940,893 B2
• Filed: 11/27/2014
• Issued: 04/10/2018
• Est. Priority Date: 11/28/2013
• Status: Active Grant

• Current Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Inventors: Li, Guoqing, Chang, Xinmiao
• Primary Examiner(s): Yang, Nan-Ying
• Application Number:
  US15/023,526
• Publication Number:
  US 20160247480A1
• Time in Patent Office: 1,230 Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A head mounted device control method includes capturing situation data, using the situation data to determine whether a wearer of a head mounted device is inside a moving vehicle, and when it is determined that the wearer is inside a moving vehicle, controlling an image capture apparatus in the head mounted device to capture an environmental image, using the captured environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat, and when it is determined that the seat taken by the wearer is the driver'"'"'s seat, disabling a preset service, where the preset service includes a screen display service of a near-eye display. The method may reduce diversion of attention of the wearer, and improve driving safety.

Claims

1. A head mounted device control method, comprising:

using captured status data to determine a status of a wearer of the head mounted device, wherein the status comprises a driving state and a non-driving state;

disabling a preset service when the wearer is in the driving state, wherein the preset service comprises at least one of a screen display service of a near-eye display, a manual input service, and a projection and display service, wherein the captured status data comprises situation data and an environmental image, and wherein the situation data comprises at least one type of moving speed data, signal strength data of a vehicle mounted wireless network, user schedule data, and environmental noise strength data; and

substituting the situation data into a situation evaluation function to obtain a situation evaluation value,

wherein using the captured status data to determine the status of the wearer of the head mounted device comprises;

using the situation data to determine whether the wearer of the head mounted device is inside a moving vehicle;

using the environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat when the wearer is inside the moving vehicle; and

determining that the wearer of the head mounted device is in the driving state when the wearer is inside the moving vehicle and the seat taken is the driver'"'"'s seat,

wherein using the situation data to determine whether the wearer is inside the moving vehicle comprises;

determining whether the situation evaluation value is greater than or equal to a threshold;

determining that the wearer is inside the moving vehicle when the situation evaluation value is greater than or equal to the threshold; and

determining that the wearer is not inside the moving vehicle when the situation evaluation value is less than the threshold,

wherein the situation evaluation function is denoted by F(x,y,z,v) and comprises at least one of a signal strength evaluation function ƒ

₁(x), a schedule evaluation function ƒ

₂(y), an environmental noise evaluation function ƒ

₃(z), and a moving speed evaluation function ƒ

₄(v), wherein x indicates the signal strength data, wherein y indicates the user schedule data, wherein z indicates the environmental noise strength data, wherein v indicates the moving speed data,

wherein substituting the situation data into the situation evaluation function to obtain the situation evaluation value comprises at least one of the following;

substituting x into ƒ

₁(x) to obtain a signal strength evaluation value;

substituting y into ƒ

₂(y) to obtain a schedule evaluation value;

substituting z into ƒ

₃(z) to obtain an environmental noise strength evaluation value; and

substituting v into ƒ

₄(v) to obtain a moving speed evaluation value,

wherein ƒ

₁(x)=α

₁x, wherein α

₁ indicates a signal strength weight and α

₁>

0, wherein

2. The method according to claim 1, wherein the environmental image is captured by:

setting photographing parameters; and

performing photographing to obtain the environmental image,

wherein the photographing parameters are determined according to the moving speed data or are preset standard photographing parameters,

wherein using the captured environmental image to determine whether the seat taken by the wearer is the driver'"'"'s seat comprises determining whether the seat taken by the wearer is the driver'"'"'s seat by;

detecting whether the environmental image comprises a preset mark;

or

calculating a similarity between the captured environmental image and a preset standard environmental image,

wherein the seat taken by the wearer is the driver'"'"'s seat when the environmental image comprises the preset mark,

wherein the seat taken by the wearer is not the driver'"'"'s seat when it is detected that the environmental image does not comprise the preset mark,

wherein the seat taken by the wearer is the driver'"'"'s seat when the calculated similarity between the captured environmental image and the preset standard environmental image is greater than or equal to a similarity threshold, and

wherein the seat taken by the wearer is not the driver'"'"'s seat when the calculated similarity between the captured environmental image and the preset standard environmental image is less than the similarity threshold.

3. A bead mounted device control apparatus, comprising:

a memory configured to store instructions; and

a processor, wherein the instructions are executed by the processor to cause the head mounted device control apparatus to;

use captured status data to determine a status of a wearer of the head mounted device, wherein the status comprises a driving state and a non-driving state;

disable a preset service when the wearer is in the driving state, wherein the preset service comprises at least one of a screen display service of a near-eye display, a manual input service, and a projection and display service, wherein the captured status data comprises situation data and an environmental image, and wherein the situation data comprises at least one type of moving speed data, signal strength data of a vehicle mounted wireless network, user schedule data, and environmental noise strength data;

use the situation data to determine whether the wearer of the head mounted device is inside a moving vehicle;

use the environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat when the wearer is inside the moving vehicle;

determine that the wearer of the head mounted device is in the driving state when the wearer is inside the moving vehicle and the seat taken is the driver'"'"'s seat;

substituting the situation data into a situation evaluation function to obtain a situation evaluation value;

determine whether the situation evaluation value is greater than or equal to a threshold;

determine that the wearer is inside the moving vehicle when the situation evaluation value is greater than or equal to the threshold; and

determine that the wearer is not inside the moving vehicle when the situation evaluation value is less than the threshold,

wherein the situation evaluation function is denoted by F(x,y,z,v) and comprises at least one of a signal strength evaluation function ƒ

₁(x), a schedule evaluation function ƒ

₂(y), an environmental noise evaluation function ƒ

₃(z), and a moving speed evaluation function ƒ

₄(v), wherein x indicates the signal strength data, wherein y indicates the user schedule data, wherein z indicates the environmental noise strength data, wherein v indicates the moving speed data,

wherein substituting the situation data into the situation evaluation function to obtain the situation evaluation value comprises at least one of the following;

substituting x into ƒ

₁(x) to obtain a signal strength evaluation value;

substituting y into ƒ

₂(y) to obtain a schedule evaluation value;

substituting z into ƒ

₃(z) to obtain an environmental noise strength evaluation value; and

substituting v into ƒ

₄(v) to obtain a moving speed evaluation value,

wherein ƒ

₁(x)=α

₁x, wherein α

₁ indicates a signal strength weight and α

₁>

0, wherein

4. The head mounted device control apparatus according to claim 3, wherein the instructions are further executed by the processor to cause the head mounted device control apparatus to:

set photographing parameters;

perform photographing to obtain the environmental image, wherein the photographing parameters are determined according to the moving speed data or are preset standard photographing parameters; and

determine whether a seat taken by the wearer is a driver'"'"'s seat by;

detecting whether the environmental image comprises a preset mark;

or

calculating a similarity between the captured environmental image and a preset standard environmental image,

wherein the seat taken by the wearer is the driver'"'"'s seat when the environmental image comprises the preset mark,

wherein the seat taken by the wearer is not the driver'"'"'s seat when it is detected that the environmental image does not comprise the preset mark,

wherein the seat taken by the wearer is the driver'"'"'s seat when the calculated similarity between the captured environmental image and the preset standard environmental image is greater than or equal to a similarity threshold, and

wherein the seat taken by the wearer is not the driver'"'"'s seat when the calculated similarity between the captured environmental image and the preset standard environmental image is less than the similarity threshold.