Head Mounted Device Control Method and Apparatus, and Head Mounted Device

• US 20160247480A1
• Filed: 11/27/2014
• Published: 08/25/2016
• Est. Priority Date: 11/28/2013
• Status: Active Grant

• Current Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Inventors: Li, Guoqing, Chang, Xinmiao
• Granted Patent: US 9,940,893 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A head mounted device control method includes capturing situation data, using the situation data to determine whether a wearer of a head mounted device is inside a moving vehicle, and when it is determined that the wearer is inside a moving vehicle, controlling an image capture apparatus in the head mounted device to capture an environmental image, using the captured environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat, and when it is determined that the seat taken by the wearer is the driver'"'"'s seat, disabling a preset service, where the preset service includes a screen display service of a near-eye display. The method may reduce diversion of attention of the wearer, and improve driving safety.

Claims

1-17. -17. (canceled)

18. A head mounted device control method, comprising:

using captured status data to determine a status of a wearer of the head mounted device, wherein the status comprises a driving state and a non-driving state; and

disabling a preset service when it is determined that the wearer is in the driving state, wherein the preset service comprises at least one of a screen display service of a near-eye display, a manual input service, and a projection and display service, wherein the status data comprises situation data and an environmental image, and wherein the situation data comprises at least one type of moving speed data, signal strength data of a vehicle mounted wireless network, user schedule data, and environmental noise strength data.

19. The method according to claim 18, further comprising:

enabling when it is determined that the wearer is in the non-driving state; and

retaining the preset service when it is determined that the wearer is in the non-driving state.

20. The method according to claim 18, wherein using the status data to determine the status of the wearer of the head mounted device comprises:

using the situation data to determine whether the wearer of the head mounted device is inside a moving vehicle;

using the environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat when it is determined that the wearer is inside the moving vehicle; and

determining that the wearer of the head mounted device is in the driving state when the wearer is inside the moving vehicle and the seat taken is the driver'"'"'s seat.

21. The method according to claim 18, wherein using the status data to determine the status of the wearer of the head mounted device comprises:

using the environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat;

using the situation data to determine whether the wearer of the head mounted device is inside a moving vehicle when it is determined that the seat taken by the wearer is the driver'"'"'s seat; and

determining that the wearer of the head mounted device is in the driving state when the wearer is inside the moving vehicle and the seat taken is the driver'"'"'s seat.

22. The method according to claim 20, further comprising determining that the wearer of the head mounted device is in the non-driving state when it is determined that the seat taken is not the driver'"'"'s seat or that the wearer is not inside the moving vehicle.

23. The method according to claim 20, further comprising substituting the situation data into a situation evaluation function to obtain a situation evaluation value, wherein using the situation data to determine whether the wearer is inside the moving vehicle comprises:

determining whether the situation evaluation value is greater than or equal to a threshold;

determining that the wearer is inside the moving vehicle when the situation evaluation value is greater than or equal to the threshold; and

determining that the wearer is not inside the moving vehicle when the situation evaluation value is less than the threshold.

24. The method according to claim 23, wherein the situation evaluation function is denoted by F(x,y,z,v) and comprises at least one of a signal strength evaluation function ƒ

₁(x), a schedule evaluation function ƒ

₂(y), an environmental noise evaluation function ƒ

₃(z), and a moving speed evaluation function ƒ

₄(v), wherein x indicates the signal strength data, wherein y indicates the user schedule data, wherein z indicates the environmental noise strength data, wherein v indicates the moving speed data, and wherein substituting the situation data into the situation evaluation function to obtain the situation evaluation value comprises at least one of the following;

substituting x into ƒ

₁(x) to obtain a signal strength evaluation value;

substituting y into ƒ

₂(y) to obtain a schedule evaluation value;

substituting z into ƒ

₃(z) to obtain an environmental noise strength evaluation value; and

substituting v into ƒ

₄(v) to obtain a moving speed evaluation value.

25. The method according to claim 24, wherein ƒ

₁(x)=α

_1x, wherein α

₁ indicates a signal strength weight and α

₁>

0, wherein

26. The method according to claim 18, wherein the environmental image is captured in the following manner:

setting photographing parameters; and

performing photographing to obtain the environmental image, wherein the photographing parameters are determined according to the moving speed data, or the photographing parameters are preset standard photographing parameters.

27. The method according to claim 26, wherein using the captured environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat comprises:

detecting whether the environmental image comprises a preset mark;

determining that the seat taken by the wearer is the driver'"'"'s seat when it is detected that the preset mark is comprised; and

determining that the seat taken by the wearer is not the driver'"'"'s seat when it is detected that the preset mark is not comprised;

or

calculating a similarity between the captured environmental image and a preset standard environmental image;

determining that the seat taken by the wearer is the driver'"'"'s seat when the similarity obtained through calculation is greater than or equal to a similarity threshold and

determining that the seat taken by the wearer is not the driver'"'"'s seat when the similarity obtained through calculation is less than the similarity threshold.

28. The method according to claim 26, wherein the photographing parameters comprise an exposure time, a reciprocal F of a ratio of an aperture diameter to a focal length of a lens, a sensitivity, and a selected focus.

29. The method according to claim 18, wherein after it is determined that the wearer is in the driving state, the method further comprises:

sending device information of a wearable device that has been connected to the head mounted device, to a vehicle mounted system to which the vehicle mounted wireless network belongs when it is detected that the head mounted device is connected to the vehicle mounted wireless network;

searching for a wearable device that established a connection with the head mounted device when it is determined that the wearer is in the non-driving state; and

reestablishing a connection with the wearable device that is searched out.

30. The method according to claim 18, further comprising:

converting information received or coming from a preset emergency contact into speech information for playing when it is determined that the wearer is in the driving state; and

pushing the screen display service to a display screen other than the head mounted device when it is determined that the wearer is in the driving state.

31-35. -35. (canceled)

36. A head mounted device control apparatus, comprising a memory configured to store instructions, wherein the instructions being executed by a processor cause the head mounted device control apparatus to:

use captured status data to determine a status of a wearer of the head mounted device, wherein the status comprises a driving state and a non-driving state; and

disable a preset service when it is determined that the wearer is in the driving state, wherein the preset service comprises at least one of a screen display service of a near-eye display, a manual input service, and a projection and display service, wherein the status data comprises situation data and an environmental image, and wherein the situation data comprises at least one type of moving speed data, signal strength data of a vehicle mounted wireless network, user schedule data, and environmental noise strength data.

37. The head mounted device control apparatus according to claim 36, wherein the instructions are further executed by the processor to cause the head mounted device control apparatus to:

enable the preset service when it is determined that the wearer is in the non-driving state; and

retain the preset service when it is determined that the wearer is in the non-driving state.

38. The head mounted device control apparatus according to claim 36, wherein the instructions are further executed by the processor to cause the head mounted device control apparatus to:

use the situation data to determine whether the wearer of the head mounted device is inside a moving vehicle;

use the environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat when it is determined that the wearer is inside the moving vehicle; and

determine that the wearer of the head mounted device is in the driving state when the wearer is inside the moving vehicle and the seat taken is the driver'"'"'s seat.

39. The head mounted device control apparatus according to claim 36, wherein the instructions are further executed by the processor to cause the head mounted device control apparatus to:

use the environmental image to determine whether a seat taken by the wearer is a driver'"'"'s seat;

use the situation data to determine whether the wearer of the head mounted device is inside a moving vehicle when it is determined that the seat taken by the wearer is the driver'"'"'s seat; and

determine that the wearer of the head mounted device is in the driving state when the wearer is inside the moving vehicle and the seat taken is the driver'"'"'s seat.

40. The head mounted device control apparatus according to claim 38, wherein the instructions are further executed by the processor to cause the head mounted device control apparatus to determine that the wearer of the head mounted device is in the non-driving state when it is determined that the seat taken is not the driver'"'"'s seat or that the wearer is not inside the moving vehicle.

41. The head mounted device control apparatus according to claim 38, wherein the instructions are further executed by the processor to cause the head mounted device control apparatus to substitute the situation data into a situation evaluation function to obtain a situation evaluation value, wherein using the situation data to determine whether the wearer is inside the moving vehicle comprises:

determining whether the situation evaluation value is greater than or equal to a threshold;

determining that the wearer is inside the moving vehicle when the situation evaluation value is greater than or equal to the threshold; and

determining that the wearer is not inside the moving vehicle when the situation evaluation value is less than the threshold.

42. The head mounted device control apparatus according to claim 41, wherein the situation evaluation function is denoted by F(x,y,z,v) and comprises at least one of a signal strength evaluation function ƒ

₁(x), a schedule evaluation function ƒ

₂(y), an environmental noise evaluation function ƒ

₃(z), and a moving speed evaluation function ƒ

₄(v), wherein x indicates the signal strength data, wherein y indicates the user schedule data, wherein z indicates the environmental noise strength data, wherein v indicates the moving speed data, and wherein substituting the situation data into the situation evaluation function to obtain the situation evaluation value comprises at least one of the following;

substituting x into ƒ

₁(x) to obtain a signal strength evaluation value;

substituting y into ƒ

₂(y) to obtain a schedule evaluation value;

substituting z into ƒ

₃(z) to obtain an environmental noise strength evaluation value; and

substituting v into ƒ

₄(v) to obtain a moving speed evaluation value.

43. The head mounted device control apparatus according to claim 42, wherein ƒ

₁(x)=α

_1x, wherein α

₁ indicates a signal strength weight and α

₁>

0, wherein