WEARABLE TERMINAL DEVICE AND METHOD OF CONTROLLING THE WEARABLE TERMINAL DEVICE

• US 20110001695A1
• Filed: 06/28/2010
• Published: 01/06/2011
• Est. Priority Date: 07/06/2009
• Status: Abandoned Application

• Current Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Inventors: Marumo, Nobuyuki, Suzuki, Katsuyuki, Yoshimune, Shin, Mochida, Yasuhiko, Iizaka, Hitoshi, Watanabe, Nobuo, Natsume, Morito
• Application Number:
  US12/824,566
• Publication Number:
  US 20110001695A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions

Abstract

A wearable terminal device includes: a head mounted display including a monitor display unit; a line-of-sight detecting unit for detecting a line-of-sight position of a wearer; a sound collecting unit configured to collect sound uttered by the wearer; a sound recognizing unit configured to recognize a sound command from the wearer on the basis of the collected sound; an operation unit configured to receive operation corresponding to the detected line-of-sight position or operation instructed by the recognized sound command; a setting unit configured to set an operation mode corresponding to work of the wearer out of plural operation modes; and a control unit configured to control, in the set operation mode, display of the monitor display unit corresponding to operation by the wearer.

Claims

1. A wearable terminal device comprising:

a head mounted display including a monitor display unit;

a line-of-sight detecting unit for detecting a line-of-sight position of a wearer;

a sound collecting unit configured to collect sound uttered by the wearer;

a sound recognizing unit configured to recognize a sound command from the wearer on the basis of the collected sound;

an operation unit configured to receive operation corresponding to the detected line-of-sight position or operation instructed by the recognized sound command;

a setting unit configured to set an operation mode corresponding to work of the wearer out of plural operation modes; and

a control unit configured to control, in the set operation mode, display of the monitor display unit corresponding to operation by the wearer.

2. The device according to claim 1, further comprising:

an image pickup unit; and

an image recognizing unit configured to perform image recognition for an area corresponding to the detected line-of-sight position from an image picked up by the image pickup unit, wherein

the control unit controls, in the set operation mode, processing corresponding to a result of the recognition by the image recognizing unit.

3. The device according to claim 2, wherein

the image recognizing unit recognizes a predetermined code or a predetermined image included in the area, and

the control unit controls, in the set operation mode, processing performed by using the predetermined code or the predetermined image.

4. The device according to claim 1, further comprising a position detecting unit configured to detect a position of the device, wherein

the setting unit sets the operation mode corresponding to the detected position of the device.

5. The device according to claim 1, wherein the setting unit sets the operation mode according to operation by the wearer through the operation unit.

6. The device according to claim 1, wherein the monitor display unit performs display corresponding to the set operation mode.

7. The device according to claim 1, wherein the monitor display unit performs display corresponding to the operation mode by switching a background color.

8. The device according to claim 1, wherein the monitor display unit performs display in a light transmissive state.

9. The device according to claim 1, wherein the plural operation modes include a checkout mode for performing checkout for a commodity, a check mode for performing check of a commodity, and a registration mode for performing registration of a commodity.

10. A method of controlling a wearable terminal device including:

a head mounted display including a monitor display unit;

a line-of-sight detecting unit for detecting a line-of-sight position of a wearer, a sound collecting unit configured to collect sound uttered by the wearer;

a sound recognizing unit configured to recognize a sound command from the wearer on the basis of the collected sound; and

an operation unit configured to receive operation corresponding to the detected line-of-sight position or operation instructed by the recognized sound command,

the method comprising;

setting an operation mode corresponding to work of the wearer out of plural operation modes; and

controlling, in the set operation mode, display of the monitor display unit corresponding to operation by the wearer.