Head mount display device and method for controlling the same

• US 8,878,750 B1
• Filed: 10/31/2013
• Issued: 11/04/2014
• Est. Priority Date: 09/02/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Park, Hyorim, Lee, Doyoung, Kim, Yongsin
• Primary Examiner(s): Sitta, Grant
• Application Number:
  US14/068,522
• Time in Patent Office: 369 Days
• Field of Search: 345/156, 345/8
• US Class Current: 345/8
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks

Abstract

A head mount display (HMD) device according to one embodiment comprises a camera unit configured to capture an image at a front of the HMD device, a distance obtaining unit configured to obtain a distance between the HMD device and an object in the front of the HMD device, a communication unit configured to transmit and receive data, a display unit configured to display visual information, and a processor configured to control the camera unit, the distance obtaining unit, the communication unit and the display unit, wherein the processor is further configured: to recognize a face from the image, to receive personal data corresponding to the recognized face, to obtain, from the received personal data, personal information and period from a latest date when the face was lastly recognized to a current date when the face is currently recognized, to display the personal information when the period is longer than a first threshold period, and control a quantity of the personal information to be displayed based on a distance between the recognized face and the HMD device, and the period, and not to display the personal information when the period is shorter than the first threshold period.

Claims

1. A head mount display (HMD) device comprising:

a camera unit configured to capture an image at a front of the HMD device;

a distance obtaining unit configured to obtain a relative distance between the HMD device and an object in the front of the HMD device;

a location obtaining unit configured to obtain an absolute location information of the HMD device;

a communication unit configured to transmit and receive data;

a display unit configured to display visual information; and

a processor configured to control the camera unit, the distance obtaining unit, the location obtaining unit, the communication unit and the display unit,

wherein the processor is further configured;

to recognize a face from the image,

to receive personal data corresponding to the recognized face,

to obtain, from the received personal data, personal information and period from a latest date when the face was lastly recognized to a current date when the face is currently recognized,

when the period is shorter than a first threshold period, not to display the personal information, and

when the period is longer than the first threshold period, to display the personal information, and to control a quantity of the personal information based on the relative distance and the period, and

wherein a category of the personal information to be displayed is determined based on the absolute location information of the HMD device.

2. The HMD device according to claim 1, wherein the processor is further configured to:

reduce the quantity of the personal information when the relative distance becomes short, and

increase the quantity of the personal information when the relative distance becomes long.

3. The HMD device according to claim 1, wherein the processor is further configured to:

reduce the quantity of the personal information when the period becomes short, and

increase the quantity of the personal information when the period becomes long.

4. The HMD device according to claim 1, wherein the period includes a time interval from a latest time when the face was lastly recognized to a current time when the face is currently recognized.

5. The HMD device according to claim 1, wherein the processor is further configured to control the quantity of the personal information by adjusting at least one of a size of a text, a quantity of the text, a scroll speed, number of categories, and a size of the visual information.

6. The HMD device according to claim 1, wherein the processor is further configured to:

obtain frequency information on number of recognized times of the face for a second threshold period, from the received personal data, and

control the quantity of the personal information based on the frequency information.

7. The HMD device according to claim 6, wherein the processor is further configured to:

reduce the quantity of the personal information when the number of recognized times is increased, and

increase the quantity of the personal information when the number of recognized times is reduced.

8. The HMD device according to claim 6, wherein the processor is further configured not to display the personal information when the number of recognized times exceeds a predetermined number.

9. The HMD device according to claim 1, wherein the personal information includes at least one of name information, age information, address information, company information, job title information, contact information, and recent meeting date information corresponding to the recognized face.

10. The HMD device according to claim 1, wherein the location obtaining unit includes a Global Positioning System (GPS) sensor.

11. The HMD device according to claim 1, wherein, when the period is longer than the first threshold period, the processor is further configured to:

obtain the absolute location of the HMD device and determine the category of the personal information to be displayed based on the obtained absolute location,

display the personal information based on the determined category, and

control the quantity of the displayed personal information based on the relative distance and the period.

12. The HMD device according to claim 1, wherein the processor is further configured to display the personal information near the recognized face.

13. The HMD device according to claim 1, wherein the processor is further configured:

to recognize a pupil from the image, and

to receive the personal data corresponding to the recognized pupil.

14. The HMD device according to claim 1, wherein the processor is further configured to update status information on a current status when the face is recognized from the image.

15. The HMD device according to claim 14, wherein the status information includes at least one of information on recognizing date when the face is recognized, recognizing time when the face is recognized, and a location where the face is recognized.

16. The HMD device according to claim 1, wherein the processor is further configured to provide a notification indicating that the personal information does not exist when the personal information corresponding to the recognized face does not exist.

17. The HMD device according to claim 1, wherein the processor is further configured to control the quantity of the personal information based on priority of a plurality of categories included in the personal information when controlling the quantity of the personal information based on the relative distance and the period.

18. A method for controlling a head mount display (HMD) device, the method comprising:

capturing an image at a front of the HMD device;

recognizing a face from the image;

receiving personal data corresponding to the recognized face;

obtaining, from the received personal data, personal information and period from a latest date when the face is lastly recognized to a current date when the face is currently recognized;

when the period is shorter than a first threshold period, not displaying the personal information; and

when the period is longer than the first threshold period, displaying the personal information and controlling a quantity of the personal information to be displayed is controlled based on the period and a relative distance between the HMD device and the recognized face,

wherein a category of the personal information to be displayed is determined based on an absolute location information of the HMD device.

19. The method according to claim 18, wherein the displaying the personal information includes:

reducing the quantity of the personal information when the relative distance becomes short, and

increasing the quantity of the personal information when the relative distance becomes long.

20. The method according to claim 18, wherein the displaying the personal information includes:

reducing the quantity of the personal information when the period becomes short, and

increasing the quantity of the personal information when the period becomes long.