INFORMATION PRESENTATION DEVICE, DIGITAL CAMERA, HEAD MOUNT DISPLAY, PROJECTOR, INFORMATION PRESENTATION METHOD AND NON-TRANSITORY COMPUTER READABLE MEDIUM

• US 20130215149A1
• Filed: 03/29/2013
• Published: 08/22/2013
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: HAYASHI, Daisuke
• Granted Patent: US 9,196,093 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A digital camera functioning as an information presentation device is provided with a CG superimposition unit 17 which functions so that a virtual object is superimposed on a real space image captured by an imaging element 3, and is displayed on a display unit 23; a visual line detection unit 12 which detects a visual line of a person included in the real space image captured by the imaging element 3; and a superimposing position determination unit 11 which determines a superimposing position of the virtual object on the basis of the visual line detected by the visual line detection unit 12.

Claims

1. An information presentation device that presents information to a person in real space, comprising:

a control unit that performs a control either to superimpose the information on a reality space image captured by the imaging element to be displayed on a display unit or to project the information on a position of the reality space;

a line-of-sight detection unit that detects lines-of-sight of a plurality of persons included in the reality space image captured by the imaging element; and

an information presentation position determination unit that determines a superimposing position of the information or the position on the basis of the detected lines-of-sight of the plurality of the persons by the line-of-sight detection unit.

2. The information presentation device according to claim 1, further comprising:

an attribute determination unit that determines attributes of all the persons of which lines-of-sight are detected using images of all the persons and a database in which the images of the persons and the attributes thereof are recorded to be corresponded with each other; and

an information contents determination unit that determines a content of information according to the attributes of all the persons.

3. The information presentation device according to claim 2, wherein the attribute of the person indicates at least one of sex, age, occupation, name and costume.

4. The information presentation device according to claim 1, further comprising:

an angle calculation unit that calculates an angle formed by the respective lines-of-sight of two persons included in the reality space image captured by the imaging element; and

an information contents determination unit that determines the content of information according to at least the angle formed by the lines-of-sight.

5. The information presentation device according to claim 4, further comprising:

an attribute determination unit that determines the attributes of two persons using the images of the two persons and a database in which the images of the two persons and the attributes thereof are recorded to be corresponded with each other,

wherein the information contents determination unit determines the content of information according to the angle formed by the lines-of-sight and the attributes of the two persons.

6. The information presentation device according to claim 5, wherein the attribute of the person indicates at least one of sex, age, occupation, name and costume.

7. A digital camera, comprising:

respective units of the information presentation device according to claim 1;

the imaging element; and

the display unit,

wherein the control unit performs the control to superimpose the information on the reality space image captured by the imaging element to be displayed on the display unit

8. A head mount display, comprising:

respective units of the information presentation device according to claim 1;

the imaging element; and

the display unit,

wherein the control unit performs the control to superimpose the information on the reality space image captured by the imaging element to be displayed on a display unit.

9. A projector, comprising:

respective units of the information presentation device according to claim 1; and

the imaging element,

wherein the control unit performs the control to project the information on the position of the reality space

10. An information presentation method in which information is presented to a person in real space, comprising:

a control step of performing a control either to superimpose the information on a reality space image captured by the imaging element to be displayed on a display unit or to project the information on a position of the reality space;

a line-of-sight detection step of detecting a lines-of-sight of a plurality of persons included in the reality space image captured by the imaging element; and

an information presentation position determination step of determining information presentation position to determine a superimposing position of the information or the position on the basis of the detected lines-of-sight of the plurality of the persons by the line-of-sight detection unit.

11. The information presentation method according to claim 10, further comprising:

an attribute determination step of determining attributes of all the persons of which lines-of-sight are detected using images of all the persons and a database in which the images of the persons and the attributes thereof are recorded to be corresponded with each other; and

an information contents determination step of determining a content of information according to the attributes of all the persons.

12. The information presentation method according to claim 11, wherein the attribute of the person indicates at least one of sex, age, occupation, name, and costume.

13. The information presentation method according to claim 10, further comprising:

an angle calculation step of calculating an angle formed by the respective lines-of-sight of two persons included in the reality space image captured by the imaging element; and

an information contents determination step of determining the content of information according to at least the angle formed by the lines-of-sight.

14. The information presentation method according to claim 13, further comprising:

an attribute determination step of determining the attributes of two persons using the images of the two persons and a database in which the images of the two persons and the attributes thereof are recorded to be corresponded with each other,

wherein in the information contents determination step, it is determined the content of information according to the angle formed by the lines-of-sight and the attributes of the two persons.

15. The information presentation method according to claim 14, wherein the attribute of the person indicates at least one of sex, age, occupation, name, and costume.

16. A non-transitory computer readable medium storing an information presentation program that, when executed, causes respective steps of the information presentation method according to claim 11.