INFORMATION DISPLAY METHOD AND INFORMATION DISPLAY TERMINAL

• US 20170116479A1
• Filed: 04/08/2014
• Published: 04/27/2017
• Est. Priority Date: 04/08/2014
• Status: Active Grant

• Current Assignee: Maxell, Ltd.
• Original Assignee: Hitachi Maxell Limited (Hitachi, Ltd.)
• Inventors: OUCHI, Satoshi, SEO, Yoshiho, OGI, Yuya, KAWAMURA, Tomoto, NAKAMURA, Toshiteru
• Granted Patent: US 10,445,577 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06Q 30/0235 constrained by time limit or expiration date
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: G09G 2380/04 Electronic labels
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

An information display terminal includes an arithmetic unit performing a process that selects a predetermined type of communication unit among a plurality of types of communication units on the basis of, for example, information related to first objects recognized from a captured image, which is stored in advance, and acquires the related information from a predetermined device on the Internet through the communication unit and a process that, when the presence of a second object or a predetermined positional relationship between the first objects and the second object is specified in the captured image, displays the related information of the first objects in a viewing direction, using a display unit.

Claims

1. An information display method that is performed in an information display terminal including an imaging unit that captures an image in a viewing direction of a wearer, a display unit that displays information in the viewing direction, and a plurality of types of communication units that communicate with a network or another terminal which can access the network, the method comprising:

an information acquisition process that recognizes a first object in the image captured by the imaging unit according to a predetermined criterion, selects a predetermined type of communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, accesses the network or another terminal through the communication unit, and acquires the related information of the first object from the network on the basis of identification information recognized from the first object; and

an information display process that, when the presence of a second object or a predetermined positional relationship between the first object and the second object is determined or specified in the image captured by the imaging unit, displays the acquired related information of the first object in the viewing direction, using the display unit.

2. The information display method according to claim 1,

wherein, in the information display process, when the predetermined positional relationship between the first object and the second object in the image captured by the imaging unit is maintained for a predetermined period of time or more, the information display terminal displays the acquired related information of the first object in the viewing direction, using the display unit.

3. The information display method according to claim 1,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects the predetermined type of communication unit among the plurality of types of communication units on the basis of an available communication type indicated by information about a communication environment of the first object as the information related to the first object which is stored in advance.

4. The information display method according to claim 1,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects a communication unit that has a radio field intensity equal to or greater than a predetermined level among the current radio field intensities sensed by each communication unit as the predetermined detection information obtained from the predetermined element.

5. The information display method according to claim 1,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects a communication unit with minimum power consumption when a remaining battery level obtained from a power management unit of the information display terminal is equal to or less than a predetermined value as the predetermined detection information obtained from the predetermined element.

6. The information display method according to claim 1,

wherein the information display terminal further includes a positioning unit that measures a current position of the information display terminal and a storage unit that stores map information, and

when the communication unit is selected in the information acquisition process, the information display terminal calculates a distance between the current position of the information display terminal obtained from the positioning unit and a position of the first object on a map, which is specified by collating the identification information recognized from the first object with the map information, as the predetermined detection information obtained from the predetermined element and selects a communication unit with a communicable distance including the calculated distance.

7. The information display method according to claim 1,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects the communication unit in an order of priority of each type of communication unit, on the basis of at least one of the information related to the first object which is stored in advance and the predetermined detection information obtained from the predetermined element.

8. An information display method that is performed in an information display terminal including a display unit that displays information in a viewing direction of wearer, a plurality of types of communication units that communicate with a network or another terminal which can access the network, a posture detection unit that detects a posture of the information display terminal, a positioning unit that measures a current position of the information display terminal, and a storage unit that stores map information, the method comprising:

an information acquisition process that recognizes an object which the wearer of the information display terminal faces on a map as a first object on the basis of the current position of the information display terminal obtained from the positioning unit, a direction of the information display terminal obtained from the posture detection unit, and the map information, selects a predetermined type of communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, accesses the network or another terminal through the communication unit, and acquires the related information of the first object from the network on the basis of identification information recognized from the first object; and

an information display process that measures a time for which the wearer faces the first object and displays the acquired related information of the first object in the viewing direction using the display unit when the measured time is equal to or greater than a predetermined value.

9. The information display method according to claim 8,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects the predetermined type of communication unit among the plurality of types of communication units on the basis of an available communication type indicated by information about a communication environment of the first object as the information related to the first object which is stored in advance.

10. The information display method according to claim 8,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects a communication unit that has a radio field intensity equal to or greater than a predetermined level among the current radio field intensities sensed by each communication unit as the predetermined detection information obtained from the predetermined element.

11. The information display method according to claim 8,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects a communication unit with minimum power consumption when a remaining battery level obtained from a power management unit of the information display terminal is equal to or less than a predetermined value as the predetermined detection information obtained from the predetermined element.

12. The information display method according to claim 8,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal calculates a distance between the current position of the information display terminal obtained from the positioning unit and a position of the first object on a map as the predetermined detection information obtained from the predetermined element and selects a communication unit with a communicable distance including the calculated distance.

13. The information display method according to claim 8,

wherein, when the communication unit is selected in the information acquisition process, the information display terminal selects the communication unit in an order of priority of each type of communication unit, on the basis of at least one of the information related to the first object which is stored in advance and the predetermined detection information obtained from the predetermined element.

14. An information display terminal comprising:

an imaging unit that captures an image in a viewing direction of a wearer;

a display unit that displays information in the viewing direction;

a plurality of types of communication units that communicate with a network or another terminal which can access the network; and

an arithmetic unit performing a process that recognizes a first object in the image captured by the imaging unit according to a predetermined criterion, selects a predetermined type of communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, accesses the network or another terminal through the communication unit, and acquires the related information of the first object from the network on the basis of identification information recognized from the first object and a process that, when the presence of a second object or a predetermined positional relationship between the first object and the second object is determined or specified in the image captured by the imaging unit, displays the acquired related information of the first object in the viewing direction, using the display unit.

15. An information display terminal comprising:

a display unit that displays information in a viewing direction of wearer;

a plurality of types of communication units that communicate with a network or another terminal which can access the network;

a posture detection unit that detects a posture of the information display terminal;

a positioning unit that measures a current position of the information display terminal;

a storage unit that stores map information; and

an arithmetic unit performing a process that recognizes an object which the wearer of the information display terminal faces on a map as a first object on the basis of the current position of the information display terminal obtained from the positioning unit, a direction of the information display terminal obtained from the posture detection unit, and the map information, selects a predetermined type of communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, accesses the network or another terminal through the communication unit, and acquires the related information of the first object from the network on the basis of identification information recognized from the first object and a process that measures a time for which the wearer faces the first object and displays the acquired related information of the first object in the viewing direction using the display unit when the measured time is equal to or greater than a predetermined value.