Information display method and information display terminal

• US 10,445,577 B2
• Filed: 04/08/2014
• Issued: 10/15/2019
• Est. Priority Date: 04/08/2014
• Status: Active Grant

• Current Assignee: Maxell, Ltd.
• Original Assignee: Maxell, Ltd.
• Inventors: Ouchi, Satoshi, Seo, Yoshiho, Ogi, Yuya, Kawamura, Tomoto, Nakamura, Toshiteru
• Primary Examiner(s): Jansen, II, Michael J
• Application Number:
  US15/302,005
• Publication Number:
  US 20170116479A1
• Time in Patent Office: 2,016 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06Q 30/0235 constrained by time limit or expiration date
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: G09G 2380/04 Electronic labels
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

An information display terminal includes an arithmetic unit performing a process that selects a predetermined type of communication unit among a plurality of types of communication units on the basis of, for example, information related to first objects recognized from a captured image, which is stored in advance, and acquires the related information from a predetermined device on the Internet through the communication unit and a process that, when the presence of a second object or a predetermined positional relationship between the first objects and the second object is specified in the captured image, displays the related information of the first objects in a viewing direction, using a display unit.

Claims

1. An information display method that is performed in an information display terminal including a processor coupled to a memory, a camera that captures an image in a viewing direction of a wearer, a display that displays information in the viewing direction, and a plurality of types of communication units that communicate with a network or another terminal which accesses the network, the method comprising:

an information acquisition process, executed by the processor, that recognizes a first object in the image captured by the camera according to a predetermined criterion, selects a communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, accesses the network or another terminal through the communication unit, and acquires the related information of the first object from the network on the basis of identification information recognized from the first object; and

an information display process, executed by the processor, that, when a predetermined positional relationship between the first object and a second object is determined or specified in the image captured by the camera, displays the acquired related information of the first object in the viewing direction using the display,

wherein, in the information acquisition process, the communication unit of a predetermined type is selected from among the plurality of types of communication units on the basis of an available communication type indicated by information about a communication environment of the first object as the information related to the first object which is stored in advance.

2. The information display method according to claim 1,

wherein, in the information display process, when the predetermined positional relationship between the first object and the second object in the image captured by the camera is maintained for a predetermined period of time or more, the information display terminal displays the acquired related information of the first object in the viewing direction using the display.

3. The information display method according to claim 2,

wherein the predetermined positional relationship is that a distance between the first object and the second object is within a predetermined distance or the first object and the second object are overlapped.

4. The information display method according to claim 1,

wherein, in the information acquisition process, the information display terminal selects the communication unit that has a radio field intensity equal to or greater than a predetermined level among the current radio field intensities sensed by each communication unit as the predetermined detection information obtained from the predetermined element.

5. The information display method according to claim 1,

wherein, in the information acquisition process, the information display terminal selects the communication unit with minimum power consumption when a remaining battery level obtained from a power management unit of the information display terminal is equal to or less than a predetermined value as the predetermined detection information obtained from the predetermined element.

6. The information display method according to claim 1,

wherein the information display terminal further includes a positioning unit that measures a current position of the information display terminal and a storage unit that stores map information, and

wherein, in the information acquisition process, the information display terminal calculates a distance between the current position of the information display terminal obtained from the positioning unit and a position of the first object on a map, which is specified by collating the identification information recognized from the first object with the map information, as the predetermined detection information obtained from the predetermined element and selects the communication unit with a communicable distance including the calculated distance.

7. An information display method that is performed in an information display terminal including a processor coupled to a memory, a camera that captures an image in a viewing direction of a wearer, a display that displays information in the viewing direction, and a plurality of types of communication units that communicate with a network or another terminal which accesses the network, the method comprising:

an information acquisition process, executed by the processor, that recognizes a first object in the image captured by the camera according to a predetermined criterion, selects a communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, accesses the network or another terminal through the communication unit, and acquires the related information of the first object from the network on the basis of identification information recognized from the first object; and

an information display process, executed by the processor, that, when a predetermined positional relationship between the first object and a second object is determined or specified in the image captured by the camera, displays the acquired related information of the first object in the viewing direction using the display,

wherein, in the information acquisition process, the communication unit is selected among the plurality of types of communication units in an order of priority of each of the types of communication units on the basis of at least one of the information related to the first object which is stored in advance and the predetermined detection information obtained from the predetermined element.

8. The information display method according to claim 7,

wherein, in the information display process, when the predetermined positional relationship between the first object and the second object in the image captured by the camera is maintained for a predetermined period of time or more, the information display terminal displays the acquired related information of the first object in the viewing direction using the display.

9. The information display method according to claim 7,

wherein, in the information acquisition process, the information display terminal selects the communication unit that has a radio field intensity equal to or greater than a predetermined level among the current radio field intensities sensed by each communication unit as the predetermined detection information obtained from the predetermined element.

10. The information display method according to claim 7,

wherein, in the information acquisition process, the information display terminal selects the communication unit with minimum power consumption when a remaining battery level obtained from a power management unit of the information display terminal is equal to or less than a predetermined value as the predetermined detection information obtained from the predetermined element.

11. The information display method according to claim 7,

wherein the information display terminal further includes a positioning unit that measures a current position of the information display terminal and a storage unit that stores map information, and

wherein, in the information acquisition process, the information display terminal calculates a distance between the current position of the information display terminal obtained from the positioning unit and a position of the first object on a map, which is specified by collating the identification information recognized from the first object with the map information, as the predetermined detection information obtained from the predetermined element and selects the communication unit with a communicable distance including the calculated distance.

12. An information display terminal comprising:

a camera that captures an image in a viewing direction of a wearer;

a display that displays information in the viewing direction;

a plurality of types of communication units that communicate with a network or another terminal which access the network; and

a processor coupled to a memory, the memory storing instructions that, when executed by the processor, configure the processor to;

recognize a first object in the image captured by the camera according to a predetermined criterion, select a communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, access the network or the another terminal through the communication unit, and acquire the related information of the first object from the network on the basis of identification information recognized from the first object, and

when a predetermined positional relationship between the first object and a second object is determined or specified in the image captured by the camera, display the acquired related information of the first object in the viewing direction using the display,

wherein the processor is further configured to select the communication unit of a predetermined type from among the plurality of types of communication units on the basis of an available communication type indicated by information about a communication environment of the first object as the information related to the first object which is stored in advance.

13. The information display terminal according to claim 12,

wherein the processor is further configured to, when the predetermined positional relationship between the first object and the second object in the image captured by the camera is maintained for a predetermined period of time or more, display the acquired related information of the first object in the viewing direction using the display.

14. The information display terminal according to claim 13,

wherein the predetermined positional relationship is that a distance between the first object and the second object is within a predetermined distance or the first object and the second object are overlapped.

15. The information display terminal according to claim 12,

wherein the processor is further configured to select the communication unit that has a radio field intensity equal to or greater than a predetermined level among the current radio field intensities sensed by each communication unit as the predetermined detection information obtained from the predetermined element.

16. The information display terminal according to claim 12,

wherein the processor is further configured to select the communication unit with minimum power consumption when a remaining battery level obtained from a power management unit of the information display terminal is equal to or less than a predetermined value as the predetermined detection information obtained from the predetermined element.

17. The information display terminal according to claim 12,

wherein the information display terminal further includes a positioning unit that measures a current position of the information display terminal and a storage unit that stores map information, and

wherein the processor is further configured to calculate a distance between the current position of the information display terminal obtained from the positioning unit and a position of the first object on a map, which is specified by collating the identification information recognized from the first object with the map information, as the predetermined detection information obtained from the predetermined element and select the communication unit with a communicable distance including the calculated distance.

18. An information display terminal comprising:

a camera that captures an image in a viewing direction of a wearer;

a display that displays information in the viewing direction;

a plurality of types of communication units that communicate with a network or another terminal which access the network; and

a processor coupled to a memory, the memory storing instructions that, when executed by the processor, configure the processor to;

recognize a first object in the image captured by the camera according to a predetermined criterion, select a communication unit among the plurality of types of communication units on the basis of at least one of information related to the first object which is stored in advance and predetermined detection information which is obtained from a predetermined element, access the network or the another terminal through the communication unit, and acquire the related information of the first object from the network on the basis of identification information recognized from the first object, and

when a predetermined positional relationship between the first object and a second object is determined or specified in the image captured by the camera, display the acquired related information of the first object in the viewing direction using the display,

wherein the processor is further configured to select the communication unit from among the plurality of types of communication units in an order of priority of each of the types of communication units on the basis of at least one of the information related to the first object which is stored in advance and the predetermined detection information obtained from the predetermined element.

19. The information display terminal according to claim 18,

wherein the processor is further configured to, when the predetermined positional relationship between the first object and the second object in the image captured by the camera is maintained for a predetermined period of time or more, display the acquired related information of the first object in the viewing direction using the display.

20. The information display terminal according to claim 18,

wherein the processor is further configured to select the communication unit that has a radio field intensity equal to or greater than a predetermined level among the current radio field intensities sensed by each communication unit as the predetermined detection information obtained from the predetermined element.

21. The information display terminal according to claim 18,

wherein the processor is further configured to select the communication unit with minimum power consumption when a remaining battery level obtained from a power management unit of the information display terminal is equal to or less than a predetermined value as the predetermined detection information obtained from the predetermined element.

22. The information display terminal according to claim 18,

wherein the information display terminal further includes a positioning unit that measures a current position of the information display terminal and a storage unit that stores map information, and

wherein the processor is further configured to calculate a distance between the current position of the information display terminal obtained from the positioning unit and a position of the first object on a map, which is specified by collating the identification information recognized from the first object with the map information, as the predetermined detection information obtained from the predetermined element and select the communication unit with a communicable distance including the calculated distance.