Information display system using head mounted display device, information display method using head mounted display device, and head mounted display device

• US 9,824,496 B2
• Filed: 02/20/2014
• Issued: 11/21/2017
• Est. Priority Date: 03/22/2013
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Kimura, Fusashi
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Tswei, Yu-Jang
• Application Number:
  US14/185,692
• Publication Number:
  US 20140285521A1
• Time in Patent Office: 1,370 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 1/00 Arrangements for detecting or preventing errors in the information received correcting synchronisation H04L7/00

Abstract

In an information display system, an information apparatus includes a target information storage section that stores target information to be published by the information apparatus and an extraction section that extracts the target information from the target information storage section on the basis of user information that is information regarding a user of a head mounted display device, and the head mounted display device includes an information generating section that generates information for additional presentation for providing the augmented reality to the user using the target information acquired from the information apparatus and an image display section that enables the user to view the generated information for additional presentation as a virtual image.

Claims

1. An information display system, comprising:

an information apparatus; and

a head mounted display device that enables a user to view a virtual image,

wherein the information apparatus includes;

a target information table that stores;

target information to be published by the information apparatus,

extraction permission conditions, which are conditions when extracting the target information, so as to match the target information, and

order information for determining a display order of the target information so as to match the target information, the order information specifying, for each piece of target information included in the target information table, a respective agreement number that represents a number of users that have agreed with the piece of target information; and

at least one of a processor that executes one or more programs and an application specific integrated circuit (“

ASIC”

) to realize one or more functions of;

an extraction section that extracts;

the order information from the target information table, and

the target information from the target information table when user information that is information regarding the user of the head mounted display device satisfies the extraction permission conditions; and

a communication unit that transmits the extracted target information and the extracted order information to the head mounted display device,

wherein the head mounted display device includes;

at least one of an additional processor that executes one or more programs and an additional application specific integrated circuit (“

ASIC”

) to realize one or more functions of;

an information acquisition section that transmits the user information to the information apparatus and acquires the target information from the information apparatus; and

an information generating section that generates information for additional presentation for providing augmented reality to the user using the acquired target information; and

an optical image display that enables the user to view the generated information for additional presentation as the virtual image, and

wherein, when a plurality of pieces of the target information satisfying the extraction permission conditions are received, the information generating section of the head mounted display device generates the information for additional presentation by placing each of the plurality of pieces of target information respectively in a separate layer of a plurality of superimposed layers according to the order information.

2. The information display system according to claim 1,

wherein at least one of an account name set by the user, authentication information set by the user, an e-mail address of the user, a network address of the head mounted display device, a MAC address of the head mounted display device, an account name provided from a provider of a service used by the user, and authentication information provided from the provider of the service used by the user is included in the user information.

3. The information display system according to claim 1,

wherein

the information apparatus further includes an update condition table that stores update permission conditions for allowing updating of the target information table,

the at least one of the processor and the ASIC included in the information apparatus further realize one or more functions of an update section that, when received information that has been received from the head mounted display device satisfies the update permission conditions, updates the target information table using the received information, and

the at least one of the additional processor and the additional ASIC included in the head mounted display device further realizes one or more functions of an update request section that transmits information for updating the target information table to the information apparatus.

4. The information display system according to claim 3,

wherein, in the information apparatus, limited area information specifying a limited area to limit updating of the target information table is stored in the update condition table of the information apparatus so as to match the update permission conditions, and the update section acquires the limited area information corresponding to current position information of the head mounted display device, which is included in the received information, and updates the target information table using the received information when the received information satisfies the update permission conditions matched with the acquired limited area information, and

the update request section of the head mounted display device transmits the current position information indicating a current position of the head mounted display device together with information for updating the target information table.

5. The information display system according to claim 3,

wherein at least one of conditions specifying the user for whom updating of the target information table is allowed, conditions specifying update date and time of the target information table, and conditions indicating that updating of the target information table is not allowed is included in the update permission conditions.

6. The information display system according to claim 1, wherein the extraction permission conditions specify a time period associated with the target information.

7. The information display system according to claim 6, wherein the time period specified by the extraction permission conditions includes at least one of a date, a date range, a date frequency, and a time range.

8. An information display method using an information apparatus and a head mounted display device that enables a user to view a virtual image, comprising:

(a) making the head mounted display device transmit user information, which is information regarding the user of the head mounted display device, to the information apparatus;

(b) making the information apparatus extract from a target information table;

target information, which is to be published by the information apparatus, when the received user information satisfies extraction permission conditions, which are conditions when extracting the target information, so as to match the target information, and

order information for determining a display order of the target information so as to match the target information, the order information specifying, for each piece of target information included in the target information table, a respective agreement number that represents a number of users that have agreed with the piece of target information;

(c) making the information apparatus transmit the extracted target information and the extracted order information to the head mounted display device;

(d) making the head mounted display device acquire the target information from the information apparatus;

(e) generating information for additional presentation for providing augmented reality to the user using the acquired target information; and

(f) making the generated information for additional presentation be viewed as the virtual image by the user,

wherein, when a plurality of pieces of the target information satisfying the extraction permission conditions are received, the information for additional presentation is generated by placing each of the plurality of pieces of target information respectively in a separate layer of a plurality of superimposed layers according to the order information.

9. A head mounted display device that enables a user to view a virtual image, comprising:

at least one of a processor that executes one or more programs and an application specific integrated circuit (“

ASIC”

) to realize one or more functions of;

an information acquisition section that acquires;

target information that is information extracted from a target information table when user information, which is information regarding the user of the head mounted display device, satisfies extraction permission conditions, which are conditions when extracting the target information, so as to match the target information, and

order information for determining a display order of the target information so as to match the target information, the order information specifying, for each piece of target information included in the target information table, a respective agreement number that represents a number of users that have agreed with the piece of target information; and

an information generating section that generates information for additional presentation for providing augmented reality to the user using the acquired target information; and

an optical image display that enables the user to view the generated information for additional presentation as the virtual image,

wherein, when a plurality of pieces of the target information satisfying the extraction permission conditions are received, the information generating section generates the information for additional presentation by placing each of the plurality of pieces of target information respectively in a separate layer of a plurality of superimposed layers according to the order information.

10. A head mounted display device that enables a user to view a virtual image, comprising:

a target information table that stores;

target information to be published by the head mounted display device,

extraction permission conditions, which are conditions when extracting the target information, so as to match the target information, and

order information for determining a display order of the target information so as to match the target information, the order information specifying, for each piece of target information included in the target information table, a respective agreement number that represents a number of users that have agreed with the piece of target information;

at least one of a processor that executes one or more programs and an application specific integrated circuit (“

ASIC”

) to realize one or more functions of;

an extraction section that extracts;

the order information from the target information table, and

the target information from the target information table when user information that is information regarding the user satisfies the extraction permission conditions; and

an information generating section that generates information for additional presentation for providing augmented reality to the user using the extracted target information; and

an optical image display that enables the user to view the generated information for additional presentation as the virtual image,

wherein, when a plurality of pieces of the target information satisfying the extraction permission conditions are received, the information generating section generates the information for additional presentation by placing each of the plurality of pieces of target information respectively in a separate layer of a plurality of superimposed layers according to the order information.