Information distribution system, head mounted display, method for controlling head mounted display, and computer program

• US 10,073,262 B2
• Filed: 05/27/2015
• Issued: 09/11/2018
• Est. Priority Date: 06/16/2014
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Nakai, Satoshi, Mori, Yuichi
• Primary Examiner(s): Yang, Andrew G
• Application Number:
  US14/723,145
• Publication Number:
  US 20150363974A1
• Time in Patent Office: 1,203 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 2210/61 Scene description
• CPC Class Codes: G06T 2219/016 Exploded view
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/38 Outdoor scenes
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 2213/008 Aspects relating to glasses for viewing stereoscopic images

Abstract

An information distribution system includes an image display apparatus including a position identification section that identifies the position of the image display apparatus, a first communication section, and a control section; and an information processing apparatus including a storage section that stores content information, a second communication section, and a selection section. The selection section selects at least two contents from a plurality of contents stored in the storage section based on the received position of the image display apparatus. The second communication section distributes content information on the selected at least two contents to the first communication section. The control section sets one content in the received content information as a first content and causes the image display section to display the set first content and the contents other than the first content in the distributed content information in different display forms.

Claims

1. An information distribution system comprising:

an image display apparatus including;

a camera configured to capture an image of an outside scene;

an image display section that displays an image on an image display area based on a content;

a position identification section that identifies the position of the image display apparatus;

a first communication section; and

a control section; and

an information processing apparatus including;

a storage section that stores content information on a content related to a position;

a second communication section; and

a selection section,

wherein the first communication section transmits information on the identified position of the image display apparatus to the second communication section,

the second communication section receives the transmitted information on the position of the image display apparatus,

the selection section selects at least two contents from a plurality of contents stored in the storage section based on the received position of the image display apparatus,

the second communication section distributes content information on the selected at least two contents to the first communication section,

the first communication section receives the distributed content information, and

the control section sets one content in the received content information as a first content and causes the image display section to display the set first content and the contents other than the first content in the distributed content information in different display forms,

the control section sets priorities of the plurality of contents based on a current position of the image display apparatus and a field of view of a user of the image display apparatus, such that;

(i) a first priority is set for first content in a first region where the image display apparatus is present, the first content being in the field of view of the user;

(ii) a second priority is set for second content in a second region where the image display apparatus is not present, the second content being in the field of view of the user;

(iii) a third priority is set for third content in the second region, the third content being outside the field of view of the user; and

(iv) a fourth priority is set for fourth content in the first region, the fourth content being outside the field of view of the user, the priorities being ordered from highest to lowest in order from the first priority to the fourth priority,

after the priorities of the contents are set, the camera captures the image of the outside scene, and the captured image is compared to the contents stored in the storage section,

when a highest priority content is detected in the captured image, the control section causes the image display section to display the highest priority content differently from the contents other than the highest priority content by displaying the highest priority content as an augmented reality image and displaying the contents other than the highest priority content as a list,

when the highest priority content is not detected in the captured image, the control section causes the image display section to display the highest priority content as a list, and

functions performed by the image display section, the position identification section, the first communication display section, the control section, the storage section, the second communication section and the selection section are achieved under control of a central processing unit (CPU).

2. The information distribution system according to claim 1,

wherein the image display section displays a virtual image as the image displayed based on a content and transmits the outside scene.

3. The information distribution system according to claim 2,

wherein the image display apparatus further includes an orientation identification section that identifies the orientation of the image display section,

the control section sets, based on the identified position of the image display apparatus, the distributed content information, and the identified orientation of the image display section, a display form of a first virtual image that is a virtual image displayed based on the first content and a display form of a second virtual image that is a virtual image displayed based on the contents other than the first content, and

functions performed by the orientation identification section are achieved under control of the CPU.

4. The information distribution system according to claim 3,

wherein the control section stores a change in the identified orientation of the image display section and sets at least one of the display form of the first virtual image and the display form of the second virtual image based on the identified position of the image display apparatus, the distributed content information, and the stored change in the orientation of the image display section.

5. The information distribution system according to claim 3,

wherein the image display apparatus further includes a distance measurement section that measures the distance between a position related to a content in the distributed content information and the position of the image display apparatus,

the control section sets at least one of the display form of the first virtual image and the display form of the second virtual image based on a measured distance to at least one content, the identified position of the image display apparatus, and the distributed content information, and

functions performed by the distance measurement section are achieved under control of the CPU.

6. The information distribution system according to claim 3,

wherein the image display apparatus further includes an operation section that accepts operation,

the control section produces content specifying information that specifies a content in the distributed content information based on the accepted operation,

the first communication section transmits the produced content specifying information to the second communication section,

the second communication section receives the transmitted content specifying information,

the selection section selects at least two contents from the content information stored in the storage section based on the received content specifying information and the identified position of the image display apparatus, and

functions performed by the operation section are achieved under control of the CPU.

7. The information distribution system according to claim 3,

wherein at least one of the display form of the first virtual image and the display form of the second virtual image is the position where a virtual image is displayed on the image display section.

8. The information distribution system according to claim 1,

wherein the control section sets, based on the identified position of the image display apparatus, the distributed content information, and a captured outside scene, at least one of a display form of a first virtual image that is a virtual image displayed based on the first content and a display form of a second virtual image that is a virtual image displayed based on the contents other than the first content.

9. The information distribution system according to claim 1,

wherein the control section detects an image related to the first content in the captured outside scene and, as the display form of the first virtual image, sets the position where the first virtual image is displayed on the image display section to be a position related to the detected image.

10. The information distribution system according to claim 1,

wherein the image display section displays a virtual image as the image displayed based on a content and transmits the outside scene,

the image display apparatus further includes an orientation identification section that identifies the orientation of the image display section,

the first communication section transmits orientation information representing the identified orientation to the second communication section,

the second communication section receives the transmitted orientation information,

the selection section selects the at least two contents based on the identified position of the image display apparatus and the transmitted orientation information, and

functions performed by the orientation identification section are achieved under control of the CPU.

11. The information distribution system according to claim 1, wherein

the control section monitors detection of a selection operation, the selection operation including causing a selection image to move from one display position to another display position on the image display area, so that the selection image overlaps selected content in the image display area, and

when the selection operation is detected, the control section sets the image display area to a selected content display mode to display detailed information from the list on the selected content in the image display area.

12. A transmissive head mounted display comprising:

a camera configured to capture an image of an outside scene;

a storage section that stores contents;

a position identification section that identifies the position of the head mounted display;

a first receiver that receives distributed content information in relation to the identified position;

an image display section that displays virtual images on an image display area based on at least two contents in the received content information and transmits the outside scene; and

a control section that sets one content in the received content information as a first content and causes the image display section to display the set first content and the contents other than the first content in the distributed content information in different display forms,

wherein the control section sets priorities of the plurality of contents based on a current position of the head mounted display and a field of view of a user of the head mounted display, such that;

(i) a first priority is set for first content in a first region where the head mounted display is present, the first content being in the field of view of the user;

(ii) a second priority is set for second content in a second region where the head mounted display is not present, the second content being in the field of view of the user;

(iii) a third priority is set for third content in the second region, the third content being outside the field of view of the user; and

(iv) a fourth priority is set for fourth content in the first region, the fourth content being outside the field of view of the user, the priorities being ordered from highest to lowest in order from the first priority to the fourth priority,

after the priorities of the contents are set, the camera captures the image of the outside scene, and the captured image is compared to the contents stored in the storage section,

when a highest priority content is detected in the captured image, the control section causes the image display section to display the highest priority content differently from the contents other than the highest priority content by displaying the highest priority content as an augmented reality image and displaying the contents other than the highest priority content as a list,

when the highest priority content is not detected in the captured image, the control section causes the image display section to display the highest priority content as a list, and the control section monitors detection of a selection operation, the selection operation

functions performed by the position identification section, the image display section and the control section are achieved under control of a central processing unit (CPU).

13. A transmissive head mounted display comprising:

a camera configured to capture an image of an outside scene;

a position identification section that identifies the position of the head mounted display;

a storage section that stores contents;

a selection section that selects at least two contents based on the identified position;

an image display section that displays virtual images on an image display area based on the selected at least two contents and transmits the outside scene; and

a control section that sets one of the selected at least two contents as a first content and causes the image display section to display the set first content and the contents other than the first content in the stored content information in different display forms,

wherein the control section sets priorities of the plurality of contents based on a current position of the head mounted display and a field of view of a user of the head mounted display, such that;

(i) a first priority is set for first content in a first region where the head mounted display is present, the first content being in the field of view of the user;

(ii) a second priority is set for second content in a second region where the head mounted display is not present, the second content being in the field of view of the user;

(iii) a third priority is set for third content in the second region, the third content being outside the field of view of the user; and

(iv) a fourth priority is set for fourth content in the first region, the fourth content being outside the field of view of the user, the priorities being ordered from highest to lowest in order from the first priority to the fourth priority,

after the priorities of the contents are set, the camera captures the image of the outside scene, and the captured image is compared to the contents stored in the storage section,

when a highest priority content is detected in the captured image, the control section causes the image display section to display the highest priority content differently from the contents other than the highest priority content by displaying the highest priority content as an augmented reality image and displaying the contents other than the highest priority content as a list,

when the highest priority content is not detected in the captured image, the control section causes the image display section to display the highest priority content as a list, and

functions performed by the position identification section, the storage section, the selection section, the image display section and the control section are achieved under control of a central processing unit (CPU).

14. A method for controlling a transmissive head mounted display, the head mounted display including a first receiver that receives distributed content information, and an image display that displays virtual images on an image display area based on at least two contents in the distributed content information and transmits the outside scene, the method comprising:

capturing an image of an outside scene;

storing contents in a storage;

identifying the position of the head mounted display;

receiving content information related to the identified position;

setting one content in the received content information as a first content and causing the image display to display the set first content and the contents other than the first content in the received content information in different display forms;

setting priorities of the plurality of contents based on a current position of the head mounted display and a field of view of a user of the head mounted display, such that;

(i) a first priority is set for first content in a first region where the head mounted display is present, the first content being in the field of view of the user;

(ii) a second priority is set for second content in a second region where the head mounted display is not present, the second content being in the field of view of the user;

(iii) a third priority is set for third content in the second region, the third content being outside the field of view of the user; and

(iv) a fourth priority is set for fourth content in the first region, the fourth content being outside the field of view of the user, the priorities being ordered from highest to lowest in order from the first priority to the fourth priority,

after the priorities of the contents are set, capturing the image of the outside scene, and comparing the captured image to the contents stored in the storage;

when a highest priority content is detected in the captured image, displaying the highest priority content differently from the contents other than the highest priority content by displaying the highest priority content as an augmented reality image and displaying the contents other than the highest priority content as a list; and

when the highest priority content is not detected in the captured image, displaying the highest priority content as a list.

15. A computer program product for a transmissive head mounted display, the head mounted display including a camera configured to capture an image of an outside scene and an image display that displays an image on an image display area based on a content, the computer program product comprising a non-transitory computer-readable medium having a computer program embodied therein, the computer program being adapted to be executed on a processor to implement a method, the method comprising:

identifying the position of the head mounted display;

storing contents in a storage;

selecting at least two contents based on the identified position;

displaying virtual images based on the selected at least two contents and transmitting the outside scene;

setting one of the selected at least two contents as a first content and causing the image display to display the set first content and the contents other than the first content in the stored content information in different display forms;

setting priorities of the plurality of contents based on a current position of the head mounted display and a field of view of a user of the head mounted display, such that;

(i) a first priority is set for first content in a first region where the head mounted display is present, the first content being in the field of view of the user;

(ii) a second priority is set for second content in a second region where the head mounted display is not present, the second content being in the field of view of the user;

(iii) a third priority is set for third content in the second region, the third content being outside the field of view of the user; and

(iv) a fourth priority is set for fourth content in the first region, the fourth content being outside the field of view of the user, the priorities being ordered from highest to lowest in order from the first priority to the fourth priority,

after the priorities of the contents are set, capturing the image of the outside scene, and comparing the captured image to the contents stored in the storage;

when a highest priority content is detected in the captured image, displaying the highest priority content differently from the contents other than the highest priority content by displaying the highest priority content as an augmented reality image and displaying the contents other than the highest priority content as a list; and

when the highest priority content is not detected in the captured image, displaying the highest priority content as a list.