Image reproducing method and apparatus for displaying annotations on a real image in virtual space

• US 20050116964A1
• Filed: 11/16/2004
• Published: 06/02/2005
• Est. Priority Date: 11/19/2003
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Suzuki, Masahiro, Katayama, Akihiro, Sakagawa, Yukio, Kotake, Daisuke, Endo, Takaaki
• Granted Patent: US 7,626,596 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2219/004 Annotating, labelling

Abstract

In an image reproducing method capable of displaying annotations in virtual space constituted by a group of real panoramic images. If an object for which an annotation is to be displayed falls within the field of view at the position of the observer, the object is adopted as the display position of the annotation. If the object is not within the field of view, then the direction of forward travel of the observer is adopted as the annotation display position. If the object is in a state of transition, then the annotation display position is decided by interpolation.

Claims

1. An image reproducing method capable of displaying an annotation relating to an object in virtual space, said method comprising:

an acquisition step of acquiring annotation information that is for displaying an annotation, and definition information for defining a first zone, in which a first mode for causing the annotation to be displayed at a position that does not correspond to the location of the object is to be executed, and a second zone, in which a second mode for causing the annotation to be displayed at a position that corresponds to the location of the object is to be executed;

a determination step of determining whether a viewpoint position of an observer lies in the first zone or in the second zone in accordance with the viewpoint position; and

a display control step of causing the annotation to be displayed in the first mode if the viewpoint position has been determined to lie in the first zone by said determination step, and in the second mode if the viewpoint position has been determined to lie in the second zone by said determination step.

2. The method according to claim 1, wherein the definition information defines a third zone set between the first and second zones, said third zone being a zone in which a third mode is executed, said third mode causing a display position of the annotation to be moved, in accordance with the movement of the viewpoint, from a display position of the annotation based upon the first mode to a display position of the annotation based upon the second mode, said determination step further determining whether the viewpoint position lies in the third zone, and

said display control step causing the annotation to be displayed upon deciding the display position of the annotation according to the third mode if the viewpoint position lies in the third zone.

3. The method according to claim 1, wherein said display control step causes a change in the form of the annotation display between the first and second modes.

4. The method according to claim 1, wherein said display control step causes a change in the form of the annotation display based upon distance between the viewpoint position and the object in the first mode.

5. The method according to claim 1, wherein said display control step causes display of route guidance for reaching the object during display of the annotation in the first mode.

6. The method according to claim 1, wherein if a plurality of annotations to be displayed in the first mode exist, said display control step causes display of the annotations from the front in order starting from an annotation of the object that is closest to the viewpoint position in virtual space, and causes display of the annotations while changing over the displayed annotations successively in response to operation by a user.

13. A storage medium storing a control program for causing the image reproducing method set forth in claim 1 to be executed by a computer.

15. A control program for causing the image reproducing method set forth in claim 1 to be executed by a computer.

7. An image reproducing apparatus capable of displaying an annotation relating to an object in virtual space, said apparatus comprising:

a storage unit configured to store annotation information that is for displaying an annotation, and definition information for defining a first zone, in which a first mode for causing the annotation to be displayed at a position that does not correspond to the location of the object is to be executed, and a second zone, in which a second mode for causing the annotation to be displayed at a position that corresponds to the location of the object is to be executed;

a determination unit configured to determine whether a viewpoint position of an observer lies in the first zone or in the second zone in accordance with the viewpoint position; and

a display control unit configured to cause the annotation to be displayed in the first mode if the viewpoint position has been determined to lie in the first zone by said determination unit, and in the second mode if the viewpoint position has been determined to lie in the second zone by said determination unit.

8. An image reproducing method capable of displaying an annotation in virtual space, said method comprising an annotation display position deciding step of adopting a position that corresponds to the location of an object, for which an annotation is to displayed, as the annotation display position in a first state in which the object falls within a field of view at the position of an observer, adopting a prescribed position in the forward direction of the observer as the annotation display position in a second state in which the object does not fall within the field of view, and deciding the annotation display position by interpolation in a third state which is between the first state and the second state.

9. The method according to claim 8, wherein if a plurality of annotations displayed in the forward direction of the observer exist, annotation of an object that is closest to the position of the observer in virtual space is displayed up front, and displayed annotations are capable of being changed over in response to operation by a user.

10. The method according to claim 8, wherein said annotation display position deciding step decides the form of the annotation display in accordance with distance between the observer and an object for which the annotation is displayed in virtual space.

11. The method according to claim 10, wherein the form of the annotation display changes in terms of at least one among shape, transparency and size of the annotation in accordance with distance between the observer and the object for which the annotation is displayed.

12. The method according to claim 10, wherein the form of the annotation display is provided with guidance information extending from a present position in virtual space to location of the object.

14. A storage medium storing a control program for causing the image reproducing method set forth in claim 8 to be executed by a computer.

16. A control program for causing the image reproducing method set forth in claim 8 to be executed by a computer.