Information presentation apparatus and information processing method thereof

• US 7,053,916 B2
• Filed: 07/25/2003
• Issued: 05/30/2006
• Est. Priority Date: 07/31/2002
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.), Marshalltown Company
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Kobayashi, Toshihiro, Fujiki, Masakazu
• Primary Examiner(s): Razavi, Michael
• Assistant Examiner(s): WOODS, ERIC V
• Application Number:
  US10/626,590
• Publication Number:
  US 20040145594A1
• Time in Patent Office: 1,040 Days
• Field of Search: 345629-639
• US Class Current: 345/633
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An information presentation apparatus comprises an input unit, a measurement unit to measure a user'"'"'s viewpoint position and pose, a model data storage unit to store virtual world model data, real world model data, and data necessary to generate a virtual world image, an annotation data storage unit to store data added to real and virtual worlds and displayed, a generation unit to generate an image of the virtual world by using information in the measurement unit, the model data storage unit and the annotation data storage unit, a user viewpoint image input unit to capture a real-world image viewed from the user'"'"'s viewpoint, and an image display unit to display an image obtained by synthesizing the image from the generation unit and the image from the user viewpoint image input unit or the image from the user viewpoint image input unit, on a user'"'"'s image display.

Claims

1. An information presentation apparatus comprising:

user operation input unit, adapted to input an operation of a user;

user viewpoint position and orientation measurement unit, adapted to measure a position and orientation of a user'"'"'s viewpoint;

model data storage unit, adapted to store virtual world model data, real world model data, and data necessary to generate a virtual world image;

annotation data storage unit, adapted to store data necessary to be added to a real world and a virtual world and then displayed;

virtual image generation unit, adapted to generate an image of the virtual world by using information in said user viewpoint position and orientation measurement unit, said model data storage unit and said annotation data storage unit;

user viewpoint image input unit, adapted to capture an image of the real world viewed from the user'"'"'s viewpoint; and

image display unit, adapted to display an image obtained by synthesizing the image generated by said virtual image generation unit and the image obtained by said user viewpoint image input unit, on an image display device of the user,

wherein said virtual image generation unit draws the information stored in said model data storage unit from the user'"'"'s viewpoint in computer graphics to generate the image of the virtual world viewed from the user'"'"'s viewpoint, by using the position and orientation information at the user'"'"'s viewpoint obtained from said user viewpoint position and orientation measurement unit, and wherein said virtual image generation unit has a function to generate an annotation indicating information of a target that the user pays attention to, such that its attributes of a color, a shape and a character type are different from those of other annotation.

2. An information processing method comprising the steps of:

inputting viewpoint information of a user;

generating a virtual world image according to the viewpoint information, by using previously held virtual world data;

generating an annotation concerning an attention target; and

generating an image obtained by synthesizing an image of a real world, the generated virtual world image, and the generated annotation,

wherein another annotation indicating whether or not the attention target is being observed by another user is generated and merged to the synthesized image, and wherein said virtual image generation unit has a function to generate an annotation indicating information of a target that the user pays attention to, such that its attributes are different from those of other annotation.