Method and apparatus for processing information of an object

• US 6,937,763 B2
• Filed: 11/09/2001
• Issued: 08/30/2005
• Est. Priority Date: 11/10/2000
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hirono, Ryo, Koike, Hiroyuki, Koyama, Nobukazu
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): DESIRE, GREGORY M
• Application Number:
  US10/037,568
• Publication Number:
  US 20020136432A1
• Time in Patent Office: 1,390 Days
• Field of Search: 348/169, 382/165, 382/154, 382/190, 382/203, 715/849, 715/852, 715/501.1, 715/513, 715/526, 345/419, 707/3, 707/10, 707/102, 707/104.1, 709/200, 709/217, 709/229
• US Class Current: 382/190
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06F 16/7854 using shape G06F16/7837 takes precedence
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

Disclosed are a method and apparatus for automatically embedding information of an object in a video picked up by a camera device. A camera device generates imaging position information relating to an imaging position of the video, and view point information relating to the direction and range of the video taken from the imaging position. An object contained in the video taken by the camera device is searched in an object location managing server, based on object position information relating to the position of the predetermined object, and the imaging position information and the view point information generated by the camera device. The object information of the object hit in the object location managing server is searched in the object information managing server. The display presents an image corresponding to the video picked up by the camera device and an image corresponding to the object information of the object contained in the video.

Claims

1. An apparatus for processing information of an object, comprising:

at least one image pickup means which picks up a video and generates imaging position information relating to a position from which the video is taken, and view point information relating to a direction and a range of the video taken from the position,

object searching means for searching for a predetermined object contained in the video picked up by the image pickup means, based on object position information relating to the position of the predetermined object, and the imaging position information and the view point information generated by the image pickup means,

object information searching means for searching for object information relating to the predetermined object searched for by the object searching means,

display means for displaying an image corresponding to the video picked up by the image pickup means and an image corresponding to the object information of the predetermined object; and

video position information generator means which generates video position information relating to the position of the predetermined object in the video, based on the object position information of the predetermined object searched for by the object searching means, and the imaging position information and the view point information generated by the image pickup means which has taken the video containing the predetermined object,

wherein the display means displays an image corresponding to the object information relating to the predetermined object when a position, in the displayed image, designated in response to a position designating signal being input falls within an area corresponding to the video position information of the predetermined object contained in the video.

2. An apparatus according to 1, wherein when an object designated in response to the position designating signal is the image pickup means, the display means displays an image corresponding to the video picked up by the image pickup means identified by the object information of the object.

3. An apparatus according to claim 2, wherein the display means comprises communication means which communicates with a communication device, identified by the object information, in accordance with the object information of the predetermined object.

4. A method for processing information of an object, comprising:

an image pickup step for picking up a video and generating imaging position information relating to a position from which the video is taken and view point information relating to a direction and a range of the video taken from the position,

an object searching step for searching for a predetermined object contained in the video picked up in the image pickup step, based on object position information relating to the position of the predetermined object, and the imaging position information and the view point information generated in the image pickup step,

an object information searching step for searching for object information relating to the predetermined object searched for in the object searching step,

a display step for displaying an image corresponding to the video picked up in the image pickup step and an image corresponding to the object information of the predetermined object; and

a video position information generating step which generates video position information relating to the position of the predetermined object in the video, based on the object position information of the predetermined object searched for by the object searching step, and the imaging position information and the view point information generated in the image pickup step which has taken the video containing the predetermined object,

wherein the display step displays an image corresponding to the object information relating to the predetermined object when a position is designated in the displayed image and when the designated position falls within an area corresponding to the video position information of the predetermined object contained in the video.

5. A method according to claim 4, wherein when a designated object is image pickup means, the display step displays an image corresponding to the video picked up by the image pickup means identified by the object information of the object.

6. A method according to claim 4, wherein the display step comprises a communication substep for communicating with a communication device, identified by the object information, in accordance with the object information of the predetermined object.