Image experiencing system and information processing method

• US 20030062675A1
• Filed: 09/26/2002
• Published: 04/03/2003
• Est. Priority Date: 09/28/2001
• Status: Abandoned Application

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Sato, Hiroaki, Noro, Hideo, Matsui, Taichi
• Application Number:
  US10/254,789
• Publication Number:
  US 20030062675A1
• Time in Patent Office: Days
• US Class Current: 273/237
• CPC Class Codes: A63F 2009/2433 Voice-actuated
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6661 for changing the position of the virtual camera
• CPC Class Codes: A63F 2300/6676 by dedicated player input
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: A63F 3/00643 Electric board games; Electric features of board games electric word or number games A63F3/0421; computer chess G06F; electric raffle games A63F3/081
• CPC Class Codes: A63F 3/00895 Accessories for board games A63F3/00697 takes precedence; game accessories of general use A63F11/00
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

The invention intends to increase the feeling of reality in a board game in addition to the interestingness of the game itself and to facilitate understanding of the proceeding situation of the game.

The invention provides an image experiencing system for a game which proceeds by placing items on a game board, comprising player position/attitude determining unit for determining the position/direction information of the view of the player, a generation unit for generating computer graphics based on the items on the game board, according to the position/attitude information of the view of the player, and a head-mounted display for displaying the generated computer graphics in superposition with the image of the real field.

Claims

1. An image experiencing system for a game which proceeds by placing an item on a game board, the system comprising:

player position and attitude determining means for determining the position and attitude information of a view point of a player;

generation means for generating computer graphics corresponding to the item on the game board, based on the position and attitude information of the view point of said player; and

a head mounted display for displaying said generated computer graphics in superposition with an image of the real world.

2. A system according to claim 1, wherein the position and attitude information of said player is information indicating a relative position of the view point of said player relative to said game board.

3. A system according to claim 1, further comprising:

measurement means for measuring attitude information of said player;

wherein said player position and attitude determining means determines the position and attitude information of the view point of said player from the attitude information and pre-calibrated position information of said player.

4. A system according to claim 1, further comprising:

a camera fixed to said head mounted display;

wherein said player position and attitude determining means analyzes the image of said camera and executes image recognition thereon, thereby obtaining the position and attitude information of the view point of said player.

5. A system according to claim 1, further comprising:

a position and attitude sensor for measuring the position and attitude of the player; and

a camera fixed to said head mounted display;

wherein said player position and attitude determining means includes a first position and attitude determining unit for determining the position and attitude information of the view point of the player from the output of said position and attitude sensor, and a second position and attitude determining unit for determining the position and attitude information of the view point of the player from an image taken by said camera, and the position and attitude information of the view point of said player is determined according to the reliability of the respective output values of said first and second position and attitude determining units.

6. A system according to claim 1, further comprising:

an attitude sensor for measuring the attitude of the player; and

a camera fixed to said head mounted display;

wherein said player position and attitude determining means includes a first position and attitude determining unit for determining the position and attitude information of the view point of the player from the output of said attitude sensor, and a second position and attitude determining unit for determining the position and attitude information of the view point of the player from an image taken by said camera, and the position and attitude information of the view point of said player is determined according to the reliability of the respective output values of said first and second position and attitude determining units.

7. A system according to claim 5 or 6, wherein a correction value is determined from the output value of said first or second position and attitude determining unit, and said correction value is used for correcting the output value of said first or second position and attitude determining unit.

8. A system according to claim 1, further comprising item operation recognition means for recognizing a change in the item on said game board.

9. A system according to claim 8, wherein said item operation recognition means recognizes a special mark identifier attached to the item.

10. A system according to claim 9, wherein a visible or invisible bar code is used as the special mark identifier.

11. A system according to claim 9, wherein a RFID transponder is used as the special mark identifier.

12. A system according to claim 8, wherein said item operation recognition means recognizes a shape of the item and/or a pattern on the item by image recognition.

13. A system according to claim 12, wherein an image taken by a camera fixed to said head mounted display is used.

14. A system according to claim 12, wherein said item operation recognition means recognizes a placement of an item in a specified position of a specified camera, thereby recognizing an item to be changed.

15. A system according to claim 14, wherein, in placing an item at said specified position of said specified camera, a guide facilitating the placement of the item is prepared by computer graphics and is displayed in the head mounted display of said player.

16. A system according to claim 1, wherein plural players play on a single game board, and the result of complex operations by the plural players is displayed in each head mounted display in the view point of each player.

17. An information processing method for a game which proceeds by placing an item on a game board, the method comprising steps of:

entering position and attitude information of a view point of a player;

generating computer graphics corresponding to the item on the game board, based on the position and attitude information of the view point of said player; and

displaying said generated computer graphics in superposition with an image of the real world in a head mounted display worn by the player.

18. A method according to claim 17, wherein the position and attitude information of said player is information indicating a relative position of the view point of said player relative to said game board.

19. A program for controlling an information processing apparatus thereby executing the information processing according to claim 17.

20. A recording medium storing the program according to claim 19.

21. An image experiencing system for a game which proceeds by placing an item on a game board bearing plural marks, the system comprising:

a position and attitude grasp unit for recognizing the kind of plural items placed on said game board and the position of said items;

game management means for managing the proceeding of the game, based on the kinds of said plural items and the positions thereof; and

generation means for generating computer graphics of a game scene corresponding to the kinds of the items of said plural items and the positions thereof.

22. A system according to claim 21, wherein:

said game is a battle type game;

said system further comprises determination means for determining the characteristics of a character of an own side based on the combination of the own side; and

said generation means generates said computer graphics based said determined characteristics of the character of the own side.

23. A system according to claim 21, wherein said game management means manages the proceeding of the game by a combination of the characteristics of the characters of the own side and the opponent side.

24. A system according to claim 21, wherein said game board has a three-dimensional structure, and said computer graphics are displayed in the head mounted display worn by the player, based on a model of the three-dimensional structure of said game board.

25. An information processing method for a game which proceeds by placing an item on a game board bearing plural marks, the method comprising steps of:

entering an image from an image pickup unit in a head mounted display worn by a player;

detecting a mark in said image thereby determining the position and attitude of a view point of said player on said game board;

identifying the item on said game board and generating computer graphics indicating a game scene based on the result of said identification; and

displaying said computer graphics, based on the position and attitude of said view point in said head mounted display.

26. A method according to claim 25, further comprising a step of:

entering position and attitude information of the player from a three-dimensional position and attitude measuring unit for measuring the position and attitude of said player;

wherein the position and attitude of said view point is obtained from said position and attitude information and from said detected mark.

27. A method according to claim 25, wherein the item on said game board is identified from an image from an image pickup unit for taking the image on said game board.

28. A method according to claim 25, further comprising a step of recognizing an instruction from the player for advancing the game.

29. A program for realizing an information processing method for a game which proceeds by placing an item on a game board bearing plural marks, the method comprising steps of:

entering an image from an image pickup unit in a head mounted display worn by a player;

detecting a mark in said image thereby determining the position and attitude of a view point of said player on said game board;

identifying the item on said game board and generating computer graphics indicating a game scene based on the result of said identification; and

displaying said computer graphics, based on the position and attitude of said view point in said head mounted display.