Computer readable recording medium recording image processing program and image processing apparatus

• US 8,223,120 B2
• Filed: 01/13/2009
• Issued: 07/17/2012
• Est. Priority Date: 09/05/2008
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Ohta, Keizo
• Primary Examiner(s): SIMPSON, LIXI CHOW
• Application Number:
  US12/352,716
• Publication Number:
  US 20100060575A1
• Time in Patent Office: 1,281 Days
• Field of Search: None
• US Class Current: 345/156
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6661 for changing the position of the virtual camera
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/02 Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038

Abstract

Displayed region size data indicating a size of a screen of a display device, or a size of a region in which an image of a virtual space is displayed on the screen, is obtained. Distance data indicating a distance between a user and the display device is obtained. A position and an angle of view of the virtual camera in the virtual space are set based on the displayed region size data and the distance data.

Claims

1. A non-transitory computer readable storage medium storing an image processing program executable by a processing system of an image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, the program comprising instructions that are configured to:

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device; and

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data.

2. The medium of claim 1, wherein

the displayed region size data includes data indicating a width in a first direction and a width in a second direction perpendicular to the first direction, of the screen of the display device or the region in which the image of the virtual space is displayed on the screen, and

the instructions are further configured to set a horizontal angle of view and a vertical angle of view of the virtual camera, based on the width in the first direction or the width in the second direction.

3. The medium of claim 2, wherein

the horizontal angle of view and/or the vertical angle of view of the virtual camera is set to increase as the width in the first direction and/or width in the second direction increase.

4. The medium of claim 2, wherein

the horizontal angle of view and/or the vertical angle of view is set to be smaller as the distance indicated by the distance data increases.

5. The medium of claim 1, wherein

the angle of view of the virtual camera is set to be larger as the screen of the display device or the region in which the image of the virtual space is displayed on the screen increases.

6. The medium of claim 1, wherein

the angle of view is set to be smaller as the distance indicated by the distance data increases.

7. The medium of claim 1, wherein the instructions are further configured to:

obtain captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculate a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data.

8. The medium of claim 1, wherein the instructions are further configured to:

determine the position and the angle of view of the virtual camera with reference to a position of the object when an object exists in a space to be displayed on the screen of the display device or the region in which the image of the virtual space is displayed on the screen.

9. The medium of claim 1, wherein the instructions are further configured to:

when a plurality of objects exist in a space to be displayed on the screen of the display device or the region in which the image of the virtual space is displayed on the screen, in the virtual space, determine the position and the angle of view of the virtual camera with reference to a position of an object closest to the virtual camera.

10. The medium of claim 1, wherein:

the angle of view is set to be narrower as the distance indicated by the distance data increases, and

the angle of view is set to be larger as the distance indicated by the distance data decreases.

11. A non-transitory computer readable storage medium storing an image processing program executable by a processing system of an image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, the program comprising instructions that are configured to:

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen, the displayed region size data includes data indicating a width in a first direction and a width in a second direction perpendicular to the first direction, of the screen of the display device or the region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data; and

set a horizontal angle of view and a vertical angle of view of the virtual camera based on the width in the first direction and the width in the second direction.

12. The medium of claim 11, wherein

the horizontal angle of view and/or the vertical angle of view of the virtual camera is set to increase as the width in the first direction and/or the width in the second direction increase.

13. The medium of claim 11, wherein

the horizontal angle of view and/or the vertical angle of view is set to be smaller as the distance indicated by the distance data increases.

14. A non-transitory computer readable storage medium storing an image processing program executable by a processing system of an image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, the program comprising instructions that are configured to:

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtain captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculate a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data,

wherein the distance between the input device and the imaging subject is calculated based on a size of the imaging subject shown in the captured image.

15. The medium of claim 14, wherein

the calculated distance between the input device and the imaging subject decreases as the size of the imaging subject shown in the captured image increases.

16. A non-transitory computer readable storage medium storing an image processing program executable by a processing system of an image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, the program comprising instructions that are configured to:

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtain captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculate a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data, wherein the distance between the input device and the imaging subject is calculated based on a distance between a plurality of imaging subjects shown in the captured image.

17. The medium of claim 16, wherein

the calculated distance between the input device and the imaging subject decreases as a distance between a plurality of imaging subjects increases.

18. An image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, comprising:

a processing system that includes at least one processor, the processing system configured to;

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device; and

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data.

19. An image processing system that is configured to output an image of a virtual space to a display device, the system comprising:

at least one processor that is configured to;

obtain size data that relates to a size of the display device or a size of a region in which the image of the virtual space is displayed on a screen of the display device;

obtain distance data that relates to a distance between a user and the display device;

set a position of a virtual camera in the virtual space based on the size data and the distance data; and

set an angle of view of the virtual camera in the virtual space based on the size data and the distance data.

20. A computer implemented method for outputting an image of a virtual space to a display device, the method comprising:

obtaining, via a processing system that includes at least one processor, size data that relates to a size of the display device or a size of a region in which the image of the virtual space is displayed on a screen of the display device;

obtaining distance data that relates to a distance between a user and the display device;

setting a position of a virtual camera, via the processing system, in the virtual space based on the size data and the distance data; and

setting an angle of view of the virtual camera in the virtual space based on the size data and the distance data.

21. An image processing system that is configured to output a view of a virtual space provided from a virtual camera to a display device, the system comprising at least one processor that is configured to:

obtain size data that relates to a size of the display device, or a size of a region of the display device in which the view of the virtual space is output, the size data including a first width in a first direction and a second width in a second direction that is substantially perpendicular to the first direction, wherein the first and second widths are associated with the display device or the region of the display device;

obtain distance data that relates to a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the obtained size data and distance data; and

set a horizontal angle of view and a vertical angle of view of the virtual camera based on the first width and the second width.

22. A computer implemented method for outputting a view of a virtual space provided from a virtual camera to a display device, the method comprising:

obtaining size data that relates to a size of the display device, or a size of a region of the display device in which the view of the virtual space is output, the size data including a first width in a first direction and a second width in a second direction that is substantially perpendicular to the first direction, wherein the first and second widths are associated with the display device or the region of the display device;

obtaining distance data, via a processing system that includes at least one processor, that relates to a distance between a user and the display device;

setting a position and an angle of view of the virtual camera in the virtual space based on the obtained size data and distance data; and

setting a horizontal angle of view and a vertical angle of view, via the processing system, of the virtual camera based on the first width and the second width.

23. An image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, the apparatus comprising:

a processing system that includes at least one processor, the processing system configured to;

obtain size data that relates to a size of the display device, or a size of a region of the display device in which the view of the virtual space is output, the size data including a first width in a first direction and a second width in a second direction that is substantially perpendicular to the first direction, wherein the first and second widths are associated with the display device or the region of the display device;

obtain distance data that relates to a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the obtained size data and distance data; and

set a horizontal angle of view and a vertical angle of view of the virtual camera based on the first width and the second width.

24. An image processing system that is configured to output an image of a virtual space that is captured by a virtual camera to a display device, the system comprising at least one processor that is configured to:

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtain captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculate a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data,

wherein the distance between the input device and the imaging subject is calculated based on a size of the imaging subject shown in the captured image.

25. A computer implemented method for outputting an image of a virtual space to a display device, the image associated with a view of the virtual space provided from a virtual camera, the method comprising:

obtaining displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtaining distance data indicating a distance between a user and the display device;

setting a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtaining captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculating, via a processing system that includes at least one processor, a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data,

wherein the distance between the input device and the imaging subject is further calculated based on a size of the imaging subject shown in the captured image.

26. An image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, the apparatus comprising:

a processing system that includes at least one processor, the processing system configured to;

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtain captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculate a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data,

wherein the distance between the input device and the imaging subject is calculated based on a size of the imaging subject shown in the captured image.

27. An image processing system that is configured to output an image of a virtual space that is captured with a virtual camera to a display device, the system comprising at least one processor that is configured to:

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtain captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculate a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data, wherein the distance between the input device and the imaging subject is calculated based on a distance between a plurality of imaging subjects shown in the captured image.

28. A computer implemented method for outputting an image of a virtual space to a display device, the method comprising:

obtaining displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtaining distance data indicating a distance between a user and the display device;

setting a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtaining captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculating, via a processing system that includes at least one processor, a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data, wherein the distance between the input device and the imaging subject is calculated based on a distance between a plurality of imaging subjects shown in the captured image.

29. An image processing apparatus for outputting an image of a virtual space captured by a virtual camera to a display device, the apparatus comprising:

a processing system that includes at least one processor, the processing system configured to;

obtain displayed region size data indicating a size of a screen of the display device, or a size of a region in which the image of the virtual space is displayed on the screen;

obtain distance data indicating a distance between a user and the display device;

set a position and an angle of view of the virtual camera in the virtual space based on the displayed region size data and the distance data;

obtain captured image data output from an input device including an imager for capturing an image of at least one imaging subject which is placed in a vicinity of the display device; and

calculate a distance between the input device and the imaging subject as a distance between the user and the display device based on the imaging subject shown in the captured image indicated by the captured image data, wherein the distance between the input device and the imaging subject is calculated based on a distance between a plurality of imaging subjects shown in the captured image.