Handheld information processing apparatus and handheld game apparatus

• US 8,894,486 B2
• Filed: 01/13/2011
• Issued: 11/25/2014
• Est. Priority Date: 01/14/2010
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Konno, Hideki, Umezu, Ryuji, Sugino, Kenichi
• Primary Examiner(s): D'AGOSTINO, PAUL ANTHONY
• Application Number:
  US13/006,055
• Publication Number:
  US 20120108328A1
• Time in Patent Office: 1,412 Days
• Field of Search: 463/30, 463/31, 463/32, 345/173
• US Class Current: 463/31
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/203 Image generating hardware
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A game apparatus includes a stereoscopic image display device configured to display a stereoscopic image, which is stereoscopically visible by the naked eye, and a planar image display device configured to display a planar image. A touch panel is provided on a screen of the planar image display device. An image of a silhouette of an object in a virtual space is displayed on the planar image display device. The game apparatus causes the object in the virtual space to move according to a touch operation performed on the image of the silhouette displayed on the screen of the planar image display device, and stereoscopically displays the object on the stereoscopic image display device.

Claims

1. A handheld information processing apparatus comprising:

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen that is planar;

a planar image display section for displaying a planar image with which a user performs an input operation on the handheld information processing apparatus;

a touch panel provided on a screen of the planar image display section; and

a controller for executing a predetermined process, based on a touch position detected by the touch panel.

2. The handheld information processing apparatus according to claim 1, wherein the controller is configured to change the stereoscopic image displayed on the stereoscopic image display section, based on the touch position detected by the touch panel.

3. The handheld information processing apparatus according to claim 2, wherein

the planar image display section displays a planar image for operating a virtual object in a virtual space,

the controller changes the virtual object, based on the touch position detected by the touch panel, and

the stereoscopic image display section displays the stereoscopic image by using the right-eye image and the left-eye image which are obtained by taking images, by using a virtual stereo camera, of the virtual object changed by the controller.

4. The handheld information processing apparatus according to claim 1, wherein the touch panel is not provided on a screen of the stereoscopic image display section.

5. The handheld information processing apparatus according to claim 1, wherein

the handheld information processing apparatus further includes a switch for switching ON/OFF of stereoscopic presentation of the stereoscopic image display section, and

the stereoscopic image display section displays the stereoscopic image only when the stereoscopic presentation is switched ON by the switch.

7. The handheld information processing apparatus according to claim 1, wherein

the handheld information processing apparatus further includes a mode selector configured to enable the selection of either of

a first mode in which a real right-eye image and a real left-eye image taken of an actual space are used;

and

a second mode in which the right-eye image and the left-eye image taken, of the virtual space, by the virtual stereo camera are used,

in a case where the first mode is selected by the mode selector, the stereoscopic image display section displays the stereoscopic image by using the real right-eye image and the real left-eye image taken of the actual space, and

in a case where the second mode is selected by the mode selector, the stereoscopic image display section displays the stereoscopic image by using the right-eye image and the left-eye image taken, of the virtual space, by the virtual stereo camera.

8. The handheld information processing apparatus according to claim 7, wherein

the handheld information processing apparatus further includes a stereo camera for taking images of the actual space,

the stereoscopic image display section displays the stereoscopic image by using the real right-eye image and the real left-eye image taken by the stereo camera.

10. The handheld information processing apparatus according to claim 1, wherein

the handheld information processing apparatus is configured of a first housing and a second housing joined together so as to be foldable,

the stereoscopic image display section is provided in the first housing, and

the planar image display section is provided in the second housing.

11. The handheld information processing apparatus according to claim 10, wherein the first housing is arranged above the second housing in a state where the handheld information processing apparatus is open.

13. The handheld information processing apparatus according to claim 1, wherein the right-eye image and the left-eye image are displayed with respect to each other on the stereoscopic image display section in a manner to effect superimposition, as perceived by the user, of the right-eye image and the left-eye image.

14. The handheld information processing apparatus according to claim 1, wherein the stereoscopic image display section is provided in the first housing on a planar surface thereof.

15. The handheld information processing apparatus according to claim 14, further comprising an adjustment mechanism configured to receive user input and, in response thereto, to adjust respective positions of the left- and right-eye images in order to adjust a stereoscopic effect of the stereoscopic image being displayed.

16. The handheld information processing apparatus according to claim 14, wherein the stereoscopic image is displayed such that areas where the left- and right-eye images do not overlap, as perceived by the user, are not displayed via the stereoscopic image display section.

17. The handheld information processing apparatus according to claim 16, wherein the planar image display section displays a planar image that includes portions of the left- and right-eye images that do not overlap, as perceived by the user, via the stereoscopic image display section.

18. The handheld information processing apparatus according to claim 1, wherein the stereoscopic image display section and the planar image display section both display the same left- and right-eye images, but in different ways.

22. The handheld information processing apparatus according to claim 1, wherein the stereoscopic image display section is planar and the entirety of the stereoscopic image display section is provided in the first housing on one planar surface thereof.

6. A handheld information processing apparatus comprising:

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image;

a planar image display section for displaying a planar image with which a user performs an input operation on the handheld information processing apparatus;

a touch panel provided on a screen of the planar image display section; and

a controller for executing a predetermined process, based on a touch position detected by the touch panel, wherein;

the handheld information processing apparatus further includes a switch for switching ON/OFF of stereoscopic presentation of the stereoscopic image display section,

the stereoscopic image display section displays the stereoscopic image only when the stereoscopic presentation is switched ON by the switch,

the switch is a slider the position of which is adjustable,

the handheld information processing apparatus further includes a virtual camera setter for setting, according to the position of the slider, a distance between two virtual cameras, which are components of the virtual stereo camera and which are set in the virtual space, and

the stereoscopic image display section displays the stereoscopic image by using the right-eye image and the left-eye image taken, of the virtual space, by using the virtual stereo camera set by the virtual camera setter.

9. A handheld information processing apparatus comprising:

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image;

a planar image display section for displaying a planar image with which a user performs an input operation on the handheld information processing apparatus;

a touch panel provided on a screen of the planar image display section; and

a controller for executing a predetermined process, based on a touch position detected by the touch panel, wherein;

the handheld information processing apparatus further includes a mode selector configured to enable the selection of either of

a first mode in which a real right-eye image and a real left-eye image taken of an actual space are used; and

a second mode in which the right-eye image and the left-eye image taken, of the virtual space, by the virtual stereo camera are used,

in a case where the first mode is selected by the mode selector, the stereoscopic image display section displays the stereoscopic image by using the real right-eye image and the real left-eye image taken of the actual space,

in a case where the second mode is selected by the mode selector, the stereoscopic image display section displays the stereoscopic image by using the right-eye image and the left-eye image taken, of the virtual space, by the virtual stereo camera,

the planar image display section displays an adjustment bar for adjusting relative positions of the real right-eye image and the real left-eye image,

the controller sets a position of a slider of the adjustment bar, based on the touch position detected by the touch panel, and adjusts the relative positions of the real right-eye image and the real left-eye image, according to the position of the slider, and

the stereoscopic image display section displays the stereoscopic image by using the real right-eye image and the real left-eye image which are adjusted by the controller.

12. A handheld game apparatus comprising:

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen that is planar;

a planar image display section for displaying a planar image with which the user performs an input operation on the handheld game apparatus;

a touch panel provided on a screen of the planar image display section; and

a controller for executing a predetermined process, based on a touch position detected by the touch panel.

19. An information processing system comprising:

at least one processor and a memory;

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen that is planar;

a planar image display section for displaying a planar image with which a user performs an input operation on the handheld information processing system;

a touch panel provided on a screen of the planar image display section; and

a controller, configured to cooperate with the at least one processor, to execute a predetermined process, based on a touch position detected by the touch panel.

20. A method of operating a handheld information processing apparatus comprising stereoscopic and planar image display sections and a touch panel provided on a screen of the planar image display section;

displaying, in connection with the stereoscopic image display section, a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen that is planar;

displaying, in connection with the planar image display section, a planar image with which a user performs an input operation on the handheld information processing apparatus; and

executing a predetermined process, in connection with at least one processor and a memory of the handheld information processing apparatus, based on a touch position detected by the touch panel.

21. A non-transitory computer readable storage medium tangibly storing a program comprising instructions that, when executed by at least one processor of a handheld information processing apparatus comprising stereoscopic and planar image display sections and a touch panel provided on a screen of the planar image display section, at least:

display, in connection with the stereoscopic image display section, a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen that is planar;

display, in connection with the planar image display section, a planar image with which a user performs an input operation on the handheld information processing apparatus; and

execute a predetermined process, in connection with the at least one processor, based on a touch position detected by the touch panel.

23. A handheld information processing apparatus comprising:

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen;

a planar image display section for displaying a planar image with which a user performs an input operation on the handheld information processing apparatus;

a touch panel provided on a screen of the planar image display section; and

a controller for executing a predetermined process, based on a touch position detected by the touch panel,

wherein the stereoscopic image display section is placed on an upper side, and the planar image display section is placed on a lower side.

24. The handheld information processing apparatus according to claim 23, wherein the information processing apparatus is a game apparatus.

25. A handheld information processing apparatus comprising:

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen;

a planar image display section for displaying a planar image with which a user performs an input operation on the handheld information processing apparatus;

a touch panel provided on a screen of the planar image display section; and

a controller for executing a predetermined process, based on a touch position detected by the touch panel, wherein;

the controller is configured to change the stereoscopic image displayed on the stereoscopic image display section, based on the touch position detected by the touch panel,

the planar image display section is configured to display a planar image for operating a virtual object in a virtual space,

the controller is configured to change the virtual object, based on the touch position detected by the touch panel,

the stereoscopic image display section is configured to display the stereoscopic image by using the right-eye image and the left-eye image which are obtained by taking images, by using a virtual stereo camera, of the virtual object changed by the controller, and

the planar image display section also is configured to display an image obtained by taking an image of the virtual space by using a virtual camera.

26. The handheld information processing apparatus according to claim 25, wherein the information processing apparatus is a game apparatus.

27. A handheld information processing apparatus comprising:

a stereoscopic image display section for displaying a stereoscopic image, which is stereoscopically visible by the naked eye, by using a right-eye image and a left-eye image such that the right-eye image and the left-eye image are displayed on one screen;

a planar image display section for displaying a planar image with which a user performs an input operation on the handheld information processing apparatus;

a touch panel provided on a screen of the planar image display section;

a controller for executing a predetermined process, based on a touch position detected by the touch panel; and

a mode selector configured to enable the selection of one of

a first mode in which a real right-eye image and a real left-eye image taken of an actual space are used; and

a second mode in which the right-eye image and the left-eye image taken, of the virtual space, by the virtual stereo camera are used, wherein;

in a case where the first mode is selected by the mode selector, the stereoscopic image display section is configured to display the stereoscopic image by using the real right-eye image and the real left-eye image taken of the actual space, and

in a case where the second mode is selected by the mode selector, the stereoscopic image display section is configured to display the stereoscopic image by using the right-eye image and the left-eye image taken, of the virtual space, by the virtual stereo camera.

28. The handheld information processing apparatus according to claim 27, wherein the information processing apparatus is a game apparatus.