Information processing system and program
First Claim
1. A non-transitory computer readable storage medium having stored thereon a program executable by at least one computer of an information processing apparatus for receiving operation data from a handheld operation device including an imaging device for taking images of an imaging target and for displaying, in a display area on a display device, a menu object containing selectable items and enabling a user to interact with the displayed menu object in accordance with calculation processing performed using the operation data, the imaging device taking first and second images, the program causing the at least one computer to perform operations comprising:
- obtaining a first image taken by the imaging device of the operation device as the operation data;
conditionally selecting the displayed menu object as a user-selected operation target based on a position of the imaging target in a taken image;
calculating a first two-dimensional vector based on an orientation of the imaging target in the first taken image;
calculating a second two-dimensional vector based on an orientation of the imaging target in the second taken image;
calculating an angular difference between said first and second two-dimensional vectors, the angular difference indicative of roll rotation of the operation device about an imaging direction axis of the imaging device between the imaging device and the user-selected operation target;
calculating a scroll amount, s, based on the calculated angular difference so that the scroll amount has a magnitude that is proportional to the absolute value of the angular difference;
linearly scrolling the selectable items within the selected displayed menu object in a predetermined direction by an amount responsive to the calculated scroll amount, s; and
allowing the user to initiate an action by pointing the handheld device at and further selecting a scrolled selectable item displayed on the display area of the display device.
1 Assignment
0 Petitions
Accused Products
Abstract
A game system comprises image obtaining means, direction calculation means, moving means, and display control means. The image obtaining means obtains an image taken by an imaging device. The direction calculation means calculates a direction originally determined from the image of an imaging target included in the image taken by the imaging device. The moving means moves an operation target in a predetermined direction in accordance with the calculated direction. The display control means generates an image in accordance with the movement of the operation target performed by the moving means and displays the generated image on a screen of a display device.
12 Citations
32 Claims
-
1. A non-transitory computer readable storage medium having stored thereon a program executable by at least one computer of an information processing apparatus for receiving operation data from a handheld operation device including an imaging device for taking images of an imaging target and for displaying, in a display area on a display device, a menu object containing selectable items and enabling a user to interact with the displayed menu object in accordance with calculation processing performed using the operation data, the imaging device taking first and second images, the program causing the at least one computer to perform operations comprising:
-
obtaining a first image taken by the imaging device of the operation device as the operation data; conditionally selecting the displayed menu object as a user-selected operation target based on a position of the imaging target in a taken image; calculating a first two-dimensional vector based on an orientation of the imaging target in the first taken image; calculating a second two-dimensional vector based on an orientation of the imaging target in the second taken image; calculating an angular difference between said first and second two-dimensional vectors, the angular difference indicative of roll rotation of the operation device about an imaging direction axis of the imaging device between the imaging device and the user-selected operation target; calculating a scroll amount, s, based on the calculated angular difference so that the scroll amount has a magnitude that is proportional to the absolute value of the angular difference; linearly scrolling the selectable items within the selected displayed menu object in a predetermined direction by an amount responsive to the calculated scroll amount, s; and allowing the user to initiate an action by pointing the handheld device at and further selecting a scrolled selectable item displayed on the display area of the display device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A non-transitory computer readable storage medium having stored thereon a program executable by at least one computer of an information processing apparatus for receiving operation data from a handheld operation device, which includes an imaging device for taking images of an imaging target and a processor for calculating coordinates of a plurality of marker points in the image of the imaging target taken by the imaging device, and for displaying, in a display area on a display device, a menu object containing selectable items and enabling a user to interact with the displayed menu object in accordance with calculation processing performed using the operation data, the imaging device taking first and second images, the program causing the at least one computer to perform operations comprising:
-
obtaining coordinates of plural marker points of the first taken image as operation data from the handheld device; conditionally selecting the displayed menu object as a user-selected operation target based on position of the plural marker points of the first taken image; calculating a first two-dimensional vector based on said coordinates of plural marker points in the first taken image; obtaining coordinates of plural marker points of the second taken image as operation data from the handheld device; and calculating a second two-dimensional vector based on said coordinates of plural marker points of the second taken image; calculating an angular difference between said first and second two-dimensional vectors, the angular difference indicative of roll rotation of the operation device about an imaging direction axis of the imaging device between the imaging device and the user-selected operation target; calculating a scroll amount, s, based on the calculated angular difference so that the scroll amount has a magnitude that is proportional to the absolute value of the angular difference; linearly scrolling the selectable items within the selected displayed menu object in a predetermined direction by an amount responsive to the calculated scroll amount, s; and allowing the user to initiate an action by pointing the handheld operation device at and further selecting a scrolled selectable item displayed on the display area of the display device. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A non-transitory computer readable storage medium having stored thereon a program executable by at least one computer of an information processing apparatus for receiving operation data from a handheld operation device that includes an imaging device for taking images of an imaging target and a processor for calculating a two-dimensional vector based on an orientation of the imaging target in an image taken by the imaging device, and for displaying, in a display area on a display device, a menu object containing selectable items and enabling a user to interact with the displayed menu object in accordance with calculation processing performed using the operation data, the imaging device taking first and second images, the program causing the at least one computer to execute:
-
obtaining a calculated first two-dimensional vector based on an orientation of the imaging target in the first taken image as operation data from the handheld device; conditionally selecting the displayed menu object as a user-selected operation target based at least in part on a position of the calculated first two-dimensional vector; obtaining a calculated second two-dimensional vector based on an orientation of the imaging target in the second taken image as operation data from the handheld device; calculating an angular difference between said first and second two-dimensional vectors, the angular difference indicative of roll rotation of the operation device about an imaging direction axis of the imaging device between the imaging device and the user-selected operation target; calculating a scroll amount, s, based on the calculated angular difference so that the scroll amount has a magnitude that is proportional to the absolute value of the angular difference; linearly scrolling the selectable items within the selected displayed menu object in a predetermined direction by an amount responsive to the calculated scroll amount, s; and allowing the user to initiate an action by pointing the handheld operation device at and further selecting a scrolled selectable item displayed on the display area of the display device. - View Dependent Claims (25, 26, 27, 28, 29)
-
-
30. An information processing system including an operation device operable by a user and which includes an imaging device for taking an image of a predetermined imaging target, the imaging device taking at least first and second images, and an information processing apparatus communicably connected to the operation device, and a display device, the information processing system comprising:
-
a processor; a memory coupled to said processor, said memory storing instructions that, when executed by said processor, control said processor to; display a window on the display device having a scrollable menu containing selectable items for enabling a user to interact with the displayed selectable items; receive coordinate sets from the operation device of marker points in a first image of the imaging target taken by the imagining device; conditionally select a displayed menu for scrolling of selectable items based on a position of said marker points in said taken first image; calculate a first two-dimensional vector based on coordinate sets of said marker points of a taken first image; receive coordinate sets from the operation device of marker points in the imaging target from a taken second image; calculate a second two-dimensional vector based on coordinate sets of marker points of the taken second image; calculate an angular difference between said first and second two-dimensional vectors, the angular difference indicative of roll rotation of the operation device about an imaging direction axis of the imaging device between the imaging device and the operation target; calculate a scroll amount, s, based on the calculated angular difference so that the scroll amount has a magnitude that is proportional to the absolute value of the angular difference; linearly scroll the selectable items within the selected displayed menu object by an amount responsive to the calculated scroll amount, s; and allow the user to initiate an action by pointing to and further selecting a scrolled selectable item displayed in the menu on the display device. - View Dependent Claims (31)
-
-
32. A visual entertainment method comprising:
-
displaying, on a display screen of a display device, a virtual space including one or more operation target other than a cursor; acquiring, with an optical sensor disposed within a handheld user input device, a plurality of images of an imaging target positioned near the display device; identifying first and second points corresponding to the imaging target in one or more acquired image; determining a vector connecting the first point to the second point; conditionally selecting a displayed operation target other than a cursor based upon an indicated position on the display screen corresponding to a pointing direction of the user input device and determined at least in part based upon positions of the first and second points in an acquired image; calculating an angular difference value for a change in a direction of a determined vector from a first acquired image and a determined vector from a second acquired image or between a determined vector in an acquired image and a predetermined reference direction corresponding to the imaging target, the angular difference value indicative of a roll rotation of the handheld user input device about an imaging direction axis of the optical sensor between the user input device and the displayed operation target; calculating a linear displacement amount based on the calculated angular difference value so that the calculated linear displacement amount has a magnitude that is proportional to the absolute value of the angular difference value; and linearly translating a displayed position of the conditionally selected operation target in a predetermined direction on the display screen by an amount corresponding to the calculated linear displacement amount.
-
Specification