Information processing device, storage medium storing information processing program, information processing system, and information processing method
First Claim
1. An information processing system comprising:
- a housing having at least a front surface and side surfaces;
a camera for capturing an image in a side surface direction of the housing; and
,one or more computer processors for executing instructions such that the information processing system is at least configured to;
calculate, based on a camera image obtained by the camera, a two-dimensional position of the object on the camera image and calculate a three-dimensional position of an object included in the camera image based on the two-dimensional position;
specify a shape of an image area of the object on the camera image based on the camera image based on the calculated two-dimensional position, the shape of the image area of the object being a two-dimensional shape;
perform an information process in accordance with the three-dimensional position and the shape of the image area of the object,determine a determination range based on the position of the three-dimensional position of the object, wherein a size of the determination range is variable; and
determine the shape of the image area of the object based on a number of areas of the object outside of the determination range and on the camera image;
whereinthe image area of the object is the entirety of an area of the object on the camera image; and
the areas of the object outside of the determination range are partial areas of the entirety of the area of the object and are areas separate from each other.
1 Assignment
0 Petitions
Accused Products
Abstract
An example information processing device includes a housing and a camera for capturing an image in a side surface direction of the housing. The information processing device calculates, based on a camera image obtained by the camera, a three-dimensional position of an object (e.g., a hand of a user) included in the camera image, and performs an information process in accordance with the three-dimensional position. Note that the information processing device may specify a shape of the object based on the camera image to perform an information process in accordance with the three-dimensional position and the shape of the object. Then, it is possible to realize various inputs using a captured image.
-
Citations
10 Claims
-
1. An information processing system comprising:
-
a housing having at least a front surface and side surfaces; a camera for capturing an image in a side surface direction of the housing; and
,one or more computer processors for executing instructions such that the information processing system is at least configured to; calculate, based on a camera image obtained by the camera, a two-dimensional position of the object on the camera image and calculate a three-dimensional position of an object included in the camera image based on the two-dimensional position; specify a shape of an image area of the object on the camera image based on the camera image based on the calculated two-dimensional position, the shape of the image area of the object being a two-dimensional shape; perform an information process in accordance with the three-dimensional position and the shape of the image area of the object, determine a determination range based on the position of the three-dimensional position of the object, wherein a size of the determination range is variable; and determine the shape of the image area of the object based on a number of areas of the object outside of the determination range and on the camera image;
whereinthe image area of the object is the entirety of an area of the object on the camera image; and the areas of the object outside of the determination range are partial areas of the entirety of the area of the object and are areas separate from each other. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer-readable storage medium storing an information processing program to be performed by a computer of an information processing system including an information processing device comprising a housing having at least a front surface and side surfaces, and a camera for capturing an image in a side surface direction of the housing, the information processing program instructing the computer to execute:
-
calculate, based on a camera image obtained by the camera, a two-dimensional position of the object on the camera image and calculate a three-dimensional position of an object included in the camera image based on the two-dimensional position; specify a shape of an image area of the object on the camera image based on the camera image based on the calculated two-dimensional position, the shape of the image area of the object being a two-dimensional shape, and perform an information process in accordance with the three-dimensional position and the shape of the image area of the object; determine a determination range based on the position of the three-dimensional position of the object, wherein a size of the determination range is variable; and determine the shape of the image area of the object based on a number of areas of the object outside of the determination range and on the camera image;
whereinthe image area of the object is the entirety of an area of the object on the camera image; and the areas of the object outside of the determination range are partial areas of the entirety of the area of the object and are areas separate from each other.
-
-
10. An information processing method to be performed on an information processing system including an information processing device comprising a housing having at least a front surface and side surfaces, and a camera for capturing an image in a side surface direction of the housing, the method comprising:
-
calculating, based on a camera image obtained by the camera, a two-dimensional position of the object on the camera image and calculate a three-dimensional position of an object included in the camera image based on the two-dimensional position; specifying a shape of an image area of the object on the camera image based on the camera image based on the calculated two-dimensional position, the shape of the image area of the object being a two-dimensional shape; and performing, an information process in accordance with the three-dimensional position and the shape of the image area of the object; determine a determination range based on the position of the three-dimensional position of the object, wherein a size of the determination range is variable; and determine the shape of the image area of the object based on a number of areas of the object outside of the determination range and on the camera image;
wherein;the image area of the object is the entirety of an area of the object on the camera image; and the areas of the object outside of the determination range are partial areas of the entirety of the area of the object and are areas separate from each other.
-
Specification