INFORMATION PROCESSING DEVICE, STORAGE MEDIUM STORING INFORMATION PROCESSING PROGRAM, INFORMATION PROCESSING SYSTEM, AND INFORMATION PROCESSING METHOD

• US 20160232674A1
• Filed: 01/20/2016
• Published: 08/11/2016
• Est. Priority Date: 02/10/2015
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Wataru Tanaka
• Inventors: TANAKA, Wataru, KITAZONO, Yusuke
• Granted Patent: US 9,864,905 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

An example information processing system includes a camera. The information processing system calculates, based on a camera image obtained by the camera, a position or a direction of an object (e.g., a hand of a user) included in the camera image. The information processing system instructs an output device to produce an output in accordance with the position or the direction of the object. The information processing system displays, on a display device, a guide image including a range image representing a range and an indicator image whose position or direction changes in accordance with a change in the output within the range.

Claims

1. An information processing system comprising a camera, wherein one or more processor of the information processing system executes:

calculating, based on a camera image obtained by the camera, a position or a direction of an object included in the camera image;

instructing an output device to produce an output in accordance with the position or the direction of the object; and

displaying, on a display device, a guide image including a range image representing a range and an indicator image whose position or direction changes in accordance with a change in the output within the range.

2. The information processing system according to claim 1, wherein the camera captures an image in a side surface direction of a housing of the information processing system.

3. The information processing system according to claim 1, wherein the indicator image is an image representing the object.

4. The information processing system according to claim 1, wherein the processor displays, on the display device, a guide image including a predetermined device reference image so that a positional relationship between the indicator image and the predetermined device reference image corresponds to a positional relationship between the object and the camera.

5. The information processing system according to claim 1, wherein when a position of the object cannot be calculated, the processor changes a display mode of the guide image, as compared with that when the position of the object is calculated.

6. The information processing system according to claim 1, wherein when the calculated position of the object is further away toward an un-calculatable area from a predetermined reference position by a predetermined distance or more, the processor changes a display mode of the guide image, as compared with that when the calculated position is within the predetermined distance.

7. The information processing system according to claim 1, wherein the processor calculates, based on the camera image, a position of the object with respect to an image-capturing direction of the camera.

8. The information processing system according to claim 1, wherein:

the processor controls an output to the output device so that the output is in accordance with a relationship between the calculated position of the object and a predetermined reference position; and

the processor displays, on the display device, a guide image including a process reference image placed at a position corresponding to the reference position within the range represented by the range image.

9. A non-transitory computer-readable storage medium storing an information processing program to be performed by a computer of an information processing system comprising a camera, the information processing program instructing the computer to execute:

calculating, based on a camera image obtained by the camera, a position or a direction of an object included in the camera image;

instructing an output device to produce an output in accordance with the position or the direction of the object; and

displaying, on a display device, a guide image including a range image representing a range and an indicator image whose position or direction changes in accordance with a change in the output within the range.

10. An information processing device comprising a camera, wherein one or more processor of the information processing device executes:

calculating, based on a camera image obtained by the camera, a position or a direction of an object included in the camera image;

instructing an output device to produce an output in accordance with the position or the direction of the object; and

displaying, on a display device, a guide image including a range image representing a range and an indicator image whose position or direction changes in accordance with a change in the output within the range.

11. An information processing method to be performed on an information processing system comprising a camera, the method comprising:

calculating, based on a camera image obtained by the camera, a position or a direction of an object included in the camera image;

instructing an output device to produce an output in accordance with the position or the direction of the object; and

displaying, on a display device, a guide image including a range image representing a range and an indicator image whose position or direction changes in accordance with a change in the output within range.