INFORMATION PROCESSING DEVICE, STORAGE MEDIUM STORING INFORMATION PROCESSING PROGRAM, INFORMATION PROCESSING SYSTEM, AND INFORMATION PROCESSING METHOD

• US 20160232404A1
• Filed: 01/20/2016
• Published: 08/11/2016
• Est. Priority Date: 02/10/2015
• Status: Abandoned Application

• Current Assignee: Norihiro Aoyagi, Yusuke Kitazono
• Original Assignee: Norihiro Aoyagi
• Inventors: KITAZONO, Yusuke, AOYAGI, Norihiro
• Application Number:
  US15/001,807
• Publication Number:
  US 20160232404A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: G06F 2203/0339 Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

An example information processing system performs a process based on a camera image obtained by a camera. That is, the information processing system obtains a camera image, and detects, based on the camera image, an operation of bringing an object (e.g., a hand of a user) into contact with the camera or the vicinity thereof. The information processing system performs a predetermined information process based on the operation detection result. Then, the user can give an instruction to the information processing system by performing an operation of touching the camera. This enables an unconventional operation, and it is possible to improve the controllability of the information processing system.

Claims

1. An information processing system for performing a process based on a camera image obtained by a camera, wherein one or more processor of the information processing system executes:

obtaining the camera image;

detecting, based on the camera image, an operation of bringing an object into contact with the camera or a vicinity thereof; and

performing a predetermined information process based on the operation detection result.

2. The information processing system according to claim 1, wherein the camera is provided on a housing of the information processing system so as to capture an image in a side surface direction of the housing.

3. The information processing system according to claim 1, wherein the processor starts performing the predetermined information process in response to the detection of the operation.

4. The information processing system according to claim 3, wherein the predetermined information process is a game process of a game application.

5. The information processing system according to claim 1, wherein the processor stops performing the predetermined information process in response to the detection of the operation.

6. The information processing system according to claim 1, wherein:

the processor calculates object information based on the camera image, the object information representing a position, a shape and/or a movement of the object; and

the processor performs, as the predetermined information process, an information process based on the object information.

7. The information processing system according to claim 6, wherein the processor calculates object information based on the camera image, the object information representing a position, a shape and/or a movement of the object when the object is not in contact with the camera or the vicinity thereof.

8. The information processing system according to claim 1, wherein:

the processor calculates a speed of the operation based on a camera image that has been obtained before the detection of the operation; and

the processor varies content of the predetermined information process in accordance with the calculated speed.

9. The information processing system according to claim 1, wherein:

the processor determines, based on a camera image that is obtained upon detection of the operation and/or a camera image that has been obtained before the detection of the operation, a position at which the operation has been performed on the camera; and

the processor varies content of the predetermined information process in accordance with the determined position.

10. The information processing system according to claim 1, wherein the processor detects the operation based on information regarding brightness of pixels within a predetermined area of the camera image.

11. The information processing system according to claim 1, wherein:

the information processing system includes an information processing device; and

the information processing system further includes an input device for receiving an input by a user, the input device provided on a front surface of a housing of the information processing device.

12. The information processing system according to claim 1, wherein:

the information processing system includes an information processing device; and

the information processing system further includes a display provided on a front surface of a housing of the information processing device.

13. The information processing system according to claim 12, wherein:

the information processing system further includes a touch panel on the display; and

the processor performs the predetermined information process based at least on either the operation detection result or an operation on the touch panel.

14. A non-transitory computer-readable storage medium storing an information processing program to be performed by a computer of an information processing system for performing a process based on a camera image obtained by a camera, the information processing program instructing the computer to execute:

obtaining the camera image;

detecting, based on the camera image, an operation of bringing an object into contact with the camera or a vicinity thereof; and

performing a predetermined information process based on the operation detection result.

15. An information processing method for performing a process based on a camera image obtained by a camera, wherein one or more processor of an information processing system executes:

obtaining the camera image;

detecting, based on the camera image, an operation of bringing an object into contact with the camera or a vicinity thereof; and

performing a predetermined information process based on the operation detection result.