INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20160018885A1
• Filed: 01/20/2014
• Published: 01/21/2016
• Est. Priority Date: 03/08/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: KIMURA, Kentaro, IKEDA, Takuo, IKEDA, Tetsuo, TSUKAHARA, Tsubasa, KOGA, Yasuyuki, IZUMIHARA, Atsushi
• Granted Patent: US 10,719,121 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

An information processing apparatus includes circuitry configured to provide a user interface to a user, determine whether a predetermined object is present in an input recognition area of a sensor, and determine a region of interest within the user interface. The circuitry is further configured to determine, while the predetermined object is determined to be present in the input recognition area, whether the region of interest within the user interface changes. The circuitry is further configured to perform an operation based on whether the region of interest is determined, while the predetermined object is determined to be present in the input recognition area, to change.

Claims

1. An information processing apparatus, comprising:

circuitry configured to

provide a user interface to a user,

determine whether a predetermined object is present in an input recognition area of a sensor,

determine a region of interest within the user interface,

determine, while the predetermined object is determined to be present in the input recognition area, whether the region of interest within the user interface changes, and

perform an operation based on whether the region of interest is determined, while the predetermined object is determined to be present in the input recognition area, to change.

2. The information processing apparatus according to claim 1, wherein the circuitry is further configured to perform the operation when the predetermined object is determined to no longer be present in the input recognition area.

3. The information processing apparatus according to claim 1, wherein the circuitry is further configured to determine the region of interest within the user interface based on another sensor that is configured to generate data representative of a viewing direction of the user.

4. The information processing apparatus according to claim 3, wherein the another sensor is one of a camera, an acceleration sensor, and a gyro sensor.

5. The information processing apparatus according to claim 1, wherein the operation is a tap, click, or select operation on an object corresponding to the determined region of interest when the region of interest within the user interface does not change while the predetermined object is determined to be present in the input recognition area.

6. The information processing apparatus according to claim 1, wherein the operation is a drag operation on an object corresponding to the determined region of interest when the region of interest within the user interface changes while the predetermined object is determined to be present in the input recognition area.

7. The information processing apparatus according to claim 1, wherein the operation is an instruction to a first device to transmit predetermined information to a second device.

8. The information processing apparatus according to claim 7, wherein the first device is a television.

9. The information processing apparatus according to claim 1, wherein the operation is transmission of a request to another device for sending predetermined data to the information processing apparatus.

10. The information processing apparatus according to claim 9, wherein the circuitry is further configured to receive data from the another device in response to the request.

11. The information processing apparatus according to claim 9, wherein the circuitry is further configured to receive a discount coupon from the another device in response to the request.

12. The information processing apparatus according to claim 1, wherein the operation is a drag operation on an object corresponding to the determined region of interest that is based on an amount of change of the region of interest.

13. The information processing apparatus according to claim 1, wherein the sensor is a camera configured to capture an image of the predetermined object.

14. The information processing apparatus according to claim 1, further comprising:

a display implemented in a head-mounted display unit and configured to present the user interface to the user.

15. The information processing apparatus according to claim 1, wherein the circuitry is further configured to determine the region of interest within the user interface when the predetermined object is determined to be present in the input recognition area.

16. The information processing apparatus according to claim 1, wherein the circuitry is further configured to determine whether a predetermined operation body, which corresponds to the predetermined object, is present in the input recognition area or whether a gesture of moving a predetermined part of the predetermined operation body is detected.

17. An information processing system, comprising:

circuitry configured to

provide a user interface to a user,

determine whether a predetermined object is present in an input recognition area of a sensor,

determine a region of interest within the user interface,

determine, while the predetermined object is determined to be present in the input recognition area, whether the region of interest within the user interface changes, and

perform an operation based on whether the region of interest is determined, while the predetermined object is determined to be present in the input recognition area, to change.

18. A method of an information processing apparatus for performing an operation, the method comprising:

providing, by circuitry of the information processing apparatus, a user interface to a user;

determining whether a predetermined object is present in an input recognition area of a sensor;

determining a region of interest within the user interface;

determining, while the predetermined object is determined to be present in the input recognition area, whether the region of interest within the user interface changes; and

performing, by the circuitry of the information processing apparatus, the operation based on whether the region of interest is determined, while the predetermined object is determined to be present in the input recognition area, to change.

19. A non-transitory computer-readable storage medium storing instructions which, when executed by a computer, cause the computer to perform a method of an information processing apparatus for performing an operation, the method comprising:

providing, by the computer, a user interface to a user;

determining whether a predetermined object is present in an input recognition area of a sensor;

determining a region of interest within the user interface;

determining, while the predetermined object is determined to be present in the input recognition area, whether the region of interest within the user interface changes; and

performing, by the computer, the operation based on whether the region of interest is determined, while the predetermined object is determined to be present in the input recognition area, to change.