INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20160041619A1
• Filed: 01/24/2014
• Published: 02/11/2016
• Est. Priority Date: 04/02/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: ISHIWATA, KATSUTOSHI, KOMORI, AKIHIRO
• Granted Patent: US 10,514,767 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Provided is an information processing apparatus including: a hand-shape recognition unit configured to recognize a hand shape of an operator on a basis of measured information related to a hand of the operator; and a display control unit configured to move a display position of an operation object on a display screen according to a change in a position of the hand of the operator when the hand shape of the operator is a predetermined shape.

Claims

1. An information processing apparatus comprising:

a hand-shape recognition unit configured to recognize a hand shape of an operator on a basis of measured information related to a hand of the operator; and

a display control unit configured to move a display position of an operation object on a display screen according to a change in a position of the hand of the operator when the hand shape of the operator is a predetermined shape.

2. The information processing apparatus according to claim 1,

wherein the predetermined shape is a shape holding the operation object.

3. The information processing apparatus according to claim 1,

wherein the operation object is an operation surface for the operator to operate the display screen.

4. The information processing apparatus according to claim 1, further comprising:

a motion recognition unit configured to recognize a hand motion performed by the operator,

wherein the display control unit switches between displaying and hiding the operation object on the display screen on a basis of a recognition result of the motion recognition unit on the hand motion of the operator.

5. The information processing apparatus according to claim 4,

wherein the hand motion is a motion of rotating the hand, and

wherein when a motion of rotating the hand of the operator in a first direction is recognized by the motion recognition unit, the display control unit displays the operation object at a position on the display screen that corresponds to a position of the hand of the operator after rotation.

6. The information processing apparatus according to claim 5,

wherein when a motion of rotating the hand of the operator in a second direction, the second direction being a direction opposite to the first direction, is recognized by the motion recognition unit while the operation object is displayed on the display screen, the display control unit hides the operation object on the display screen.

7. The information processing apparatus according to claim 4,

wherein a motion of rotating the hand is a motion of rotating one hand while the one hand is closed.

8. The information processing apparatus according to claim 4,

wherein when a hand shape of a first hand of the operator is the predetermined shape, the display control unit moves the display position of the operation object according to the change in a position of the first hand, and

wherein the information processing apparatus further includes a determination unit configured to, when a hand shape of a second hand of the operator, the hand shape being recognized by the hand-shape recognition unit, is a finger pointing shape, determine a detail of an operation performed by the operator on a basis of a position of a finger of the second hand.

9. The information processing apparatus according to claim 8,

wherein when the position of the finger of the second hand is recognized to be in front of the position of the first hand, the determination unit determines that a position in the operation object corresponding to the position of the finger of the second hand is selected by the operator.

10. The information processing apparatus according to claim 9,

wherein a ratio of an amount of movement of the operation object on the display screen to an amount of change in the position of the hand is different between the first hand and the second hand.

11. The information processing apparatus according to claim 9,

wherein the display control unit changes a ratio of an amount of movement of the operation object on the display screen to an amount of change in the position of the first hand in accordance with a positional relationship between the first hand and the second hand.

12. The information processing apparatus according to claim 11,

wherein, in a case in which the first hand is in front of the second hand, as a distance between the first hand and the second hand in a front-rear direction of the operator becomes smaller, the display control unit reduces the ratio of the amount of movement of the operation object on the display screen to the amount of change in the position of the first hand.

13. The information processing apparatus according to claim 1,

wherein when the hand shape of the operator is not recognized as being the predetermined shape by the hand-shape recognition unit, the display control unit refrains from displaying the operation object on the display screen.

14. The information processing apparatus according to claim 1,

wherein when the hand of the operator is positioned in a space between a display that displays the display screen and an eye of the operator, the display control unit displays the operation object in an area in the display screen that is different from an area that is shielded by the hand of the operator from a view of the operator.

15. The information processing apparatus according to claim 3,

wherein the display control unit displays a focus frame at a position on the display screen that corresponds to a position of a point of view of the operator, and

wherein the information processing apparatus further includes a determination unit that, when a display position of the operation surface is moved, determines that an area on the operation surface after movement corresponding to the focus frame is selected by the operator.

16. The information processing apparatus according to claim 1,

wherein the display control unit displays an image of the hand at a position on the display screen corresponding to a position of the hand of the operator.

17. The information processing apparatus according to claim 1,

wherein information related to the hand of the operator is a value corresponding to a distance from a display displaying the display screen to the hand of the operator or an image of the hand of the operator.

18. An information processing method comprising:

recognizing a hand shape of an operator on a basis of measured information related to a hand of the operator; and

moving a display position of an operation object on a display screen according to a change in a position of the hand of the operator when the hand shape of the operator is a predetermined shape.

19. A program for causing a computer to function as:

a hand-shape recognition unit configured to recognize a hand shape of an operator on a basis of measured information related to a hand of the operator; and

a display control unit configured to move a display position of an operation object on a display screen according to a change in a position of the hand of the operator when the hand shape of the operator is a predetermined shape.