Information processing apparatus and information processing method

• US 9,442,601 B2
• Filed: 07/27/2009
• Issued: 09/13/2016
• Est. Priority Date: 07/25/2008
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Narita, Tomoya, Tsuzaki, Ryoichi
• Primary Examiner(s): SIMPSON, LIXI CHOW
• Application Number:
  US12/509,783
• Publication Number:
  US 20100020037A1
• Time in Patent Office: 2,605 Days
• Field of Search: 345/173, 345/649, 715798-801, 715863-864
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

The present invention provides an information processing apparatus enables the operation such that the relation between the image displayed on the display unit and the operation of the user is close to the actual operation and an information processing method. The information processing apparatus includes a display control unit which displays an image at a display unit, a closeness value acquisition unit which acquires a closeness value regarding contact or closeness between an operation entity and a surface of the display unit, an area detection unit which performs a ternary process to the closeness value and detects a first area and a second area being different from the first area in accordance with the ternary-processed closeness value, and a centroid position calculation unit which calculates respective centroid positions of the first area and the second area.

Claims

1. An information processing apparatus, comprising:

a state detection unit configured to detect if an operation entity contacts an operation surface and to detect distance between the operation entity and the operation surface by determining brightness values of incident light received by the operation surface and converting the received light into electric signals;

an area detection unit configured to detect a first area of the operation entity having a first determined brightness value above a first brightness threshold and a second area of the operation entity having a second determined brightness value above a second brightness threshold, wherein the first area is different from the second area and the first brightness threshold is higher than the second brightness threshold in order to determine that the first area is closer to the operation surface than the second area;

a centroid position calculation unit configured to calculate respective centroid positions of the first area and the second area;

a pointing direction determination unit configured to determine a pointing direction of the operation entity when the operation entity is not in contact with the operation surface, wherein the pointing direction is determined based on a line connecting a first centroid of the first area and a second centroid of the second area; and

a control unit configured to select a first option or a second option based on a change of the pointing direction of the operation entity while not in contact with the operation surface,

wherein the first option and the second option are related to a displayed object which is selected by an operation of the operation entity.

2. The information processing apparatus according to claim 1, further comprising a movement detection unit configured to detect movement of the first centroid and the second centroid.

3. The information processing apparatus according to claim 1, wherein the state detection unit includes an electrostatic capacity detection unit configured to detect electrostatic capacity between the operation entity and the operation surface, and a closeness value calculation unit configured to calculate variation of the electrostatic capacity as the closeness value.

4. An information processing method, performed via at least one processor, the method comprising:

detecting if an operation entity contacts an operation surface and detecting distance between the operation entity and the operation surface by determining brightness values of incident light received by the operation surface and converting the received light into electric signals;

detecting a first area of the operation entity having a first determined brightness value above a first brightness threshold and a second area of the operation entity having a second determined brightness value above a second brightness threshold, wherein the first area is different from the second area and the first brightness threshold is higher than the second brightness threshold in order to determine that the first area is closer to the operation surface than the second area;

calculating respective centroid positions of the first area and the second area;

determining a pointing direction of the operation entity when the operation entity is not in contact with the operation surface, wherein the pointing direction is determined based on a line connecting a first centroid of the first area and a second centroid of the second area; and

selecting either a first option or a second option based on a change of the pointing direction of the operation entity while not in contact with the operation surface,

wherein the first option and the second option are related to a displayed object which is selected by an operation of the operation entity.

5. The information processing method according to claim 4, further comprising:

detecting movement of the first centroid and the second centroid.

6. The information processing method according to claim 4, further comprising:

detecting electrostatic capacity between the operation entity and the operation surface; and

calculating variation of the electrostatic capacity as the closeness value.