PORTABLE TERMINAL DEVICE, PROGRAM, DEVICE SHAKE COMPENSATION METHOD, AND CONDITION DETECTION METHOD

• US 20150235631A1
• Filed: 09/10/2013
• Published: 08/20/2015
• Est. Priority Date: 09/11/2012
• Status: Active Grant

• Current Assignee: Megachips Corporation
• Original Assignee: Megachips Corporation
• Inventors: Nakamura, Kenji, Tanaka, Motoyasu
• Granted Patent: US 9,747,871 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G09G 2320/08 Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/38 with means for controlling the display position
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264

Abstract

A portable terminal device operable by an operator is provided with a display unit which displays display data, an image capturing unit and an image signal processing unit which acquire image data containing the face of the operator, a detection unit which detects a relative positional change between the display data displayed on the display unit and the face of the operator based on the acquired image data to create change data, a determination unit which determines whether or not the operator is walking, and a display control unit which, in a case where the determination unit has determined that the operator is walking, controls a displaying position in the display unit of the display data displayed on the display unit so that the relative positional change detected by the detection unit is suppressed.

Claims

1. A portable terminal device operable by an operator, comprising:

a display unit configured to display an image;

an image acquisition unit configured to acquire image data containing a face of the operator;

a detection unit configured to detect a relative positional change between the image displayed on the display unit and the face of the operator based on the image data acquired by the image acquisition unit;

a determination unit configured to determine whether or not the operator is walking; and

a display compensation unit configured to, in a case where it has been determined by the determination unit that the operator is walking, control a displaying position in the display unit of the image displayed on the display unit to suppress the relative positional change detected by the detection unit.

2. The portable terminal device according to claim 1, wherein

the image acquisition unit acquires the image data containing an eyeball of the operator, and

the detection unit detects a move of the eyeball of the operator based on the image data acquired by the image acquisition unit, to detect the relative positional change between the image displayed on the display unit and the face of the operator.

3. The portable terminal device according to claim 1, wherein

the detection unit detects a change amount in the relative positional change.

4. (canceled)

5. A device shake compensation method for detecting a condition of a portable terminal device, comprising:

displaying an image on a display unit of the portable terminal device;

acquiring image data containing a face of the operator of the portable terminal device;

detecting a relative positional change between the image displayed on the display unit and the face of the operator based on the acquired image data;

determining whether or not the operator is walking; and

in a case where it has been determined that the operator is walking, controlling a displaying position in the display unit of the image displayed on the display unit to suppress the detected relative positional change.

6. A portable terminal device operable by an operator, comprising:

an image acquisition unit configured to acquire image data by capturing surroundings;

a detection unit configured to detect a motion of an object in the image data based on detection object data that is a portion obtained by removing face data representing a face of the operator from the image data acquired by the image acquisition unit; and

a condition determination unit configured to determine a condition of the operator in accordance with the motion of the object detected by the detection unit.

7. The portable terminal device according to claim 6, further comprising a control unit configured to control an operation of the portable terminal device in accordance with the condition of the operator determined by the condition determination unit.

8. The portable terminal device according to claim 6, wherein

the condition of the operator includes whether or not the operator is walking.

10. The portable terminal device according to claim 6, wherein

the detection unit detects the motion of the object based on the detection object data that is a portion of the image data acquired by the image acquisition unit after person data representing a person other than the operator is excluded from the image data.

11. The portable terminal device according to claim 6, wherein

the detection unit detects an amount of move of each pixel based on the detection object data before and after move of the object.

12. The portable terminal device according to claim 11, wherein

the detection unit obtains the number of pixels for every amount of the move of each pixel based on the detected amount of the move of each pixel, and detects the motion of the object in accordance with the amount of the move of each pixel of the largest number of pixels.

15. The portable terminal device according to claim 6, wherein

the condition of the operator includes whether or not the operator is moving on a vehicle.

9. (canceled)

13. (canceled)

14. A condition detection method for detecting a condition of a portable terminal device, comprising:

acquiring image data by capturing surroundings;

detecting a motion of an object in the image data based on detection object data that is a portion obtained by removing face data representing a face of the operator from the acquired image; and

determining the condition of the operator in accordance with the detected motion of the object.