Portable terminal device, program, device shake compensation method, and condition detection method

• US 9,747,871 B2
• Filed: 09/10/2013
• Issued: 08/29/2017
• Est. Priority Date: 09/11/2012
• Status: Active Grant

• Current Assignee: Megachips Corporation
• Original Assignee: Megachips Corporation
• Inventors: Tanaka, Motoyasu, Nakamura, Kenji
• Primary Examiner(s): Liu, Zhengxi
• Application Number:
  US14/426,875
• Publication Number:
  US 20150235631A1
• Time in Patent Office: 1,449 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G09G 2320/08 Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/38 with means for controlling the display position
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/52 including functional features of a camera

Abstract

A portable terminal device operable by an operator is provided with a display unit which displays display data, an image capturing unit and an image signal processing unit which acquire image data containing the face of the operator, a detection unit which detects a relative positional change between the display data displayed on the display unit and the face of the operator based on the acquired image data to create change data, a determination unit which determines whether or not the operator is walking, and a display control unit which, in a case where the determination unit has determined that the operator is walking, controls a displaying position in the display unit of the display data displayed on the display unit so that the relative positional change detected by the detection unit is suppressed.

Claims

1. A portable terminal device operable by an operator, the portable terminal device comprising:

circuitry configured to;

acquire image data by capturing surroundings in capturing periods of a predetermined length, wherein

the image data includes first image data and second image data,

the first image data is acquired in a first capturing period,

the second image data is acquired in a second capturing period, and

the first capturing period is a former period to the second capturing period;

generate face data and detection object data from the second image data, the face data representing a face of the operator and articles worn by the operator, and the detection object data being obtained by excluding the face data from the second image data and representing a remaining portion of the second image data other than the face data;

detect a motion of an object in the second image data based on the detection object data by comparing the detection object data with a former detection object data, the object being included in the detection object data, the motion of the object indicating a positional change of pixels representing the object in the detection object data, and the former detection object data being generated from the first image data acquired at the first capturing period; and

determine a condition of the operator in accordance with the motion of the object.

2. The portable terminal device according to claim 1, wherein

the circuitry is further configured to control an operation of the portable terminal device in accordance with the condition of the operator determined by the circuitry.

3. The portable terminal device according to claim 1, wherein

the condition of the operator includes whether or not the operator is walking.

4. The portable terminal device according to claim 1, wherein

the circuitry is further configured to:

generate person data from the second image data, the person data representing a person other than the operator in the second image data; and

detect the motion of the object based on the detection object data that is a portion of the second image data after the person data is excluded from the second image data.

5. The portable terminal device according to claim 1, wherein

the circuitry detects an amount of move of each pixel based on the detection object data before and after move of the object.

6. The portable terminal device according to claim 5, wherein

the circuitry obtains a number of pixels for every amount of the move of each pixel based on the detected amount of the move of each pixel, and detects the notion of the object in accordance with the amount of the move of each pixel of the largest number of pixels.

7. The portable terminal device according to claim 1, wherein

the condition of the operator includes whether or not the operator is moving on a vehicle.

8. A condition detection method for detecting a condition of a portable terminal device including circuitry, the condition detection method comprising:

acquiring, by the circuitry, image data by capturing surroundings in capturing periods of a predetermined length, wherein

the image data includes first image data and second image data,

the first image data is acquired in a first capturing period,

the second image data is acquired in a second capturing period, and

the first capturing period is a former period to the second capturing period;

generating, by the circuitry, face data and detection object data from the second image data, the face data representing a face of an operator and articles worn by the operator, and the detection object data being obtained by excluding the face data from the second image data and representing a remaining portion of the second image data other than the face data;

detecting, by the circuitry, a motion of an object in the second image data based on the detection object data by comparing the detection object data with a former detection object data, the object being included in the detection object data, the motion of the object indicating a positional change of pixels representing the object in the detection object data, and the former detection object data being generated from the first image data acquired at the first capturing period; and

determining, by the circuitry, a condition of the operator in accordance with the detected motion of the object.