Imaging apparatus, imaging system, target person monitoring system and control method of imaging apparatus

• US 10,304,312 B2
• Filed: 10/24/2016
• Issued: 05/28/2019
• Est. Priority Date: 10/28/2015
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Kyocera Corporation
• Inventors: Kim, Woojung
• Primary Examiner(s): McNally, Kerri L
• Assistant Examiner(s): Tran, Thang D
• Application Number:
  US15/771,753
• Publication Number:
  US 20180315288A1
• Time in Patent Office: 946 Days
• Field of Search: 340576
• CPC Class Codes: G03B 15/00 Special procedures for taking photographs; Apparatus therefor
• CPC Class Codes: G03B 15/03 Combinations of cameras with lighting apparatus; Flash units
• CPC Class Codes: G03B 15/05 Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: G03B 17/02 Bodies
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/65 Control of camera operation in relation to power supply
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/75 by influencing optical camera components
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS

Abstract

The imaging apparatus comprises an image sensor and a controller. In the image sensor, charge accumulation and reading out in a plurality of pixels arranged in a two-dimensional array are controlled per line. The controller identifies one or more lines from lines of the image sensor to generate control information for controlling illumination light on the basis of the one or more lines identified.

Claims

1. An imaging apparatus comprising:

an image sensor in which a plurality of pixels are arranged in a two-dimensional array with a plurality of lines, and wherein charge accumulation and reading out of the plurality of lines are controlled per line; and

a controller configured to,

in a first mode, control illumination light to illuminate a target area during a charge accumulation period for all of the plurality of lines in a first frame,

generate a first captured image of the first frame,

perform object detection on the first captured image,

in response to detecting an object, switch to a second mode,

in the second mode,

identify one or more lines from the plurality of lines of the image sensor that correspond to a location of the detected object in the first captured image,

for each of one or more second frames,

control the illumination light to illuminate the target area during a portion of the charge accumulation period for only the identified one or more lines in the second frame,

generate a second captured image of the second frame, and

perform object detection on the second captured image, and,

when the object is not detected for a first reference number of consecutive second frames, switch back to the first mode, and,

when the object is not detected for a second reference number of consecutive first or second frames, initiate a warning,

wherein the second reference number is greater than the first reference number.

2. The imaging apparatus according to claim 1, wherein controlling the illumination light to illuminate the target area during the portion of the charge accumulation period for only the identified one or more lines in the second frame comprises generating control information for an illumination system, wherein the control information includes an instruction for stopping emission of the illumination light outside a specific period determined on the basis of the identified one or more lines.

3. The imaging apparatus according to claim 2, wherein the specific period is defined by a start time and an end time within the charge accumulation period for the identified one or more lines in the second frame, wherein the start time a latest timing of start timings of charge accumulation in the identified one or more lines, and the end time is an end timing that is an earliest timing of end timings of charge accumulation in the identified one or more lines.

4. The imaging apparatus according to claim 1, wherein the controller performs the object detection only in an area of the second captured image corresponding to the identified one or more lines.

5. An imaging system comprising:

the imaging apparatus of claim 1; and

one or more light sources configured to emit the illumination light.

6. A target person monitoring system comprising:

the imaging system of claim 5, wherein the controller is configured to determine a state of a target person on the basis of the detected object; and

a warning system configured to give a warning to the target person when the target person is determined to be in a specific state.

7. A control method of an imaging apparatus comprising an image sensor in which a plurality of pixels are arranged in a two-dimensional array with a plurality of lines, and wherein charge accumulation and reading out of the plurality of lines are controlled per line, the method comprising:

in a first mode, controlling illumination light to illuminate a target area during a charge accumulation period for all of the plurality of lines in a first frame;

generating a first captured image of the first frame;

performing object detection on the first captured image;

in response to detecting an object, switching to a second mode;

in the second mode,

identifying one or more lines from the plurality of lines of the image sensor that correspond to a location of the detected object in the first captured image,

for each of one or more second frames,

control the illumination light to illuminate the target area during a portion of the charge accumulation period for only the identified one or more lines in the second frame,

generate a second captured image of the second frame, and

perform object detection on the second captured image, and,

when the object is not detected for a first reference number of consecutive second frames, switch back to the first mode; and

,

when the object is not detected for a second reference number of consecutive first or second frames, initiate a warning,

wherein the second reference number is greater than the first reference number.