Face recognition systems with external stimulus

• US 10,212,778 B1
• Filed: 02/19/2018
• Issued: 02/19/2019
• Est. Priority Date: 08/17/2012
• Status: Active Grant

• Current Assignee: Kuna systems corporation
• Original Assignee: Kuna systems corporation
• Inventors: Fu, Sai-Wai, Huang, Haomiao, Hiszpanski, Christopher
• Primary Examiner(s): Pham, Thai
• Application Number:
  US15/899,007
• Time in Patent Office: 365 Days
• CPC Class Codes: F21S 8/033 the surface being a wall or like vertical structure, e.g. building facade
• CPC Class Codes: F21S 8/04 intended only for mounting on a ceiling or the like overhead structures F21S8/02 takes precedence; details of ceiling bases F21V21/03
• CPC Class Codes: F21W 2131/107 of the exterior of buildings
• CPC Class Codes: F21Y 2101/00 Point-like light sources
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/67 by interactive indications to the user
• CPC Class Codes: G08B 13/196 using television cameras
• CPC Class Codes: G08B 3/00 Audible signalling systems; Audible personal calling systems
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H05B 47/125 by using cameras
• CPC Class Codes: H05B 47/16 by timing means
• CPC Class Codes: H05B 47/19 via wireless transmission
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

An apparatus includes a camera and a processor. The camera may be configured to capture video data of an area of interest. The processor may be configured to (A) process the video data, (B) generate control signals used to initiate an external stimulus and (C) execute computer readable instructions. The computer readable instructions may be executed by the processor to (a) stream the video data to an external server, receive facial recognition results from the external server and (c) if the facial recognition results cannot detect a face of a detected person, determine which of the control signals to generate. The external stimuli may be implemented to encourage a detected person to look in a direction of the camera sensor.

Claims

1. An apparatus comprising:

a camera sensor configured to capture video data of an area of interest; and

a processor configured to (A) process said video data, (B) generate control signals used to initiate an external stimulus and (C) execute computer readable instructions, wherein (i) said computer readable instructions are executed by said processor to (a) perform video analysis on video frames of said captured video data, (b) determine facial recognition results based on said video analysis and (c) if said facial recognition results cannot detect a face of a detected person, determine which of said control signals to generate and (ii) said external stimuli are implemented to encourage a detected person to look in a direction of said camera sensor.

2. The apparatus according to claim 1, wherein encouraging said detected person to look in said direction of said camera sensor increases a probability of detecting a frontal view of a face in said video data.

3. The apparatus according to claim 1, wherein said facial recognition results are determined in real-time.

4. The apparatus according to claim 3, wherein said real-time results are determined within 500 ms.

5. The apparatus according to claim 1, wherein said processor is configured to share video processing tasks with a cloud server based on a processing capability of said processor.

6. The apparatus according to claim 5, wherein said processor and said cloud server are configured to implement a video processing pipeline with different video processing tasks performed by said processor and said cloud server.

7. An apparatus comprising:

a camera sensor configured to capture video data of an area of interest; and

a processor configured to (A) process said video data, (B) generate control signals used to initiate an external stimulus and (C) execute computer readable instructions, wherein (i) said computer readable instructions are executed by said processor to (a) stream said video data to an external server, (b) receive facial recognition results from said external server and (c) if said facial recognition results cannot detect a face of a detected person, determine which of said control signals to generate and (ii) said external stimuli are implemented to encourage a detected person to look in a direction of said camera sensor.

8. The apparatus according to claim 7, wherein (i) said apparatus is configured to capture context information associated with said video data and (ii) said processor is configured to intelligently select one of said external stimuli based on at least one of (a) said context information and (b) said video data.

9. The apparatus according to claim 7, wherein said apparatus is configured to (i) detect motion and (ii) if said motion is detected, generate said control signals to initiate said external stimulus.

10. The apparatus according to claim 7, wherein person detection is performed as a filter before facial recognition is implemented.

11. The apparatus according to claim 7, wherein (i) said video data captured during a pre-determined time after said external stimulus is initiated is used as selected video frames and (ii) said selected video frames are streamed to said external server.

12. The apparatus according to claim 11, wherein (i) said selected video frames have a higher probability of having a frontal view of a face of a visitor and (ii) streaming only said selected frames increases a speed of said generating said facial recognition results.

13. The apparatus according to claim 7, wherein said facial recognition results are presented to a user device for evaluation by a user.

14. The apparatus according to claim 13, wherein (i) said evaluation by said user is presented to said external server as feedback and (ii) said feedback is used to improve learning for video processing tasks.

15. The apparatus according to claim 7, wherein said external server comprises a distributed computing network configured to scale resources based on demand.

16. The apparatus according to claim 7, wherein said external stimuli comprise at least one of (a) non-interactive stimulus, (b) conversation stimulus, (c) directive stimulus and (d) alarm stimulus.

17. The apparatus according to claim 16, wherein said non-interactive stimulus comprises an unexpected sound.

18. The apparatus according to claim 16, wherein said conversation stimulus comprises an interactive conversation using a two-way radio functionality of said apparatus between at least (i) said detected person and a homeowner and (ii) said detected person and an artificial intelligence.

19. The apparatus according to claim 16, wherein said directive stimulus comprises instructing said detected person to perform a task that comprises facing said camera sensor.

20. The apparatus according to claim 16, wherein said alarm stimulus comprises a distress signal.