Mobile device utilizing multiple cameras for environmental detection

• US 9,959,464 B2
• Filed: 02/15/2017
• Issued: 05/01/2018
• Est. Priority Date: 05/24/2012
• Status: Active Grant

• Current Assignee: IP3 2017, Series 200 of Allied Security Trust I (Allied Security Trust)
• Original Assignee: HJ Laboratories, LLC
• Inventors: Vartanian, Harry, Jurikson-Rhodes, Jaron
• Primary Examiner(s): HOGUE, DENNIS A
• Application Number:
  US15/433,707
• Publication Number:
  US 20170161556A1
• Time in Patent Office: 440 Days
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04N 1/00827 Arrangements for reading an image from an unusual original, e.g. 3-dimensional objects
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/61 based on recognised objects

Abstract

A mobile electronic device may have two or more rear facing camera to capture a first part of an environment, a second part of the environment, and a part of an item in the environment. A camera and a depth sensor of the mobile electronic device may capture biometric facial data to perform security verification. Characteristics of the environment may be identified based on the environmental data and results of the performed security verification.

Claims

1. A mobile electronic device comprising:

two or more rear facing camera configured to capture a first part of an environment, to capture a second part of the environment, and to capture a part of an item in the environment;

a camera and a depth sensor configured to capture biometric facial data to perform security verification;

a processor configured to identify characteristics of the environment based on the captured first part of the environment, the captured second part of the environment, the captured part of the item, and information received via a network adapter, wherein the identification is performed based on a successful result of the performed security verification; and

the process configured to perform eye tracking and retrieve additional information of the identified characteristics of the environment based on the eye tracking.

2. The mobile electronic device of claim 1 further comprising:

the processor is configured to utilize assistance information for the identification; and

wherein the assistance information is obtained, by the mobile electronic device, from the captured first part of the environment or the captured second part of the environment.

3. The mobile electronic device of claim 1, wherein the eye tracking is utilized to track position or location of the mobile electronic device.

4. The mobile electronic device of claim 1, wherein a timeline or history the identified characteristics of the environment is retrieved.

5. A method performed by a mobile electronic device, the method comprising:

capturing, by two or more rear facing camera of the mobile electronic device, a first part of an environment, a second part of the environment, and a part of an item in the environment;

capturing, by a camera and a depth sensor of the mobile electronic device, biometric facial data to perform security verification;

identifying, by a processor of the mobile electronic device, characteristics of the environment based on the captured first part of the environment, the captured second part of the environment, the captured part of the item, and information received via a network adapter, wherein the identification is performed based on a successful result of the performed security verification; and

performing, by the processor of the mobile electronic device, eye tracking and retrieving additional information of the identified characteristics of the environment based on the eye tracking.

6. The method of claim 5 further comprising:

utilizing, by the processor, assistance information for the identification; and

obtaining, by the mobile electronic device, the assistance information from the captured first part of the environment or the captured second part of the environment.

7. The method of claim 5, wherein the eye tracking is utilized to track position or location of the mobile electronic device.

8. The method of claim 5, wherein a timeline or history the identified characteristics of the environment is retrieved.