Mobile device utilizing multiple cameras

• US 10,599,923 B2
• Filed: 04/30/2018
• Issued: 03/24/2020
• Est. Priority Date: 05/24/2012
• Status: Active Grant

• Current Assignee: IP3 2017, Series 200 of Allied Security Trust I (Allied Security Trust)
• Original Assignee: HJ Laboratories, LLC
• Inventors: Vartanian, Harry, Jurikson-Rhodes, Jaron
• Primary Examiner(s): Monk, Mark T
• Application Number:
  US15/966,622
• Publication Number:
  US 20190005320A1
• Time in Patent Office: 694 Days
• Field of Search: None
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04N 1/00827 Arrangements for reading an image from an unusual original, e.g. 3-dimensional objects
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/61 based on recognised objects

Abstract

A mobile electronic device may have two rear facing cameras to capture environmental information. A camera and a depth sensor of the mobile electronic device may capture biometric facial data for security verification. Characteristics of the environment may be identified based on the environmental information and results of the security verification.

Claims

1. A mobile electronic device comprising:

at least two rear facing cameras configured to capture a part of an environment and to capture a part of a paper document in the environment;

a camera and a depth sensor configured to capture biometric facial information for security verification;

a processor configured to identify characteristics of the environment based on the captured part of the environment, the captured part of the paper document, and information received via a network adapter, wherein the identification is performed subsequent to a successful result of the security verification;

the process configured to detect, based on the at least two rear facing cameras, a user gesture on the paper document, wherein the user gesture is a command to digitally edit or highlight a portion of the paper document; and

the processor configured to retrieve additional information of the identified characteristics of the environment.

2. The mobile electronic device of claim 1 further comprising:

the processor is configured to utilize assistance information for the identification; and

wherein the assistance information is obtained, by the mobile electronic device, from the captured part of the environment.

3. The mobile electronic device of claim 1, wherein eye tracking is utilized to track position or location of the mobile electronic device.

4. The mobile electronic device of claim 1, wherein a timeline or history of the identified characteristics of the environment is retrieved.

5. A method performed by a mobile electronic device, the method comprising:

capturing, by at least two rear facing cameras of the mobile electronic device, a part of an environment and a part of a paper document in the environment;

capturing, by a camera and a depth sensor of the mobile electronic device, biometric facial information for security verification;

identifying, by a processor of the mobile electronic device, characteristics of the environment based on the captured part of the environment, the captured part of the paper document, and information received via a network adapter, wherein the identification is performed subsequent to a successful result of the security verification;

detecting, based on the at least two rear facing cameras by the processor a user gesture on the paper document, wherein the user gesture is a command to digitally edit or highlight a portion of the paper document; and

retrieving additional information of the identified characteristics of the environment.

6. The method of claim 5 further comprising:

utilizing, by the processor, assistance information for the identification; and

obtaining, by the mobile electronic device, the assistance information from the captured part of the environment.

7. The method of claim 5, wherein eye tracking is utilized to track position or location of the mobile electronic device.

8. The method of claim 5, wherein a timeline or history of the identified characteristics of the environment is retrieved.