Detecting a document using one or more sensors

• US 9,578,200 B2
• Filed: 12/16/2015
• Issued: 02/21/2017
• Est. Priority Date: 05/24/2012
• Status: Active Grant

• Current Assignee: IP3 2017, Series 200 of Allied Security Trust I (Allied Security Trust)
• Original Assignee: HJ Laboratories, LLC
• Inventors: Vartanian, Harry, Jurikson-Rhodes, Jaron
• Primary Examiner(s): HOGUE, DENNIS A
• Application Number:
  US14/971,483
• Publication Number:
  US 20160100150A1
• Time in Patent Office: 433 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04N 1/00827 Arrangements for reading an image from an unusual original, e.g. 3-dimensional objects
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/61 based on recognised objects

Abstract

A mobile device may have a rear facing camera and a depth sensor to capture a portion of a document or a book in an environment. A processor may identify the document or the book based on the captured portion, a captured first part of the environment, a captured second part of the environment, and information received via a network adapter.

Claims

1. A mobile device comprising:

a rear facing camera and a depth sensor configured to capture a portion of a document or a book in an environment;

two or more cameras configured to capture a first part of the environment and to capture a second part of the environment;

a processor configured to identify the document or the book based on the captured portion, the captured first part of the environment, the captured second part of the environment, and information received via a network adapter; and

wherein tracking information of furniture the identified document or the book has been at is retrieved by the mobile device.

2. The mobile device of claim 1 further comprising:

the processor is configured to utilize assistance information for the identification of the document or the book; and

wherein the assistance information is obtained, by the mobile device, from the captured first part of the environment or the captured second part of the environment.

3. The mobile device of claim 1, wherein additional information related to the identified document or the book is received, by the mobile device via the network adapter, from a server.

4. A method performed by a mobile device, the method comprising:

capturing, by a rear facing camera and a depth sensor of the mobile device, a portion of a document or a book in an environment;

capturing, by two or more cameras of the mobile device, a first part of the environment and a second part of the environment;

identifying, by the mobile device, the document or the book based on the captured portion, the captured first part of the environment, the captured second part of the environment, and information received via a network adapter; and

wherein tracking information of furniture the identified document or the book has been at is retrieved by the mobile device.

5. The method of claim 4, further comprising:

utilizing, by the mobile device, assistance information for the identification of the document or the book; and

wherein the assistance information is obtained, by the mobile device, from the captured first part of the environment or the captured second part of the environment.

6. The method of claim 4, wherein additional information related to the identified document or the book is received, by the mobile device via the network adapter, from a server.

7. A mobile device comprising:

a rear facing camera and a depth sensor configured to capture a portion of a document in an environment;

two or more cameras configured to capture a first part of the environment and to capture a second part of the environment;

a processor configured to identify the paper document based on the captured portion, the captured first part of the environment, the captured second part of the environment, and information received via a network adapter; and

wherein tracking information of furniture the identified document has been at is retrieved by the mobile device.

8. The mobile device of claim 7 further comprising:

the processor is configured to utilize assistance information for the identification of the document; and

wherein the assistance information is obtained, by the mobile device, from the captured first part of the environment or the captured second part of the environment.

9. The mobile device of claim 7, wherein additional information related to the identified document is received, by the mobile device via the network adapter, from a server.