Enabling a visually impaired or blind person to have access to information printed on a physical document

• US 10,276,065 B2
• Filed: 04/27/2015
• Issued: 04/30/2019
• Est. Priority Date: 04/18/2003
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Carro, Fernando Incertis, Trewin, Sharon M.
• Primary Examiner(s): Theriault, Steven B
• Application Number:
  US14/696,815
• Publication Number:
  US 20150242096A1
• Time in Patent Office: 1,464 Days
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A method and system for accessing information related to a physical document. An electronic copy of an existing physical document is identified and located. The electronic copy of the physical document is an exact replica of the physical document. A selected part of the physical document is identified and in response, data related to the selected part of the physical document is retrieved from the electronic copy of the physical document. The retrieved data is presented visually to a visually impaired person or orally to a blind person on the user system, which enables the visually impaired person to see or hear, respectively, the retrieved data.

Claims

1. A method for use in a user system, for accessing information related to a physical document, said method comprising:

identifying and locating an electronic copy of an existing physical document, wherein the electronic copy of the physical document is an exact replica of the physical document;

identifying a selected part of the physical document by identifying a specifically selected start point and a specifically selected end point on one page of the physical document to define the selected part of the physical document on the one page, said selected part of the physical document consisting of first text contiguously extending from the start point to the end point, said one page consisting of the first text and a remaining part of the one page, said first text encompassing a plurality of lines of text and a plurality of distinct words on the first page, said identifying the selected part of the physical document comprising receiving an identification of the start point and the end point pressed, with a fingertip or a pen, on a touch foil placed and aligned over or under the one page;

in response to said identifying the selected part of the physical document, retrieving text data from the electronic copy of the physical document, said text data retrieved from the electronic copy corresponding to, and being identical to, the first text selected from the physical document; and

presenting information visually to a visually impaired person, wherein said presenting the information visually is configured to enable the visually impaired person to see the information, and wherein the information presented visually consists of the retrieved text data,

wherein said presenting the retrieved text data visually comprises;

magnifying the retrieved text data on a screen such that the magnified retrieved text data can be visually read by the visually impaired person, wherein said magnifying the retrieved text data on the screen comprises magnifying on the screen the electronic copy of the selected part of the physical document;

or

enhancing on the screen the electronic copy of the selected part of the physical document to match a preferred reading view of the visually impaired person.

2. The method of claim 1, wherein said identifying the physical document comprises:

reading, by means of a barcode reader, a document identifier printed on the physical document at a predefined position.

3. The method of claim 1, wherein said receiving the identification of the start point and the end point comprises receiving the identification of the start point and the end point with the fingertip or the pen, on the touch foil placed and aligned over the one page.

4. The method of claim 1, wherein said receiving the identification of the start point and the end point comprises receiving the identification of the start point and the end point with the fingertip or the pen, on the touch foil placed and aligned under the one page.

5. The method of claim 1, wherein either the electronic copy of the physical document is located on the user system or the electronic copy of the physical document is located on one server of a plurality of servers to which the user system is connected via a communication network.

6. The method of claim 1, wherein the physical document comprises Braille indications.

7. A user system, comprising a computer;

and a non-transitory storage device containing instructions which, upon being executed by the computer, implement a method for accessing information related to a physical document, said method comprising;

identifying and locating an electronic copy of an existing physical document, wherein the electronic copy of the physical document is an exact replica of the physical document;

identifying a selected part of the physical document by identifying a specifically selected start point and a specifically selected end point on one page of the physical document to define the selected part of the physical document on the one page, said selected part of the physical document consisting of first text contiguously extending from the start point to the end point, said one page consisting of the first text and a remaining part of the one page, said first text encompassing a plurality of lines of text and a plurality of distinct words on the first page, said identifying the selected part of the physical document comprising receiving an identification of the start point and the end point pressed, with a fingertip or a pen, on a touch foil placed and aligned over or under the one page;

in response to said identifying the selected part of the physical document, retrieving text data from the electronic copy of the physical document, said text data retrieved from the electronic copy corresponding to, and being identical to, the first text selected from the physical document; and

presenting information visually to a visually impaired person, wherein said presenting the information visually is configured to enable the visually impaired person to see the information, and wherein the information presented visually consists of the retrieved text data,

wherein said presenting the retrieved text data visually comprises;

magnifying the retrieved text data on a screen such that the magnified retrieved text data can be visually read by the visually impaired person, wherein said magnifying the retrieved text data on the screen comprises magnifying on the screen the electronic copy of the selected part of the physical document;

or

enhancing on the screen the electronic copy of the selected part of the physical document to match a preferred reading view of the visually impaired person.

8. The user system of claim 7, wherein said receiving the identification of the start point and the end point comprises receiving the identification of the start point and the end point with the fingertip or the pen, on the touch foil placed and aligned over the one page.

9. The user system of claim 7, wherein said receiving the identification of the start point and the end point comprises receiving the identification of the start point and the end point with the fingertip or the pen, on the touch foil placed and aligned under the one page.

10. The user system of claim 7, wherein either the electronic copy of the physical document is located on the user system or the electronic copy of the physical document is located on one server of a plurality of servers to which the user system is connected via a communication network.

11. A non-transitory storage device comprising instructions for which, upon being executed by a computer, implement a method for use in a user system, for accessing information related to a physical document, said method comprising:

identifying and locating an electronic copy of an existing physical document, wherein the electronic copy of the physical document is an exact replica of the physical document;

identifying a selected part of the physical document by identifying a specifically selected start point and a specifically selected end point on one page of the physical document to define the selected part of the physical document on the one page, said selected part of the physical document consisting of first text contiguously extending from the start point to the end point, said one page consisting of the first text and a remaining part of the one page, said first text encompassing a plurality of lines of text and a plurality of distinct words on the first page, said identifying the selected part of the physical document comprising receiving an identification of the start point and the end point pressed, with a fingertip or a pen, on a touch foil placed and aligned over or under the one page;

in response to said identifying the selected part of the physical document, retrieving text data from the electronic copy of the physical document, said text data retrieved from the electronic copy corresponding to, and being identical to, the first text selected from the physical document; and

presenting information visually to a visually impaired person, wherein said presenting the information visually is configured to enable the visually impaired person to see the information, and wherein the information presented visually consists of the retrieved text data,

wherein said presenting the retrieved text data visually comprises;

magnifying the retrieved text data on a screen such that the magnified retrieved text data can be visually read by the visually impaired person, wherein said magnifying the retrieved text data on the screen comprises magnifying on the screen the electronic copy of the selected part of the physical document;

or

enhancing on the screen the electronic copy of the selected part of the physical document to match a preferred reading view of the visually impaired person.

12. The non-transitory storage device of claim 11, wherein said receiving the identification of the start point and the end point comprises receiving the identification of the start point and the end point with the fingertip or the pen, on the touch foil placed and aligned over the one page.

13. The non-transitory storage device of claim 11, wherein said receiving the identification of the start point and the end point comprises receiving the identification of the start point and the end point with the fingertip or the pen, on the touch foil placed and aligned under the one page.

14. The non-transitory storage device of claim 11, wherein either the electronic copy of the physical document is located on the user system or the electronic copy of the physical document is located on one server of a plurality of servers to which the user system is connected via a communication network.