Personal interfaces for independent living and health

• US 7,675,504 B1
• Filed: 03/09/2006
• Issued: 03/09/2010
• Est. Priority Date: 10/10/2001
• Status: Expired due to Fees

• Current Assignee: PSTP Technologies, LLC
• Original Assignee: Peter H. Smith, Timothy R. Pryor
• Inventors: Pryor, Timothy R., Smith, Peter H.
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US11/371,224
• Time in Patent Office: 1,461 Days
• Field of Search: 345/156, 345/173, 345/158, 382/176, 358/1.12, 358/1.18, 358/2.1, 358/464, 358/527
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

The invention herein primarily concerns computer interfaces, particularly those that may be used by senior citizens or others who are not familiar and even adverse to computers as they are utilized today. Applications of use to such persons are also disclosed, particularly in the areas of most concern to large segments of the population such as Health Maintenance and Medical, Home Control, and Communication (email and telephony). It is primarily based on TV cameras interfaced to computers via common interfaces such as USB2, Fire wire, or WiFi, which are used to sense common, and familiar paper pages and books of pages.

Claims

1. A method for producing a computer output which is associated with a user action comprising the steps of:

providing a page with identifying and control indicia thereon;

initially creating a data base in a memory of a computer, said creating step including the steps of

imaging the page with a camera and associating the identifying information on the page with the imaged page,

identifying a selected portion of the imaged page including control indicia which is to be associated with a specified computer output,

storing the identifying information of the page and the identified selected portion of the page in the memory of the computer, and

determining a specified computer output to be associated with a user locating an object at the selected portion of the page;

subsequently placing of the page by the user in a position to be imaged by a camera, and locating of an object at the selected portion of the page by the user;

analyzing the image of the placed page with the computer to associate the page placed by the user with the identifying information of the page in the data base,

further analyzing the image of the placed page with the computer to determine if an object was located at the selected portion of the placed page by the user;

outputting of the computer output associated with the selected portion of the page if the object was located at the selected portion of the placed page by the user.

2. A method according to claim 1 wherein said page is a sheet of paper.

3. A method according to claim 1 wherein said page is part of a book or other related collection of sheets.

4. A method according to claim 1 wherein said object is a marker placed on the page by a user.

5. A method according to claim 1 wherein said object is a finger of a user.

6. A method according to claim 1 wherein color of information on said page or said object is used in said analysis.

7. A method according to claim 1 including the further step of correcting alignment of said image as part of said analysis steps.

8. A method according to claim 1 including the further step of sensing another finger location on said page or on a further member.

9. A method according to claim 1 including the further step of identifying the user and storing information relating to pages of said user.

10. A method according to claim 1 wherein said camera is located at an acute angle to said page in a position away from said user.

11. A method according to claim 1 wherein said page is identified by comparison with patterns of pages in a data base.

12. A method according to claim 1 wherein said page is identified by comparison with a color based code on the page.