Method for providing human input to a computer

• US 8,427,449 B2
• Filed: 07/23/2012
• Issued: 04/23/2013
• Est. Priority Date: 06/29/1995
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Pryor, Timothy R.
• Primary Examiner(s): ABDULSELAM, ABBAS I
• Application Number:
  US13/556,019
• Publication Number:
  US 20120287072A1
• Time in Patent Office: 274 Days
• Field of Search: 345/173, 178 1801- 1809, 178 1901- 1905, 463/30, 463/36, 715701-702, 340/407.1
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

The invention provides a method for providing human input to a computer which allows a user to interact with a display connected to the computer. The method includes the steps of placing a first target on a first portion of the user'"'"'s body, using an electro-optical sensing means, sensing data related to the location of the first target and data related to the location of a second portion of the user'"'"'s body, the first and second portions of the user'"'"'s body being movable relative to each other, providing an output of the electro-optical sensing means to the input of the computer, determining the location of the first target and the location of the second portion of the user'"'"'s body, and varying the output of the computer to the display based upon the determined locations for contemporaneous viewing by the user.

Claims

1. A method for controlling a computer system, comprising:

detecting first and second touch inputs on a touch screen of the computer system;

calculating a first centroid corresponding to the first touch input;

calculating a second centroid corresponding to the second touch input;

determining locations of the first and second touch inputs on the touch screen based on the first and second centroids, respectively;

detecting a change in the determined locations of the first and second touch inputs; and

performing an operation on the computer system in accordance with the detected change.

2. The method of claim 1, further comprising:

displaying one or more virtual controllers on the touch screen;

determining which one or more virtual controllers have received at least one of the first and second touch inputs; and

activating or deactivating applications corresponding to the determined virtual controllers.

3. The method of claim 2, wherein the performed operation comprises displaying a change of the displayed virtual controllers in accordance with the detected change in the determined locations of the first and second touch inputs.

4. The method of claim 1, further comprising:

displaying visually observable data on the touch screen,

wherein the performed operation comprises selecting a portion of the displayed data based on the determined locations of the first and second touch inputs and the detected change thereof.

5. The method of claim 1, wherein the detected change in the determined locations of the first and second touch inputs comprises a linear movement of at least one of the first and touch inputs along the display screen.

6. The method of claim 1, wherein the detected change in the determined locations of the first and second touch inputs comprises an arc-shaped movement of at least one of the first and touch inputs along the display.

7. The method of claim 1, wherein the first touch input includes at least one of a finger and a thumb in contact with the touch screen;

and the second touch input includes at least one of a finger and a thumb in contact with the touch screen.

8. The method of claim 1, wherein the first and second touch inputs are detected at about the same time.

9. The method of claim 1, wherein the touch screen is part of a control panel in a vehicle.

10. An electronic device comprising:

a touch sensitive surface having a display for displaying one or more virtual controllers; and

a processor capable of detecting first and second touch inputs on the touch sensitive surface, calculating a first centroid corresponding to the first touch input, calculating a second centroid corresponding to the second touch input, determining locations of the first and second touch inputs on the touch screen based on the first and second centroids, respectively, detecting a change in the determined locations of the first and second touch inputs, and performing an operation on the computer system in accordance with the detected change.

11. The device of claim 10, wherein the processor is further capable of causing one or more virtual controllers to be displayed on the display, determining which one or more virtual controllers have received at least one of the first and second touch inputs, and activating or deactivating applications corresponding to the determined virtual controllers.

12. The device of claim 11, wherein the performed operation comprises displaying a change of the displayed virtual controllers in accordance with the detected change in the determined locations of the first and second touch inputs.

13. The device of claim 10, wherein the processor is further capable of causing visually observable data to be displayed on the display, wherein the performed operation comprises selecting a portion of the displayed data based on the determined locations of the first and second touch inputs and the detected change thereof.

14. The device of claim 10, wherein the detected change in the determined locations of the first and second touch inputs comprises a linear movement of at least one of the first and touch inputs along the display screen.

15. The device of claim 10, wherein the detected change in the determined locations of the first and second touch inputs comprises an arc-shaped movement of at least one of the first and touch inputs along the display.

16. The device of claim 10, wherein the first touch input includes at least one of a finger and a thumb in contact with the touch screen;

and the second touch input includes at least one of a finger and a thumb in contact with the touch screen.

17. The device of claim 10, wherein the first and second touch inputs are detected at about the same time.

18. The device of claim 10, further comprising one or more optical sensors.