RECONFIGURABLE TACTILE CONTROL DISPLAY APPLICATIONS

• US 20080024463A1
• Filed: 08/01/2007
• Published: 01/31/2008
• Est. Priority Date: 02/22/2001
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: PRYOR, Timothy
• Application Number:
  US11/832,134
• Publication Number:
  US 20080024463A1
• Time in Patent Office: Days
• US Class Current: 345/175
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60R 11/02 for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
• CPC Class Codes: B60R 11/0235 of flat type, e.g. LCD
• CPC Class Codes: B60R 2011/0005 Dashboard
• CPC Class Codes: B60R 2011/0007 Mid-console
• CPC Class Codes: B60R 2011/0012 Seats or parts thereof
• CPC Class Codes: B60R 2011/0028 Ceiling, e.g. roof rails
• CPC Class Codes: B60R 2011/0029 Floor, e.g. side sills, fire wall
• CPC Class Codes: B60R 2011/0042 characterised by mounting means
• CPC Class Codes: B60R 2011/0094 characterised by means for covering after user, e.g. boxes, shutters or the like
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

This case concerns applications of my Reconfigurable Tactile Display (RTD) invention, particularly illustrating method and apparatus in which there is no rigid connection between a projector/electro-optical sensor unit, and a screen and control surface unit used to display data and receive user touch or control inputs. In many embodiments, elimination of this rigid connection constraint allows applications where heretofore it has been difficult to provide workable or useful human interface systems. One example is in the headrest of an automobile, while another is a hospital bed where the invention provides a lightweight and very easy to clean input and viewing device for the patient.

Claims

1. A method for displaying and inputting information to a computer, comprising the steps of;

providing a computer;

providing a video projector to project visual information generated using said computer onto a display screen, said screen being movable with respect to said projector;

providing at least one electro-optical sensor;

using said sensor, electro-optically sensing information projected onto the screen or information inputted by the a user interacting with said screen; and

determining from said sensed information, an input to said computer.

2. A method according to claim 1 wherein said screen is easily removable from a housing or other a device to which it may be attached.

3. A method according to claim 1 wherein said screen is plastic.

4. A method according to claim 1 wherein said screen is easily stored.

5. A method according to claim 1 wherein said screen is easily cleaned.

6. A method according to claim 1 wherein said screen is located on the opposite side of a window from said projector and said sensor.

7. A method according to claim 1 wherein said screen is freely held by said user.

8. A method according to claim 1 wherein said freely held screen is sensed and this sensed data is used to align, correct, or modify either said sensed information or said displayed visual information.

9. A method according to claim 1 wherein said screen contains at least one physical control detail whose position or state is sensed.

10. A method according to claim 1 wherein said sensor is located in the same housing as said projection unit.

11. A method according to claim 10 wherein said projector and sensor are included in a mobile device.

20. A method according to claim 8 wherein said projection of video image is controlled so as to not project information past the screen edges.

21. A method according to claim 1 wherein said electro-optical sensor uses light outside the visible portions of the spectrum.

22. A method according to claim 1 in which sensed information is a touch gesture.

23. A method according to claim 1 in which the location of two or more fingers is sensed.

12. A method for providing video images and an interface thereto for persons in a vehicle seated behind a seat in front of them, comprising the steps of;

providing a video image projector in the seat ahead of said person;

projecting data from the projector is the onto a screen associated with the seat or the head rest of the seat ahead of the person;

sensing information concerning finger or control location on the screen; and

determining from said information, controlling images projected by said projector.

13. A method according to claim 12 wherein said images are obtained via the Internet.

14. A method according to claim 12 wherein said screen is plastic.

15. A method according to claim 12 wherein the surface of the screen is curved in at least some areas.

16. A method for presenting a larger size video image than would normally be possible in a constrained housing area in which physical controls are also present, comprising the steps of providing physical control details such as knobs or switches within the screen area of a screen substantially occupying said constrained housing area, and displaying an image which is viewable both around on within said control details, such that an observer of said image perceives an adequate view even though relatively small portions of the image are blocked by portions of said physical control details.

17. A method according to claim 16 wherein said constrained housing area is a center stack of a motor vehicle.

18. A method according to claim 16 wherein said constrained housing area is that of a mobile device such as a cell phone, remote control unit, or camera.

19. A method according to claim 16 wherein said image is projected on to said screen, and to a screen located within at least one of said control details.

24. A method for providing increased visibility of projected labels on control panels such as those of a vehicle instrument panel comprising the step of changing a projection variable related to said label, said change not being applied to a larger display area of which the label is a part.

25. A method according to claim 24 wherein said variable is a label color.

26. A method according to claim 24 wherein said variable is light source power.

27. A method according to claim 24 wherein said variable is the dwell time of projection of label information.