COMPACT RTD INSTRUMENT PANELS AND COMPUTER INTERFACES

• US 20080088587A1
• Filed: 09/10/2007
• Published: 04/17/2008
• Est. Priority Date: 02/22/2001
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Pryor, Timothy
• Application Number:
  US11/852,690
• Publication Number:
  US 20080088587A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: H04N 9/3129 scanning a light beam on the display screen scanning a light beam on a screen in displays other than projection devices G09G3/02; scanning systems in general G02B26/10; projectors using laser light sources in general H04N9/3161

Abstract

This concerns my RTD invention disclosed in co pending applications, particularly but not necessarily for use in the “center stack” region of vehicle instrument panels. Disclosed are novel prism devices to shrink the size of the unit, while increasing resistance to vibration and condensation and providing easier assembly into the vehicle. Also disclosed are methods to improve the efficiency of such projector based systems for delivering display light to the driver of the vehicle, as well as to reduce noise caused by backscatter from the screen and control surface, or sunlight coming through the windshield. RTD versions for home or office use are also disclosed, including a ““cushion computer”-like device meant primarily for use on one'"'"'s lap and optionally having a reconfigurable keyboard. The device can also serve as a TV remote and perform other useful functions in the home, workplace, or car, and may serve as a useful interface accessory to expand the usability and enjoyment of mobile devices.

Claims

1. A rear projection display, comprising:

a computer controlled video projector;

a screen on which information projected by said video projector is displayed; and

a solid plastic optical member having at least one internal reflecting surface and whose exit surface is of an extent similar to said screen.

2. Apparatus according to claim 1, wherein said screen is curved.

3. Apparatus according to claim 1, wherein said screen is attached to, or is provided on, said optical member.

4. Apparatus according to claim 1, wherein said projector is attached to said optical member.

5. Apparatus according to claim 1, further including an electro optical sensor for sensing objects on or in front of said screen.

6. A human interface for a vehicle comprising:

a computer driven video projector;

a screen and control surface on which video images are projected and where a user inputs commands using one or more fingers and/or by actuating a physical control detail located on said surface; and

a housing containing said screen and control surface and said projector, said housing adapted to fit into a slot in the instrument panel of said vehicle.

7. Apparatus according to claim 6, wherein the projected image on said screen is at least as big as the available area of the slot in the panel.

8. Apparatus according to claim 7, wherein said screen area is larger than the slot area, and the screen protrudes from the surface of the instrument panel.

9. Apparatus according to claim 6, further including an electro optical sensor means to sense user input commands.

10. Apparatus according to claim 6, wherein said commands relate to control of audio or video functions.

11. Sensing apparatus for use with a rear projection display comprising:

a rear projection screen on which images are displayed;

a light source for illuminating objects on or proximate said screen, said light source being polarized in a first direction;

a first quarter wave plate to rotate the plane of polarization of light from said light source prior to passing through said rear projection screen;

a second quarter wave plate to rotate light returning from said objects after passing back through said rear projection screen; and

an electro-optical sensing system to sense light returning from at least one of said objects, said sensing system including a polarizer whose direction of polarization is orthogonal to said first polarization direction.

12. Apparatus according to claim 11, wherein said first and second quarter wave plates are the same plate, and light passes through said plate in both directions.

13. Apparatus according to claim 11, wherein the wavelength of said light is in the near infra-red.

14. Apparatus according to claim 11, wherein said light source is a laser.

15. A method for preferentially increasing the visibility of information on a portion of a display screen comprising the steps of:

determining that a person is interacting with the screen or objects thereon in a region comprising a portion of the screen; and

using said determination, increasing the visibility of information projected in said region.

16. A method according to claim 15, wherein the light source illuminating said screen preferentially delivers more intensity to said region.

17. A method according to claim 15, wherein one or more colors of light are changed in said region.

18. A method according to claim 15, wherein the light source illuminating said screen preferentially remains on longer in said region.

19. A method according to claim 15, wherein said information is a textural or graphic label of a control function.

20. A method according to claim 15, wherein said display is provided by rear projection.

21. A lightweight human interface to a computer comprising:

a housing having a base surface;

a screen in said housing opposite said base surface;

an image display device for displaying video or graphical information on said screen;

an electro optical sensor for determining data relating to one or more objects on or proximate said screen;

communication means for communicating sensed information to a remote computer system and for receiving information from said remote computer system in response to said communicated sensed information; and

display control means for controlling said image display device using said received information.

22. Apparatus according to claim 21, wherein said image display device is a video image projector which projects information on said screen.

23. Apparatus according to claim 21, wherein said screen is tilted at an angle to said base.

24. Apparatus according to claim 21, wherein said wherein the design of said human interface is optimized for use on the lap of a user.

25. Apparatus according to claim 21, wherein said interface controls audio and visual functions of said remote computer system.

26. Apparatus according to claim 21, including further means to substantially seal the human interface against liquid entry.

27. Apparatus according to claim 21, wherein said wherein said screen is plastic.

28. Apparatus according to claim 21, wherein said wherein said housing is padded to absorb shock, increase safety, and provide a comfortable feel.

29. Apparatus according to claim 21, wherein said objects include a thumb or a finger of a user.

30. Apparatus according to claim 21, wherein said objects are physical control details used by a user to control a variable utilized by said computer system.

31. Apparatus according to claim 21, wherein said screen is curved.

32. Apparatus according to claim 21, wherein said screen is interchangeable with other screens having different physical configurations or shapes.

33. Apparatus according to claim 21, wherein said screen has a diagonal extent greater than 17 inches.

34. Apparatus according to claim 21, wherein said screen incorporates a tactile keyboard.

35. Apparatus according to claim 21, wherein a virtual keyboard is displayed on said screen.

36. Apparatus according to claim 22, wherein said sensor is incorporated with said projector.

37. Apparatus according to claim 21, wherein a plurality of objects are sensed simultaneously.

38. Apparatus according to claim 21, wherein a finger gesture is sensed.

39. Apparatus according to claim 21, wherein said interface communicates with a computer system controlling the audio or video entertainment system of a vehicle.

40. Apparatus according to claim 39, including attachment means to attach said human interface to a vehicle seat ahead of the user, an instrument panel of said vehicle, or another portion of the vehicle interior.

41. Apparatus according to claim 39, wherein said vehicle is selected from a group comprising cars, trucks, airplanes, and boats.

42. Apparatus according to claims 21, said housing further including an audio signal source for providing audio information to a user.

43. A human interface accessory for a portable computing device comprising:

a housing including an image display screen;

an image display device for displaying video or graphical information on said screen;

an electro-optical sensor for sensing information concerning at least one object on or proximate said screen; and

a means to connect a portable computing device to said sensor and said image display device to allow a user to interact via said screen with said portable computing device.

44. Apparatus according to claim 43, wherein said portable computing device is a smart cellular phone.

45. Apparatus according to claim 43, wherein said image display device is a video image projector.

46. Apparatus according to claim 43, wherein said portable computing device may be docked in said housing and said housing folds for ease of carrying.

47. Apparatus according to claim 43, wherein said at least one object is a finger or thumb of a user.

48. Apparatus according to claim 47, wherein a finger gesture on said screen made by said user is sensed.

49. Apparatus according to claim 43, wherein a plurality of said objects are sensed simultaneously.

50. Apparatus according to claim 43, wherein said portable computing device includes said projector.

501. Apparatus according to claim 43, wherein said portable computing device includes said electro-optical sensor.

52. Apparatus according to claims 43, said housing further including an audio signal source for providing audio information to a user.

53. A human interface to a computer for use on the lap of a user comprising:

a housing having a base surface;

a display screen attached to said housing opposite said base surface and fixed in position at an angle to said base and pointing generally toward said users eyes;

an image display device for displaying video or graphical information on said screen;

an electro optical sensor for determining data relating to one or more objects on, or proximate to, said screen;

a processing means to determine information from said sensed data used to control said computer; and

a means for controlling said image display device using information from said computer.

54. Apparatus according to claim 53, including attachment means to attach said human interface to a vehicle seat ahead of the user, an instrument panel of said vehicle, or another portion of the vehicle interior.

55. Apparatus according to claim 53, wherein said image display device is a video image projector for projecting information on said screen.

56. Apparatus according to claim 53, wherein said one or more objects are chosen from a group comprising a users finger, a users thumb, a writing instrument, a drawing instrument, and a physical control detail such as a knob, slider, or switch.

57. Apparatus according to claim 53, wherein a finger gesture is sensed.

58. Apparatus according to claim 53, wherein said screen is interchangeable with other screens having different physical configurations or shapes.

59. Apparatus according to claim 53, wherein a plurality of objects are sensed simultaneously.

60. Apparatus according to claim 53, wherein said wherein said screen is both plastic and curvilinear in at least a portion thereof.

61. Apparatus according to claims 53, said housing further including an audio signal source for providing audio information to a user.

62. A control panel having variable size labeling for control functions thereof, said labels being largest for those control functions which are in actively in use.

63. A human interface to a computer having a display with a screen containing tactile relief details to reference the location of a users finger on the screen.

64. A human interface according to claim 63, wherein said display is a rear projection display.

65. A human interface according to claim 63, wherein said relief detail is chosen from a group comprised of ridges, indents, bumps, grooves and regions of different surface roughness than surrounding regions.

66. A human interface according to claim 63, wherein said relief detail is of a dimension that does not substantially alter displayed images viewed through said detail.

67. A method for sensing information concerning at least one object on a users side of a rear projection screen comprising the steps of:

providing an electro-optical sensing means and an electro-optical illumination means on the projection side of said screen;

optimizing at least one of said illumination and said sensing means as a function of ambient light on the users side of said screen; and

determining from said electro optical sensing means the position or orientation of at least one object in contact with said screen or in close proximity thereto.

68. A method according to claim 67, wherein said at least one object is a physical control detail.

69. A method according to claim 67, wherein said at least one object is the tip of a users finger or thumb.

70. A method according to claim 67, wherein said screen is substantially horizontal and said at least one object is resting on said screen.

71. A method according to claim 67, wherein two or more objects are sensed simultaneously.

72. A method according to claim 67, wherein at least one contrasting target on said at least one object is sensed.

73. A method for controlling a computer based system comprising:

providing a rear projection display controlled by a computer, said display having an outer surface;

projecting an image of at least one control device on said display;

providing an electro optical sensing means for sensing at least one finger of a user contacting said outer display surface in the vicinity of said projected at least one control device image;

using data from said sensing means, and said computer, determining movement of said finger or fingers indicative of a desired change in said at least one control device;

controlling said system as a result of said sensed movement; and

displaying a new image for said at least one control device resulting from said movement.

74. A method according to claim 73, wherein said physical control detail is selected from a group comprising a knob, slider, switch, or dial.

75. A reconfigurable control system, comprising:

a rear projection display including a projector and a display screen;

a plurality of physical control details mounted to said screen;

a sensing system to sense the position of said plurality of control details;

a computer to control said projector and determine from said sensed control detail positions the desired inputs to said control system; and

a means to reconfigure said control system from one set of displayed control functions to another.

76. A method for providing different user interface experiences using the same computer based display device, comprising the steps of:

providing a rear projection and computer based display and human interface having a screen and interaction surface on which projected information is displayed for a user to interact with;

providing sensing means to sense objects on or in front of said screen and interaction surface;

providing an initial display screen and associated display software; and

removing said initial screen and substituting a second screen and associated display and sensing software, said second screen being physically different than said initial screen.

77. A method according to claim 76, wherein at least a portion of said second screen varies in shape from said initial screen.

78. A method according to claim 76, wherein at least a portion of said second screen varies in tactile relief from said initial screen.

79. A method according to claim 76, wherein at least one different physical control is mounted to said second screen than is present on said initial screen.

80. A computer based display and human interface apparatus, comprising:

a housing;

a screen and human interaction surface attached to said housing;

a computer based rear projection display device located within said housing to project data onto said screen;

sensing means to sense objects on or in front of said screen and interaction surface; and

computer means to control said sensing means and display means, said computer containing software associated with a particular screen and human interaction surface and adapted to work with further sensing and display software corresponding to other physically different screens and human interaction surfaces.