System and method implementing non-physical pointers for computer devices

• US 6,977,643 B2
• Filed: 08/22/2002
• Issued: 12/20/2005
• Est. Priority Date: 01/10/2002
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kelley, Edward E., Wilbrink, Tijs
• Primary Examiner(s): Osorio, Ricardo
• Application Number:
  US10/227,359
• Publication Number:
  US 20030128188A1
• Time in Patent Office: 1,216 Days
• Field of Search: 345/156, 345/173, 345/168, 715/773, 715/799
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A system and method for providing input to a handheld computing device by provisioning the handheld computing device with a device for projecting images generated as a result of applications executing on the computer device on a surface in front of a user located proximate said device, a projected image including an active screen display corresponding to an application executing in the device. A further projected image includes an object image located within the active screen display and representing a pointer to locations within the projected active screen display. The system detects the presence of an object located at the surface and within a projected image display area, and converts detected movement of the object located within a projected image display area on the surface into movement of the object image within the projected active screen display. The user is thus able to initiate a data input operation or execute a function at a location in the active screen display for the executing application.

Claims

1. A user input system for a computer device comprising:

a projecting device for projecting images for display on a surface in front of a user located proximate said device, a projected image including an active screen display corresponding to an application executing in said device, another projected image including an object image located within the active screen display and representing means for pointing to locations within said projected active screen display;

a signal detection system for detecting the presence of an object located at said surface in front of a user located and within a projected image display area; and

,

mechanism for converting detected movement of said object located within a projected image display area on said surface into movement of said object image within said projected active screen display to facilitate data input functions at locations in said active screen display for said executing application,

wherein a projected image for display on a surface further includes a dynamic keypad image having function keys for executing functions, said converting mechanism further converting detected movement of said object located within a projected image display area for dynamically moving said projected keypad image and keys on said surface in accordance with said object movement.

2. The user input system for a computer device according to claim 1, wherein said signal detection system is capable of detecting objects at locations within a limited range defined by said projected image.

3. The user input system for a computer device according to claim 2, wherein said signal detection system includes an electromagnetic signal transmitter means for iteratively transmitting series of electromagnetic signals sweeping said limited range, and receiving electromagnetic signal reflections from detected objects, wherein said electromagnetic signal transmitter means is located a predetermined distance away from said graphical representation.

4. The user input system for a computer device according to claim 1, wherein said object located at said surface in front of a user includes a finger of a user of said computer device.

5. The user input system for a computer device according to claim 1, further comprising means for selecting the active screen display of an executing application for projection on said surface.

6. The user input system for a computer device according to claim 1, wherein a projected image for display on a surface includes an image of a computer keyboard device, said signal detection system for detecting the presence of an object at locations corresponding to keys of said keyboard device.

7. The user input system for a computer device according to claim 1, further comprising means for deactivating projection of said keyboard image when projecting said keypad display.

8. The user input system for a computer device according to claim 1, wherein said dynamic keypad function keys include first and second keys, a first key representing a user-selectable function;

and, a second key for initiating a prior defined function for assigning said user-selected function to a first key.

9. The user input system for a computer device according to claim 8, wherein a prior defined function includes one or more of:

user macros and system functions and combinations thereof.

10. The user input system for a computer device according to claim 8, wherein a user-selected function corresponds to a function of a software application capable of being executed on said computer device, said second key automatically initiating functionality for adding one or more functions of an application to one or more first keys.

11. The user input system for a computer device according to claim 10, further including means for generating a menu having choices of further user-specified functions for projected display in response to selection of a first key.

12. The user input system for a computer device according to claim 11, further comprising means for generating and storing user preferences in a user preference file, a user preference including said menu choice functions for association with a first key.

13. The user input system for a computer device according to claim 1, further comprising means for customizing function of said keypad keys activated with said dynamic key pad image.

14. A method for inputting data in a computer device comprising:

a) projecting images generated as a result of applications executing on said computer device on a surface in front of a user located proximate said device, a projected image including an active screen display corresponding to an application executing in said device, another projected image including an object image located within the active screen display and representing means for pointing to locations within said projected active screen display;

b) detecting the presence of an object located at said surface in front of a user located and within a projected image display area; and

,

c) converting detected movement of said object located within a projected image display area on said surface into movement of said object image within said projected active screen display,

d) initiating a data input function at a location in said active screen display for said executing application,

wherein a projected image for display on a surface further includes a dynamic keypad image having function keys for executing functions, said converting step further including converting detected movement of said object located within a projected image display area for dynamically moving said projected keypad image and keys on said surface in accordance with said object movement.

15. The method according to claim 14, wherein said detecting of objects includes objects located within a range defined by said projected image.

16. The method according to claim 15, wherein said detecting step b) includes the steps of:

transmitting electromagnetic signals in an iterative manner for sweeping said defined range; and

,

receiving electromagnetic signal reflections from detected objects.

17. The method according to claim 15, wherein said object located at said surface in front of a user includes a finger of a user of said computer device.

18. The method according to claim 15, wherein projecting step a) includes the step of:

user-selecting an active screen display of an executing application for projection on said surface.

19. The method according to claim 15, wherein a projected image for display on a surface includes an image of a computer keyboard device, said detecting including detecting the presence of an object at locations corresponding to keys of said keyboard device.

20. The method according to claim 19, further comprising the step of:

deactivating projection of said keyboard image when projecting said keypad display.

21. The method according to claim 14, wherein said dynamic keypad function keys include first and second keys, said method including assigning of user-selectable functions to a first key, said assigning in response to user-selecting a second key for initiating a prior defined assigning function.

22. The method according to claim 21, wherein a prior defined function includes one or more of:

user macros and system functions.

23. The method according to claim 21, wherein a prior defined function corresponds to a function of a software application capable of being executed on said computer device, said method including automatically initiating functionality for adding one or more functions of a software application to one or more first keys.

24. The method according to claim 23, further including the step of generating a menu having choices of further user-specified functions for projected display in response to selection of a first key.

25. The method according to claim 24, further including the step of generating and storing user preferences in a user preference file, a user preference including said menu choice functions associated with a first key.

26. The method according to claim 14, further comprising the step of customizing function of said keypad keys activated with said dynamic key pad image.

27. A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for inputting data in a computer device, the method comprising steps of:

a) projecting images generated as a result of applications executing on said computer device on a surface in front of a user located proximate said device, a projected image including an active screen display corresponding to an application executing in said device, another projected image including an object image located within the active screen display and representing means for pointing to locations within said projected active screen display;

b) detecting the presence of an object located at said surface in front of a user located and within a projected image display area; and

,

c) converting detected movement of said object located within a projected image display area on said surface into movement of said object image within said projected active screen display,

d) initiating a data input function at a location in said active screen display for said executing application,

wherein said projected image for display on a surface includes a dynamic keypad image having function keys for executing functions, said converting step further including converting detected movement of said object located within a projected image display area for dynamically moving said projected keypad image and keys on said surface in accordance with said object movement.

28. The program storage device readable by machine according to claim 27, wherein projecting step a) includes the step of:

user-selecting an active screen display of an executing application for projection on said surface.