Sound-based virtual keyboard, device and method

• US 20060192763A1
• Filed: 02/25/2005
• Published: 08/31/2006
• Est. Priority Date: 02/25/2005
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Ziemkowski, Theodore B.
• Application Number:
  US11/066,748
• Publication Number:
  US 20060192763A1
• Time in Patent Office: Days
• US Class Current: 345/168
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A virtual input apparatus uses an array of transducers in contact with a sounding surface to detect a location of a sound or vibration transmitted by the sounding surface. A signal processor connected to an output of the transducer array provides data corresponding to a determined location of the vibration detected by the array. An electronic device includes a virtual keyboard that includes the array of transducers and device electronics. A method of entering data for the electronic device using the virtual keyboard includes creating a sound with a sounding surface that represents data to be entered into the electronic device by a user. The method further includes determining a point of origin of the created sound and mapping the determined point of origin into the data.

Claims

1. A virtual input apparatus comprising:

an array of vibration transducers; and

a signal processor connected to an output of the transducer array, an output of the signal processor providing data corresponding to a determined location of a vibration detected by the transducer array,

wherein the transducer array is in contact with a sounding surface, the sounding surface transmitting the vibration detected by the transducer array.

2. The virtual input apparatus of claim 1, further comprising:

a template that provides a guide to locations on the sounding surface relative to the transducer array, the locations representing virtual data,

wherein the location of the vibration corresponds to a location of the virtual data of the template, the virtual data corresponding to the data from the signal processor output.

3. The virtual input apparatus of claim 2, wherein the template is a keyboard template, keys of the keyboard template representing the virtual data, wherein the keyboard template is a sheet of material marked with key locations that mimic a keyboard.

4. The virtual input apparatus of claim 3, wherein the keyboard template is manipulatable for compact storage when not in use.

5. The virtual input apparatus of claim 2, wherein the template is a keyboard template that is an optical projection on the sounding surface, the projection providing key locations that mimic a keyboard.

6. The virtual input apparatus of claim 5, wherein the keyboard template is projected from an electronic device that comprises the virtual input apparatus, the projection being positioned on the sounding surface in relation to a location of the electronic device on the sounding surface.

7. The virtual input apparatus of claim 2, wherein the template is registered with respect to the transducer array using one or both of interactive registration and automatic registration.

8. The virtual input apparatus of claim 1, wherein the array of transducers comprises two or more transducers spaced apart from one another, the spaced apart transducers being arranged to form a planar geometric array pattern.

9. The virtual input apparatus of claim 8, wherein each transducer is located at a different vertex of the planar geometric array pattern.

10. The virtual input apparatus of claim 8, wherein the transducer array is incorporated into an electronic device that comprises the virtual input apparatus, the transducer array being adjacent to an external surface of the electronic device for direct contact to the sounding surface.

11. The virtual input apparatus of claim 1, wherein the signal processor determines the location of the vibration detected by the transducer array using a triangulation methodology.

12. The virtual input apparatus of claim 1, wherein the signal processor comprises a mapping function, the mapping function mapping the determined location into a stored key configuration, the key configuration being predetermined keys of a keyboard, the determined location of the vibration corresponding to a key and of the keyboard.

13. The virtual input apparatus of claim 1, wherein the signal processor is a processor of an electronic device that is equipped with the virtual input apparatus, the processor acting as the signal processor of the virtual input apparatus while receiving an input from the transducer array.

14. An electronic device comprising:

device electronics that provide functionality and control of the electronic device; and

a virtual keyboard that comprises an array of vibration transducers,

wherein the transducer array in contact with a sounding surface detects a location of a sound produced by a user of the electronic device whom is entering data, the transducer array providing a signal to the device electronics that is processed into data understood by the electronic device corresponding to data being entered by the user.

15. The electronic device of claim 14, wherein the device electronics comprise a controller;

an operational subsystem;

a memory subsystem; and

a control program that is stored in the memory subsystem, one or both of the virtual keyboard and the device electronics further comprising a signal processor,

wherein the controller executes the control program and controls the operational subsystem, the power subsystem and the memory subsystem.

16. The electronic device of claim 15, wherein the control program comprises a control portion and a virtual keyboard portion, the virtual keyboard portion comprising instructions that, when executed by the controller, implement converting the signal from the transducer array into a specific data input type, the instructions further implementing mapping the specific data input type into input data used by the electronic device.

17. The electronic device of claim 14, wherein the electronic device is one or both of a portable personal electronic device (PED) and a docking station for the PED, the PED being selected from one or more of a digital camera, a personal digital assistant (PDA), a remote control for an audio/visual system, a cellular telephone, a video game console, a portable video game unit, an MP3 player, a CD player, and DVD player.

18. A method of entering data for a portable electronic device using a virtual keyboard comprising:

creating a sound with a sounding surface, the sound representing data to be entered into the electronic device;

determining a point of origin of the created sound, the sound being transmitted from the point of origin to the virtual keyboard by the sounding surface; and

mapping the determined point of origin of the sound into the data.

19. The method of data entry of claim 18, wherein determining a point of origin comprises using an array of acoustic transducers in contact with the sounding surface;

and triangulating the point of origin of the created sound.

20. The method of data entry of claim 18, wherein mapping the determined point of origin comprises comparing the determined point of origin to a predefined map of data corresponding to specific point of origin locations, and selecting a particular data entry from a corresponding specific location.

21. The method of data entry of claim 18, further comprising employing a keyboard template to assist with creating the sound, the keyboard template providing predefined points of origin corresponding to a predetermined map used during mapping to convert the determined point of origin of the created sound into the data.

22. A virtual input apparatus for an electronic device comprising:

means for detecting a sound; and

means for processing signals from the means for detecting, wherein a signal represents a detected sound, an output of the means for processing signals providing data corresponding to a location of the sound detected by the means for detecting,

wherein the means for detecting is adjacent to a sounding surface, the sounding surface transmitting the sound detected by the means for detecting.

23. The virtual input apparatus of claim 22, wherein the means for detecting a sound comprises an array of sound transducers.

24. The virtual input apparatus of claim 22, wherein the means for processing signals is a signal processor of the electronic device.

25. The virtual input apparatus of claim 22, further comprising a means for defining a location on the sounding surface for data entry, the means for defining facilitating the data entry for a user of the electronic device.

26. The virtual input apparatus of claim 25, wherein the means for defining comprises a template that corresponds to the data understood by the electronic device.

27. The virtual input apparatus of claim 26, wherein the template is registered with respect to the means for detecting by one or both of interactive registration and automatic registration.

28. The virtual input apparatus of claim 22, wherein the location of the sound from the sounding surface represents a predefined key on a virtual keyboard, the means for processing signals converting the location of the detected sound into the data that corresponds to the predefined key of the virtual keyboard.

29. A virtual input apparatus for an electronic device comprising:

an electronic device; and

means for entering virtual data into the electronic device, the means for entering being in contact with a sounding surface,

wherein the virtual data is a determined location of a vibration on the sounding surface relative to the means for entering, the virtual data corresponding to actual data used by the electronic device.

30. The virtual input apparatus of claim 29, wherein the means for entering virtual data comprises:

means for detecting the vibration; and

means for converting the determined location into actual data, one or both of the detecting means and the converting means comprises means for determining the location of the vibration.

31. The virtual input apparatus of claim 29, wherein the determined location of the vibration corresponds to an actual key location on a virtual keyboard.

32. The virtual input apparatus of claim 29, wherein the means for entering comprises a transducer array in contact with the sounding surface,

wherein the transducer array provides a signal representing the determined location of the vibration to a processor of the electronic device, the processor converting the signal into the actual data,

and wherein the means for entering optionally further comprising a template in contact with the sounding surface that is positioned relative to the transducer array, the template defining locations on the sounding surface for a user of the electronic device, the locations correspond to the actual data understood by a user of the electronic device.

33. The virtual input apparatus of claim 32, wherein the optional template is a keyboard having defined locations of keys representing actual data, the processor comprising a stored keyboard map corresponding to the keyboard template, the processor using the stored map to convert the signal from the transducer array.

34. A virtual keyboard apparatus comprising:

an array of vibration transducers in contact with a sounding surface, the transducer array detecting a vibration transmitted by the sounding surface; and

a signal processor connected to an output of the transducer array, the signal processor comprising a stored keyboard map, an output of the signal processor providing data that represents a key of the keyboard map, the key corresponding to a determined location of the detected vibration.

35. The virtual keyboard apparatus of claim 34, further comprising:

a keyboard template that provides a guide to locations on the sounding surface relative to the transducer array, the keyboard template corresponding to the stored keyboard map, such that a location of the vibration corresponds to a location of a key of the keyboard template that corresponds to the key of the stored keyboard map.