Universal computing device

• US 20040085286A1
• Filed: 10/31/2002
• Published: 05/06/2004
• Est. Priority Date: 10/31/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Jian, Zhang, ChunHui
• Granted Patent: US 7,009,594 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/03545 Pens or stylus

Abstract

A universal input device is described. The universal input device provides a common user interface for a variety of different computing platforms including printed documents. Using the present system, one may use the universal input device to control various computing devices as well as capture handwritten electronic ink and have the electronic in be associated with new or stored documents.

Claims

1. An input device for generating data representative of hand written strokes, the input device comprising:

an image capturing unit for capturing an image of an area of an object over which the input device is positioned and generating captured image data;

a processor processing the captured image data; and

a memory storing data.

2. An input device according to claim 1, wherein the image of the area over which the input device is positioned includes image data representative of a location of the area of the object.

3. An input device according to claim 2, wherein the image data representative of a location of the area of the object includes an image pattern representative of the location of the area of the object.

4. An input device according to claim 3, wherein the image pattern representative of the location of the area of the object includes a portion of a maze-like pattern.

5. An input device according to claim 2, wherein the image data representative of a location of the area of the object includes a coded reference representative of the location of the area of the object.

6. An input device according to claim 1, wherein the processor detects data within the captured image representative of a location of the area of the object.

7. An input device according to claim 1, wherein the processor detects data within the captured image and processes that data to determine a location of the area of the object.

8. An input device according to claim 1, wherein the processor processes the captured image data and creates an image file representing handwritten inputs.

9. An input device according to claim 1, wherein the image capturing unit captures multiple images of multiple areas of the object, and

the processor processes the captured images, detects data within the captured images representative of the location of the area over which the input device is located, and processes the detected data to generate information representative of user inputs.

10. An input device according to claim 9, wherein the data within the captured images representative of a location of the area of the object includes an image pattern representative of each location of each area of the object.

11. An input device according to claim 9, wherein the data within the captured images representative of a location of the area of the object includes a portion of a maze-like pattern.

12. An input device according to claim 9, wherein the data within the captured images representative of a location of the area of the object includes a coded reference representative of the location of the area of the object.

13. An input device according to claim 9, wherein the data within the captured images representative of a location of the area of the object includes a feature of the object appearing in more than one captured image.

14. An input device according to claim 13, wherein the processor performs a comparison of the locations of a feature of the object in multiple captured images to determine movement of the input device over the object.

15. An input device according to claim 1, wherein the object comprises a display of a computing device.

16. An input device according to claim 15, wherein the object comprises a display of a computing device including an image pattern representative of the location of an area within the display.

17. An input device according to claim 16, wherein the image pattern representative of the location of an area within the display is generated as part of the image produced on the display of the computing device.

18. An input device according to claim 16, wherein the image pattern representative of the location of an area within the display is formed in the structure of the display.

19. An input device according to claim 1, wherein the object comprises a writing surface.

20. An input device according to claim 19, wherein the writing surface includes an image pattern representative of the location of an area within the writing surface.

21. An input device according to claim 1, wherein the object comprises a non-uniform reflective surface.

22. An input device according to claim 1, the input device further including an inertial sensor for generating supplemental data representing movement of the input device.

23. An input device according to claim 22, wherein the processor processes the captured image data and the supplemental data and creates an image file representing handwritten inputs.

24. An input device according to claim 1, the input device further including a communication unit transmitting data representing movement of the input device to an external processing unit for generating signals representative of handwritten inputs.

25. An input device according to claim 10, the input device further including a communication unit transmitting data representative of handwritten inputs to an external processing unit.

26. An input device according to claim 1, wherein the input device is in the shape of a pen.

27. An input device for generating user inputs based on hand written strokes, the input device comprising:

an image capturing unit for capturing an image of an area of an object over which the input device is positioned and generating captured image data;

a controller controlling the image capture unit;

a memory storing data representing the captured image;

a processor processing the captured image data; and

a communication unit communicating with an external processing unit.

28. An input device according to claim 27, wherein the image of the object over which the input device is positioned includes image data representative of a location of the area of the object.

29. An input device according to claim 28, wherein the image data representative of a location of the area of the object includes an image pattern representative of the location of the area of the object.

30. An input device according to claim 29, wherein the image pattern representative of the location of the area of the object includes a portion of a maze-like pattern.

31. An input device according to claim 28, wherein the image data representative of a location of the area of the object includes a coded reference representative of the location of the area of the object.

32. An input device according to claim 27, wherein the processor processing the captured image data detects data within the captured image representative of a location of the area of the object.

33. An input device according to claim 27, wherein the processor processing the captured image data detects data within the captured image and processes that data to determine a location of the area of the object.

34. An input device according to claim 27, wherein the processor processes the captured image data and creates an image file representing user inputs.

35. An input device according to claim 27, wherein the object comprises a display of a computing device.

36. An input device according to claim 35, wherein the object comprises a display of a computing device including an image pattern representative of the location of an area within the display.

37. An input device according to claim 35, wherein the image pattern representative of the location of an area within the display is generated as part of the image produced on the display of the computing device.

38. An input device according to claim 35, wherein the image pattern representative of the location of an area within the display is formed in the structure of the display.

39. An input device according to claim 27, wherein the object comprises a writing surface.

40. An input device according to claim 39, wherein the writing surface includes an image pattern representative of the location of an area within the writing surface.

41. An input device according to claim 27, wherein the object comprises a non-uniform reflective surface.

42. An input device according to claim 27, the input device further including an inertial sensor for generating supplemental data representing movement of the input device.

43. An input device according to claim 42, wherein the processor processes the captured image data and the supplemental data and creates an image file representing user inputs.

44. An input device according to claim 27, wherein the communication unit transmits data representing movement of the input device to the external processing unit for generating signals representative of handwritten inputs.

45. An input device according to claim 27, wherein the communication unit transmits data representative of handwritten inputs to the external processing unit.

46. An input device according to claim 27, wherein the input device is in the shape of a pen.

47. A method for creating image information representing user inputs comprising the steps of:

positioning an input device over an area of an object;

capturing an image of the area of the object over which the input device is positioned;

generating data representing the location of the input device based on a captured image; and

creating an image file.

48. The method according to claim 47, wherein the captured image includes image data representative of a location of the area of the object.

49. The method according to claim 48, wherein the image data representative of a location of the area of the object includes an image pattern representative of the location of the area of the object.

50. The method according to claim 49, wherein the image pattern representative of the location of the area of the object includes a portion of a maze-like pattern.

51. The method according to claim 48, wherein the image data representative of a location of the area of the object includes a coded reference representative of the location of the area of the object.

52. The method according to claim 47, wherein generating data representing the location of the input device based on a captured image further includes detecting data within the captured image representative of a location of the area of the object.

53. The method according to claim 47, wherein generating data representing the location of the input device based on a captured image further includes detecting data within the captured image and processing that data to determine a location of the area of the object.

54. The method according to claim 47, wherein creating an image file further includes creating an image file representing handwritten inputs.

55. The method according to claim 47 further including

moving the input device over multiple areas of the object;

capturing multiple images of multiple areas of the object over which the input device is moved;

detecting data within the captured images representative of the location of the area over which the input device is located; and

generating information representing user inputs.

56. The method according to claim 47, wherein positioning an input device over an area of an object includes positioning the input device over a display of a computing device.

57. The method according to claim 56, wherein the computing device includes sensors for detecting the input device.

58. The method according to claim 47, wherein positioning an input device over an area of an object includes positioning the input device over a computing device including an image pattern representative of the location of an area within the display.

59. The method according to claim 47, wherein positioning an input device over an area of an object includes positioning the input device over a writing surface.

60. The method according to claim 47, wherein positioning an input device over an area of an object includes positioning the input device over a non-uniform reflective surface.

61. The method according to claim 47, further including generating supplemental data representing movement of the input device.

62. The method according to claim 61, wherein creating an image file includes processing the captured image data and the supplemental data and creating an image file representing handwritten inputs.

63. The method according to claim 62, wherein the supplemental data is generated by sensors in addition to sensors for capturing an image.

64. The method according to claim 63, wherein the additional sensors are formed as part of the object over which the input device is positioned.

65. The method according to claim 64, wherein the object over which the input device is positioned includes a display including sensors for sensing movement of the input device.

66. The method according to claim 63, wherein the additional sensors are formed as part of the input device.

67. The method according to claim 47, further including

transmitting data representing the captured image from the input device to an external processing unit;

generating data representing the location of the input device based on the transmitted data; and

creating an image representative of handwritten user inputs.

68. The method according to claim 47, further including transmitting data representative of handwritten inputs to an external processing unit.

69. A method for creating image information representing user inputs on a plurality of computing devices comprising the steps of:

positioning an input device over an area of an object;

capturing an image of the area of the object over which the input device is positioned including information representing the location of the input device; and

converting the captured image data into a format for use on a computing device.

70. The method according to claim 69, wherein converting the captured image data into a format for use on a computing device includes converting the data into a format suitable for use on a plurality of computing devices.

71. The method according to claim 69, wherein converting the captured image data into a format for use on a computing device includes detecting a computing device for which the data is intended.

72. The method according to claim 71, wherein the step of detecting a computing device for which the image data is intended is based on communications between the input device and the computing device.

73. The method according to claim 71, wherein the step of detecting a computing device for which the image data is intended is based on an input by the user to the input device.

74. The method according to claim 69, further including generating data representing the location of the input device based on the captured image data.