Computer system interface surface with reference points
First Claim
1. A method of enabling user interaction with computer software running in a computer system via:
- an interface surface having printed thereon;
visible information relating to the computer software, and a plurality of tags, each tag containing at least one perspective feature and coded data indicative of an identity of the interface surface and a location on the surface,said method comprising the steps of;
(a) placing a pen, having a nib and an optical sensor,in an operative position relative to the interface surface and sensing at least one tag;
(b) calculating a two-dimensional perspective transform of the tag using the sensed at least one perspective feature;
(c) generating indicating data using;
a known spatial relationship between the pen'"'"'s physical axis and the pen optical axis, said axes being different from each other;
the sensed coded data, andthe two-dimensional perspective transform,said indicating data identifying the identity of the interface surface and a position of the pen nib relative to the interface surface;
(d) sending the indicating data to a computer system,thereby enabling the computer systemto identify at least one interactive element relating to the computer software, andoperate the computer software in accordance with instructions associated with the at least one interactive element.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for enabling user interaction with computer software running in a computer system. A user is provided with an interface surface containing information relating to the computer software and including coded data indicative of an identity of the interface surface and of at least one reference point of the interface surface. The user places a sensing device into an operative position relative to the interface surface. In this operative position, the sensing device senses indicating data indicative of: the identity of the interface surface; and a position of the sensing device relative to the interface surface, using at least some of the coded data. The computer system receives the indicating data from the sensing device, and uses the indicating data to identify at least one interactive element relating to the computer software. The computer software is then operated in accordance with instructions associated with the at least one interactive element.
-
Citations
149 Claims
-
1. A method of enabling user interaction with computer software running in a computer system via:
-
an interface surface having printed thereon;
visible information relating to the computer software, and a plurality of tags, each tag containing at least one perspective feature and coded data indicative of an identity of the interface surface and a location on the surface,said method comprising the steps of; (a) placing a pen, having a nib and an optical sensor, in an operative position relative to the interface surface and sensing at least one tag; (b) calculating a two-dimensional perspective transform of the tag using the sensed at least one perspective feature; (c) generating indicating data using; a known spatial relationship between the pen'"'"'s physical axis and the pen optical axis, said axes being different from each other; the sensed coded data, and the two-dimensional perspective transform, said indicating data identifying the identity of the interface surface and a position of the pen nib relative to the interface surface; (d) sending the indicating data to a computer system, thereby enabling the computer system to identify at least one interactive element relating to the computer software, and operate the computer software in accordance with instructions associated with the at least one interactive element. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72)
-
-
73. A system for enabling user interaction with computer software running in a computer system, said system comprising:
-
an interface surface having printed thereon;
visible information relating to the computer software, and a plurality of tags, each tag containing at least one perspective feature and coded data indicative of an identity of the interface surface and a location on the surface; anda pen, having a nib, an optical sensor and a processor, configured for; a) sensing at least one tag; (b) calculating a two-dimensional perspective transform of the tag using the sensed at least one perspective feature; (c) generating indicating data using; a known spatial relationship between the pen'"'"'s physical axis and the pen optical axis, said axes being different from each other; the sensed coded data, and the two-dimensional perspective transform, said indicating data identifying the identity of the interface surface and a position of the pen nib relative to the interface surface; (d) sending the indicating data to a computer system, thereby enabling the computer system to identify at least one interactive element relating to the computer software, and operate the computer software in accordance with instructions associated with the at least one interactive element. - View Dependent Claims (74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149)
-
Specification