Surface computer system and method for integrating display of user interface with physical objects
First Claim
1. A surface computer, comprising:
- an interactive display surface configured to;
display visual output,detect placement of a physical document on the interactive display surface; and
optically scan the physical document to obtain encoded data,wherein the physical document possesses the encoded data, andwherein the encoded data includes data other than data directly identifying the physical document; and
a computer-readable storage medium storing program instructions executable to implement one or more software applications;
wherein in response to the interactive display surface optically scanning the physical document, the surface computer is configured to;
determine, based on the encoded data, a document type from a plurality of document types; and
based on the encoded data and the document type, identify, from a plurality of software applications, a software application capable of functioning in concert with the encoded data, wherein the software application comprises a plurality of application data items; and
wherein, in response to the identifying, the interactive display surface is further configured to;
display a user interface for the software application;
receive user input via a portion of the physical document;
visibly distinguish, based on the user input and software application, the portion of the physical document at a position physically matching the portion of the physical document that received the user input;
select a first application data item of the plurality of application data items based on a relationship between the first application data item and the portion of the physical document; and
display the first application data item.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for assisting user interaction with physical objects. A system may include an interactive display surface configured to display visual output and receive a physical object, where the object possesses encoded data including data other than data directly identifying the object. The system may include a computer-readable storage medium storing program instructions executable by the surface computer to implement software applications. In response to the display surface receiving the object, the surface computer may be configured to read the encoded data passively with respect to the object, without using an active electronic interface between the surface computer and the object, and to display a user interface for software applications dependent upon the passively read encoded data, such that one or more elements of the user interface are visually associated on the interactive display surface with the physical object.
-
Citations
36 Claims
-
1. A surface computer, comprising:
-
an interactive display surface configured to; display visual output, detect placement of a physical document on the interactive display surface; and optically scan the physical document to obtain encoded data, wherein the physical document possesses the encoded data, and wherein the encoded data includes data other than data directly identifying the physical document; and a computer-readable storage medium storing program instructions executable to implement one or more software applications; wherein in response to the interactive display surface optically scanning the physical document, the surface computer is configured to; determine, based on the encoded data, a document type from a plurality of document types; and based on the encoded data and the document type, identify, from a plurality of software applications, a software application capable of functioning in concert with the encoded data, wherein the software application comprises a plurality of application data items; and wherein, in response to the identifying, the interactive display surface is further configured to; display a user interface for the software application; receive user input via a portion of the physical document; visibly distinguish, based on the user input and software application, the portion of the physical document at a position physically matching the portion of the physical document that received the user input; select a first application data item of the plurality of application data items based on a relationship between the first application data item and the portion of the physical document; and display the first application data item. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method, comprising:
-
detecting, by an interactive display surface, placement of a physical document on the interactive display surface; optically scanning, by the interactive display surface, the physical document to obtain encoded data, wherein the physical document possesses encoded data, and wherein the encoded data includes data other than data directly identifying the physical document; in response to the interactive display surface optically scanning the physical document; determining, based on the encoded data, a document type from a plurality of document types; and based on the encoded data and the document type, identifying, from a plurality of software applications, a software application capable of functioning in concert with the encoded data, wherein the software application comprises a plurality of application data items; in response to the identifying; displaying, by the interactive display surface, a user interface for the software application; receiving user input via a portion of the physical document; visibly distinguishing, based on the user input and software application, the portion of the physical document at a position physically matching the portion of the physical document that received the user input; and selecting a first application data item of the plurality of application data items based on a relationship between the first application data item and the portion of the physical document; and displaying the first application data item. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to:
-
detect, by an interactive display surface, placement of a physical document on the interactive display surface; optically scan, by the interactive display surface, the physical document to obtain encoded data, wherein the physical document possesses encoded data, and wherein the encoded data includes data other than data directly identifying the physical document; in response to detecting the interactive display surface optically scanning the physical document; determine, based on the encoded data, a document type from a plurality of document types; and based on the encoded data and the document type, identify, from a plurality of software applications, a software application capable of functioning in concert with the encoded data, wherein the software application comprises a plurality of application data items; and in response to the identifying; display, by the interactive display surface, a user interface for the software application; receive user input via a portion of the physical document; visibly distinguish, based on the user input and software application, the portion of the physical document at a position physically matching the portion of the physical document that received the user input; and select a first application data item of the plurality of application data items based on a relationship between the first application data item and the portion of the physical document; and display the first application data item. - View Dependent Claims (26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
Specification