Flexible interaction-based computer interfacing using visible artifacts

• US 20060072009A1
• Filed: 10/01/2004
• Published: 04/06/2006
• Est. Priority Date: 10/01/2004
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Pingali, Gopal Sarma, Levas, Anthony Tom, Moesgaard Kjeldsen, Frederik Carl
• Application Number:
  US10/957,123
• Publication Number:
  US 20060072009A1
• Time in Patent Office: Days
• US Class Current: 348/137
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

An exemplary technique for interaction-based computer interfacing comprises determining if an interaction with a visible artifact is a recognized interaction. When the interaction is a recognized interaction, control information is determined that has one of a plurality of types. The control information is determined by using at least the visual artifact and characteristics of the recognized interaction. The control information is mapped to one or more tasks in an application, such that any task that requires control information of a specific type can get the control information from any visual artifact that creates control information of the specific type. The control information is suitable for use by the one or more tasks.

Claims

1. A method performed on a computer system for interaction-based computer interfacing, the method comprising the steps of:

determining if an interaction with a visible artifact is a recognized interaction; and

when the interaction is a recognized interaction, performing the following steps;

determining control information having one of a plurality of types, the control information determined by using at least the visual artifact and characteristics of the recognized interaction; and

mapping the control information to one or more tasks in an application, such that any task that requires control information of a specific type can get the control information from any visual artifact that creates control information of the specific type;

wherein the control information is suitable for use by the one or more tasks.

2. The method of claim 1, wherein the control information comprises one or more parameters determined by using the characteristics of the recognized interaction.

3. The method of claim 2, wherein the parameters comprise one or more values for the one type.

4. The method of claim 1, further comprising the steps of:

locating a given one of one or more visible artifacts in an area;

determining if the given visible artifact is a recognized visible artifact;

the step of determining if an interaction with a visible artifact is a recognized interaction further comprises the step of determining if an interaction with a recognized visible artifact is a recognized interaction; and

wherein the steps of determining control information and mapping the control information are performed when the interaction is a recognized interaction for the recognized visible artifact.

5. The method of claim 1, further comprising the step of determining the interaction, performed by an object, with the visible artifact.

6. The method of claim 1, wherein the plurality of types comprise a zero-dimensional, one-dimensional, two-dimensional, or three-dimensional type.

7. The method of claim 6, wherein the control information comprises a control signal, and wherein the step of determining control information comprises the step of determining a value for each of the dimensions for a given type, the control signal comprising the values corresponding to the dimensions for the given type.

8. The method of claim 1, wherein the visible artifact corresponds to a plurality of types such that a corresponding plurality of control information can be determined for the visible artifact.

9. The method of claim 1, wherein the visible artifact corresponds to a single type such that a corresponding single control information can be determined for the visible artifact.

10. The method of claim 1, wherein the visible artifact comprises one or more of a physical object, a printed page having images, and a projected image.

11. The method of claim 1, further comprising the step of communicating the control information to the application, and wherein the application performs the one or more tasks using the control information.

12. The method of claim 1, wherein the control information is determined by using at least the visible artifact, characteristics of the recognized interaction and contextual information.

13. The method of claim 12, wherein the contextual information comprises one or more of a location of the visible artifact and a state of the application.

14. The method of claim 1, wherein the step of mapping further comprises the step of mapping, based on contextual information, the control information to the one or more tasks in the application.

15. The method of claim 14, wherein the contextual information comprises one or more of a location of the visible artifact and a state of the application.

16. The method of claim 1, further comprising the steps of:

providing to the user indicia of one or more interactions suitable for use with a selected visible artifact;

having the user select a given one of the one or more interactions for the selected visible artifact;

storing characteristics of the given interaction, the given interaction being a recognized interaction for the selected visible artifact;

providing to the user indicia of one or more types for the selected interaction with the selected visible artifact;

having the user select a given one of the one or more types for the selected visible artifact;

storing given control information for the selected visible artifact, the given control information having the given type;

providing to the user indicia of one or more tasks, for a selected application, requiring control information of the one type;

having the user select a given one of the one or more tasks for the one type; and

storing information allowing the given control information to be mapped to the given task.

17. The method of claim 1, further comprising the steps of:

providing to the user indicia of one or more interactions suitable for use with a selected visible artifact;

having the user select a given one of the one or more interactions for the selected visible artifact;

storing characteristics of the given interaction, the given interaction being a recognized interaction for the selected visible artifact;

providing to the user indicia of one or more types for the selected interaction with the selected visible artifact;

having the user select a given one of the one or more types for the selected visible artifact;

storing given control information for the selected visible artifact, the given control information having the given type;

determining that the given control information is to be mapped to the selected visible artifact; and

storing information allowing the given control information to be mapped to the given task.

18. The method of claim 1, further comprising the step of having a user perform an interaction with the visible artifact in order to determine the recognized interaction.

19. The method of claim 1, further comprising the step of having a user operate a given one of the one or more tasks of the application in order to determine information allowing the control information to be mapped the given task.

20. An apparatus for interaction-based computer interfacing, the apparatus comprising:

a memory that stores computer-readable code; and

a processor operatively coupled to the memory, said processor configured to implement the computer-readable code, said computer-readable code configured to perform the steps of;

determining if an interaction with a visible artifact is a recognized interaction; and

when the interaction is a recognized interaction, performing the following steps;

determining control information having one of a plurality of types, the control information determined by using at least the visual artifact and characteristics of the recognized interaction; and

mapping the control information to one or more tasks in an application, such that any task that requires control information of a specific type can get the control information from any visual artifact that creates control information of the specific type.

21. An article of manufacture for interaction-based computer interfacing comprising:

a computer readable medium containing one or more programs which when executed implement the steps of;

determining if an interaction with a visible artifact is a recognized interaction; and

when the interaction is a recognized interaction, performing the following steps;

determining control information having one of a plurality of types, the control information determined by using at least the visual artifact and characteristics of the recognized interaction; and

mapping the control information to one or more tasks in an application, such that any task that requires control information of a specific type can get the control information from any visual artifact that creates control information of the specific type.