Computer and vision-based augmented interaction in the use of printed media
First Claim
1. A media and gesture recognition method using a computer system, the method comprising:
- viewing and generating a digital representation of a printed media using an electronic visual sensor during a first interaction session;
identifying the printed media using the digital representation of the printed media;
retrieving information corresponding to the viewed printed media from a computer system database;
using the electronic visual sensor to view at least a first gesture of a user relative to at least a portion of the printed media;
interpreting the first finger gesture as a first command; and
based at least in part on the first gesture and the retrieved information, providing at least a portion of the retrieved information.
5 Assignments
0 Petitions
Accused Products
Abstract
Media and gesture recognition apparatus and methods are disclosed. A computerized system views a first printed media using an electronic visual sensor. The system retrieves information corresponding to the viewed printed media from a database. Using the electronic visual sensor, the system views at least a first user gesture relative to at least a portion of the first printed media. The system interprets the gesture as a command, and based at least in part on the first gesture and the retrieved information, the system electronically speaks aloud at least a portion of the retrieved information.
-
Citations
57 Claims
-
1. A media and gesture recognition method using a computer system, the method comprising:
-
viewing and generating a digital representation of a printed media using an electronic visual sensor during a first interaction session;
identifying the printed media using the digital representation of the printed media;
retrieving information corresponding to the viewed printed media from a computer system database;
using the electronic visual sensor to view at least a first gesture of a user relative to at least a portion of the printed media;
interpreting the first finger gesture as a first command; and
based at least in part on the first gesture and the retrieved information, providing at least a portion of the retrieved information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A vision-based method of processing user interaction with printed media, the method comprising:
-
receiving at a computer system a digital representation of a first image of a printed media, wherein the first image was obtained from a first imaging device;
based at least in part on the digital representation of the first image, retrieving corresponding information from a database;
receiving a first digital representation of a first image of a user gesture relative to at least a portion of the printed media;
interpreting the first digital representation of an image of a user gesture; and
based at least in part on the interpretation of the user gesture and the retrieved database information, providing at least a portion of the retrieved information to the user. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35)
-
-
36. A computer-based printed media interaction apparatus, the apparatus comprising:
-
an image sensor, the image sensor configured to view printed media;
a database including a mapping of regions of the printed media with corresponding actions;
a gesture tracking module that tracks a user gesture position relative to the printed media based at least in part on images from the image sensor; and
an interaction module that, based at least in part on the user gesture position and database information, provides at least a portion of the database information to the user. - View Dependent Claims (37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50)
-
-
51. A media and gesture recognition apparatus, the apparatus comprising:
-
an image sensor that views printed media;
a recognition module that identifies the printed media based on image information from the image sensor;
a database that stores information that relates portions of the printed media with corresponding actions;
a gesture tracking module that identifies user gestures relative to the printed media based at least in part on images from the image sensor; and
an interaction module that, based at least in part on the user gesture and database information, provides at least a portion of the database information to the user. - View Dependent Claims (52, 53, 54, 55, 56, 57)
-
Specification