Method of interacting with printed content via handheld display device
First Claim
1. A method of interacting with printed content using a handheld display device, said method comprising the steps of:
- imaging an area of a printed substrate and generating image data using an image sensor of the handheld display device, the imaged area of the printed substrate containing the printed content;
determining interaction data using said image data, said interaction data identifying a page description corresponding to at least part of the printed substrate;
retrieving display data using the page description, said display data corresponding to at least some of the printed content;
displaying, on an opaque touch-sensitive display screen of the handheld display device, display information at least partially based on said display data, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content; and
interacting with said display information via said opaque touch-sensitive display screen.
1 Assignment
0 Petitions
Accused Products
Abstract
A method of interacting with printed content using a handheld display device. The method includes the steps of: imaging an area of a printed substrate and generating image data using an image sensor; determining interaction data using the image data, retrieving display data using an identified page description, the display data corresponding to the printed content; displaying, on an opaque touch-sensitive display screen of the handheld display device, display information based on the display data; and interacting with the display information via the opaque touch-sensitive display screen. The opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content.
45 Citations
18 Claims
-
1. A method of interacting with printed content using a handheld display device, said method comprising the steps of:
-
imaging an area of a printed substrate and generating image data using an image sensor of the handheld display device, the imaged area of the printed substrate containing the printed content; determining interaction data using said image data, said interaction data identifying a page description corresponding to at least part of the printed substrate; retrieving display data using the page description, said display data corresponding to at least some of the printed content; displaying, on an opaque touch-sensitive display screen of the handheld display device, display information at least partially based on said display data, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content; and interacting with said display information via said opaque touch-sensitive display screen. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A handheld display device for interacting with printed content, said device comprising:
-
an optical sensor for imaging an area of a printed substrate containing the printed content and generating image data; a processor for determining interaction data using the image data, said interaction data identifying a page description corresponding to at least part of the printed substrate; a data retrieval unit for retrieving display data using the page description, said display data corresponding to at least some of the printed content; and an opaque touch-sensitive display screen for displaying display information based at least partially on said display data, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content, and wherein the opaque touch-sensitive display screen enables user interactivity with the display information. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. A non-transitory computer readable medium storing an interactive application for execution on a handheld display device having an image sensor, a processor and an opaque touch-sensitive display screen, the interactive application being configured to operatively control the device so as to perform the steps of:
- imaging an area of a printed substrate
and generating image data using the image sensor of the handheld display device, the imaged area of the printed substrate containing printed content;
determining interaction data using said image data, said interaction data identifying a page description corresponding to at least part of the printed substrate;
retrieving display data using the page description, said display data corresponding to at least some of the printed content;
displaying, on the opaque touch-sensitive display screen, display information at least partially based on said display data, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user'"'"'s perspective to provide a virtual window to the printed content, wherein the interactive application is configured to operatively control the device so as to perform the further step of;
responding to user interactions with said display information via touch-sensitive display screen.
- imaging an area of a printed substrate
Specification