Methods and systems for interacting with physical objects
First Claim
1. A method for interacting with an object, the method comprising:
- using a camera of a handheld computing device, capturing a picture of an object, the object being free of overt digital encoding—
such as a barcode;
providing at least some image data corresponding to the captured picture to a processor;
receiving back from the processor processed information corresponding to the object and based on the provided image data;
by reference to the processed information, automatically identifying a particular one of plural different software application programs or routines, the identified software application program or routine being particularly relevant to the object, rather than being generally relevant to all objects;
using the identified software application program or routine, producing output information; and
presenting the output information using an output component of the handheld computing device.
5 Assignments
0 Petitions
Accused Products
Abstract
A camera, of a handheld computing device, is used to capture a picture of an object. At least some image data corresponding to the captured picture is provided to a processor, which returns processed information corresponding to the object. By reference to this processed information, the system automatically identifies a particular one of plural different software application programs—a program that is particularly relevant to the object, rather than being generally relevant to all objects. Output information is then produced using the identified software application program, which is then presented to the user, e.g., on a screen of the handheld computing device. A great number of other features and arrangements are also detailed.
170 Citations
22 Claims
-
1. A method for interacting with an object, the method comprising:
-
using a camera of a handheld computing device, capturing a picture of an object, the object being free of overt digital encoding—
such as a barcode;providing at least some image data corresponding to the captured picture to a processor; receiving back from the processor processed information corresponding to the object and based on the provided image data; by reference to the processed information, automatically identifying a particular one of plural different software application programs or routines, the identified software application program or routine being particularly relevant to the object, rather than being generally relevant to all objects; using the identified software application program or routine, producing output information; and presenting the output information using an output component of the handheld computing device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for interacting with an object, the method comprising:
-
using a camera of a handheld computing device, capturing a picture of an object, the object being free of overt digital encoding—
such as a barcode;providing at least some image data corresponding to the captured picture to a processor; receiving back from the processor processed information corresponding to the object and based on the provided image data; by reference to the processed information, automatically identifying two or more different software application programs or routines, the identified software application programs or routines being particularly relevant to the object, rather than being generally relevant to all objects; presenting information to a user inviting the user to select one of said two or more identified software application programs or routines, and receiving information about a selection from the user; using the selected software application program or routine, producing output information; and presenting the output information using an output component of the handheld computing device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A computer program product embodied in a computer readable medium, the program product being adapted for use with a computing device including a camera, a processor and a data store, the program product including instructions configuring such a processor and computing device to perform the following acts:
-
capture a picture of an object using the camera; provide at least some image data corresponding to the captured picture to the processor; process the provided image data to produce processed information corresponding to the object; by reference to the processed information, automatically identify a particular one of plural different software application programs or routines stored in the data store, the identified software application program or routine being particularly relevant to the object, rather than being generally relevant to all objects; use the identified software application program or routine to produce output information; and present the output information using an output component of the handheld computing device.
-
-
20. A method comprising:
-
operating a camera of a handheld computing device in a mode in which it grabs a sequence of image frames in an automated, on-going fashion, at least one of said frames depicting a scene; providing at least some image data corresponding to said at least one of said frames to a processor; receiving back from the processor processed information corresponding to said scene and based on the provided image data; by reference to the processed information, and also by reference to a data structure in the device containing reference information, identifying a particular one of plural different software application programs or routines, the identified software application program or routine being particularly relevant to a subject depicted in the captured scene, rather than being generally relevant to all subjects, said identifying being performed without consulting a remote data structure, and said subject being free of inked or other printed markings; executing the identified software application program or routine; and providing response data to a user based on an output from execution of the identified software application program or routine.
-
-
21. A method comprising:
-
using a camera of a handheld computing device, capturing an image of a scene; providing at least some image data corresponding to the captured scene to a processor, and receiving therefrom processed information corresponding to the scene and based on the provided image data; by reference to the processed information, automatically identifying a particular one of plural different sets of software instructions, the identified set of software instructions being particularly relevant to a subject depicted in the captured scene, rather than being generally relevant to all subjects; and executing the identified set of software instructions; wherein execution of the identified set of software instructions involves further processing of captured image data.
-
-
22. A portable device including a camera, a memory, and a processor configured by non-transitory programming instructions stored in the memory to perform the following acts:
-
process image data corresponding to an image scene captured by the camera, to produce processed information; identify, by reference to the processed information, a particular one of plural different sets of software instructions, the identified set of software instructions being particularly relevant to a subject depicted in said scene, rather than being generally relevant to all subjects; and execute the identified set of software instructions, said execution involving further processing of image data captured by the camera.
-
Specification