System, method and mobile unit to sense objects or text and retrieve related information

• US 20060079294A1
• Filed: 10/06/2005
• Published: 04/13/2006
• Est. Priority Date: 10/07/2004
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Alexander C. Chen
• Inventors: Chen, Alexander C.
• Granted Patent: US 7,450,960 B2
• Time in Patent Office: Days
• US Class Current: 455/566
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system, method and mobile unit to sense objects and/or text and retrieve related images, text or translations. The system may allow users to instantly access information about an object or text with a mobile device, such as a mobile phone, pager, personal digital assistant (PDA) or lap top computer.

Claims

1. A mobile device comprising:

a sensor configured to capture an image of an object;

a keypad configured to receive a user command to select a category of information related to the object, the information comprising at least one of an image, a video, an audio file, and text;

a transceiver configured to (a) wirelessly transmit the image and user command to a communication system and (b) wirelessly receive titles of information within the category of information from the communication system; and

a display configured to display the received titles.

2. The mobile device of claim 1, wherein the mobile device comprises at least one of a mobile phone, a laptop computer, a personal digital assistant and a camera.

3. The mobile device of claim 1, wherein the category comprises at least one of a definition, a related image, a related video, news, history, purchase information, selling information, location, nearest store, person, web site, email, address, phone number, map, directions, and translation.

4. The mobile device of claim 1, wherein the titles comprise at least one of links to picture files, links to video files, links to text files, and links to web sites.

5. The mobile device of claim 1, further comprising a voice recognition unit configured to receive the user command.

6. The mobile device of claim 5, wherein the voice recognition unit is configured to receive at least one search word from the user, the search word being related to the object.

7. The mobile device of claim 1, wherein the keypad is configured to receive at least one search word from the user, the search word being related to the object.

8. The mobile device of claim 1, wherein the keypad is configured to receive a user command selecting a title among the received titles, the display being configured to show information related to the selected title.

9. The mobile device of claim 1, wherein the display is configured to display a pre-stored list of categories for the user to select, the keypad being configured to receive a user command to select one of the categories.

10. The mobile device of claim 1, wherein the keypad is configured to receive a user command to configure a category.

11. A method of operating a mobile device, the method comprising:

capturing an image of an object with the mobile device;

receiving a user command to select a category of information related to the object, the information comprising at least one of an image, a video, and text;

wirelessly transmitting the image and user command to a communication system;

wirelessly receiving titles of information within the category of information from the communication system; and

displaying the received titles.

12. The method of claim 11, further comprising receiving at least one search word from the user, the search word being related to the object.

13. A system comprising:

a communication network configured to receive a user command and data representing an image of an object from a mobile device; and

a computer configured to (a) receive the user command and data from the communication network, (b) access at least one of a database and the Internet to find information related to the object, the information comprising at least one of an image, a video, an audio file, text, a hypertext link, and a web site, and (c) send titles of the found information to the communication network;

wherein the communication network is configured to send the titles to the mobile device.

14. The system of claim 13, wherein the computer is configured to find a category of information, the category being specified in the user command.

15. The system of claim 14, wherein the category comprises at least one of a definition, a related image, a related video, news, history, purchase information, selling information, location, nearest store, person, web site, email, address, phone number, map, directions, and translation.

16. The system of claim 13, wherein the computer is configured to use a search word in the user command to find information related to the object.

17. The system of claim 13, wherein the computer is configured to use an Internet search engine to find information related to the object.

18. The system of claim 13, wherein the computer is further configured to (a) receive a second user command specifying one or more titles of found information and (b) send found information of the specified titles to the communication network.

19. The system of claim 13, wherein the computer is further configured to process the image to clarify the object.

20. The system of claim 13, wherein the computer is configured to use parameters of the object to find information related to the object, the parameters comprising at least one of shape, features, color, color pattern, surface texture, material composition, arrangement, structure, spacing between lines, and size of the object relative to other objects.

21. The system of claim 13, wherein the computer is configured to use a plurality of object classifications to find information related to the object.

22. A method comprising:

receiving a user command and data representing an image of an object from a mobile device;

accessing at least one of a database and the Internet to find information related to the object, the information comprising at least one of an image, a video, an audio file, text, a hypertext link, and a web site; and

sending titles of the found information to the mobile device.

23. The method of claim 22, further comprising using parameters of the object to find information related to the object, the parameters comprising at least one of shape, features, color, color pattern, surface texture, material composition, arrangement, structure, spacing between lines, and size of the object relative to other objects