Web-Based Content Detection in Images, Extraction and Recognition

• US 20090285444A1
• Filed: 05/15/2008
• Published: 11/19/2009
• Est. Priority Date: 05/15/2008
• Status: Active Grant

• Current Assignee: Piece Future Pte., Ltd.
• Original Assignee: Ricoh Company Limited
• Inventors: Hull, Jonathan J., Erol, Berna
• Granted Patent: US 8,385,589 B2
• Time in Patent Office: Days
• US Class Current: 382/100
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables

Abstract

A web-based image detection system includes: an image capture device, a web browser, a plug-in, and a recognition server. A captured image is processed by the plug-in to assess whether a pre-determined content type is contained with in the image. Once an initial analysis at the browser plug-in detects a pre-determined content type in an image, the image is transmitted to a recognition server for content recognition of the image by content type. The system thus enables users to link documents or other image types to electronic data using only a capture device and a web browser.

Claims

1. A method for web-based image content type detection using a browser plug-in, the method comprising:

capturing an image via a capture device associated with a client;

analyzing at the browser plug-in the captured image for detection of a pre-determined content type; and

in response to the analyzing detecting the pre-determined content type within the captured image, transmitting the captured image to a server.

2. The method of claim 1, wherein the content type is text.

3. The method of claim 1, wherein the browser plug-in comprises a .swf file that runs in a Flash player.

4. The method of claim 1, wherein the capture device is a webcam.

5. The method of claim 1, further comprising receiving from the server recognition results associated with the captured image.

6. The method of claim 5, further comprising displaying content associated with the recognition results.

7. The method of claim 1, wherein the client comprises a mobile device.

8. A method for web-based text detection, the method comprising:

capturing an image via a capture device associated with a client;

analyzing the captured image at the client for detecting text;

in response to the analyzing detecting text within the captured image, identifying at the client text image features for searching; and

transmitting from the client the text image features for searching a document server.

9. The method of claim 8, wherein the text image features are words.

10. The method of claim 8, further comprising receiving from the document server recognition results comprising a document matching the text image features.

11. The method of claim 10, further comprising displaying a thumbnail representation of the document matching the text image features and a link to the document matching the text image features.

12. The method of claim 8, wherein the analysis comprises edge detection.

13. The method of claim 8, wherein the client comprises a mobile device.

14. A method for web-based text detection, the method comprising:

capturing an image via a capture device associated with a client;

analyzing the captured image at the client for text detection;

in response to the analyzing detecting text within the captured image, identifying at the client text image features for searching; and

performing a desktop search using the text image features as keywords.

15. The method of claim 14, further comprising receiving recognition results comprising a document matching the text image features.

16. The method of claim 15, wherein the document is selected from the group consisting of a file, an email, and a web history entry.

17. The method of claim 15, wherein the document is stored on the client.

18. The method of claim 15, further comprising displaying a thumbnail representation of the document matching the text image features and a link to the document matching the text image features.

19. The method of claim 14, wherein the analysis comprises edge detection.

20. The method of claim 14, wherein the client comprises a mobile device.

21. A method for web-based text detection using a browser plug-in, the method comprising:

providing by a server the browser plug-in for running on a client;

using the browser plug-in, capturing at the client an image via a capture device associated with the client;

receiving the captured image at the server;

analyzing the captured image at the server for text detection;

in response to the analyzing detecting text within the captured image, identifying at the server features for searching; and

performing at the server a document recognition search using the features.

22. The method of claim 21, wherein the browser plug-in comprises a .swf file that runs in a Flash player.

23. The method of claim 21, wherein the analysis comprises edge detection.

24. The method of claim 21, further comprising displaying a thumbnail representation of a document recognized using the features and a link to the document recognized using the features.

25. A system for web-based image content type detection using a browser plug-in, the system comprising:

a capture device associated with a client for capturing an image;

the browser plug-in for analyzing the captured image and for, in response to the analyzing detecting a pre-determined content type within the captured image, transmitting the captured image to a server.

26. The system of claim 25, wherein the content type is text.

27. The system of claim 25, wherein the browser plug-in comprises a .swf file that runs in a Flash player.

28. The system of claim 25, wherein the capture device is a webcam.

29. The system of claim 25, wherein the browser plug-in receives from the server recognition results associated with the captured image.

30. The system of claim 29, wherein the browser plug-in displays content associated with the recognition results.

31. The system of claim 25, wherein the client comprises a mobile device.

32. A system for web-based text detection, the system comprising:

a capture device associated with a client for capturing an image;

a browser plug-in for analyzing the captured image at the client and, in response to the analyzing detecting text within the captured image, identifying at the client text image features for searching; and

wherein the client transmits the text image features for searching a document server.

33. The system of claim 32, wherein the text image features are words.

34. The system of claim 32, wherein the browser plug-in receives from the document server recognition results comprising a document matching the text image features.

35. The system of claim 34, wherein the browser plug-in displays a thumbnail representation of the document matching the text image features and a link to the document matching the text image features.

36. The system of claim 32, wherein the analysis comprises edge detection.

37. The system of claim 32, wherein the client comprises a mobile device.

38. A system for web-based text detection, the system comprising:

a capture device associated with a client for capturing an image;

a browser plug-in for analyzing the captured image at the client and, in response to the analyzing, detecting text within the captured image, identifying at the client text image features for searching; and

a desktop search application interface for performing a desktop search using the text image features as keywords.

39. The system of claim 38, wherein the browser plug-in receives recognition results comprising a document matching the text image features.

40. The system of claim 39, wherein the document is selected from the group consisting of a file, an email, and a web history entry.

41. The system of claim 39, wherein the document is stored on the client.

42. The system of claim 39, wherein the browser plug-in displays a thumbnail representation of the document matching the text image features and a link to the document matching the text image features.

43. The system of claim 38, wherein the analysis comprises edge detection.

44. The system of claim 38, wherein the client comprises a mobile device.

45. A system for web-based text detection using a browser plug-in, the system comprising:

a server for providing the browser plug-in for running on a client;

the browser plug-in to capture an image via a capture device associated with the client;

wherein the captured image is received at the server;

wherein the browser plug-in analyzes the captured image at the server and, in response to the analyzing detecting text within the captured image, identifies at the server features for searching; and

wherein the server performs a document recognition search using the features.

46. The system of claim 45, wherein the browser plug-in comprises a .swf file that runs in a Flash player.

47. The system of claim 45, wherein the analysis comprises edge detection.

48. The system of claim 45, wherein the browser plug-in displays a thumbnail representation of a document recognized using the features and a link to the document recognized using the features.