System and method of user interface and data entry from a video call

• US 20060182311A1
• Filed: 02/14/2006
• Published: 08/17/2006
• Est. Priority Date: 02/15/2005
• Status: Active Grant

• Current Assignee: DSPV Ltd., Dvpv, Ltd.
• Original Assignee: Dvpv, Ltd.
• Inventors: Lev, Zvi Haim
• Granted Patent: US 7,551,782 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 18/28 Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
• CPC Class Codes: G06V 10/772 Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A system and method for imaging an object, and using reference templates to recognize and enhance object image, including the identification of a template for a specific area of a target object to which images of the object may be compared, the use of the camera on a wireless device to image the target object, comparison of the images of the object within the specific area of the object to the template for that area of the object, identification of the image of the object from the comparison of the image to the template for the specific area of the object, and the storage of the template and the identified image on a data server.

Claims

1. A method for imaging an object, and using reference templates to recognize and enhance object image, the method comprising:

identifying a template for a specific area of a target object to which images of the object are compared;

using the camera on a wireless device to image the target object;

comparing images of the object within the specific area of the object to the template for that area of the object;

identifying an image from the comparison of the images to the template for the specific area of the object; and

storing the template and the identified image in a storage unit.

2. The method of claim 1, further comprising:

repeating all prior operations of the method to identify and store a multiplicity of templates in which each template applies to a specific area of the target object;

comparing each of a multiplicity of images of the target object to the template applicable to the area of the imaged object in which the image is located;

identifying each compared image from the comparison to the template for the area in which the image is located on the object; and

storing each compared image and corresponding template in the storage unit.

3. The method of claim 2, further comprising:

using the camera of a wireless device to capture multiple images of each area of the target object;

in which said multiple images in an area are on substantially same size scale and in which a substantial pictorial overlap among the images in an area is present;

applying a technique to combine said multiple images of an area of the target object into a recognizable form;

storing results of said technique in the storage unit.

4. The method of claim 3, wherein said technique is selected from a group comprising optical character recognition, optical mark recognition, barcode recognition, alphanumeric data detection, logo and graphical symbols recognition, face recognition, and recognition of special marks.

5. The method of claim 3, wherein said technique is frame combination.

6. The method of claim 3, wherein said technique is projective geometric transform.

7. The method of claim 3, wherein a user communicates the selection of captured images of the target object to the storage unit using keypresses on the wireless device conveyed as Dual-Tone Multi-Frequency (DTMF) commands.

8. The method of claim 3, wherein a user selects the area imaged by zooming the camera with a forward movement on the center of the area of interest.

9. The method of claim 3, wherein the user identifies the area of interest by voice command.

10. The method of claim 3, further comprising:

recognizing that some of the images taken of the target object are damaged so that such images convey incorrect or misleading information;

comparing frames to templates to identify each damaged frame;

discarding a fixed number of frames after each damaged frame, in which the fixed number of frames is approximately 10 or less.

11. The method of claim 3, in which the user is financially charged for using the service of identification, recognition, and enhancement of target objects.

12. The method of claim 11, in which the charge to user is based on one or more of the group comprising time and quantity of air time transmission and reception, time and quantity of data transmitted and received, and quantity of data processed by the server.

13. The method of claim 3, further comprising:

said storage unit transmits feedback to a user during or very soon after the imaging executed by the user;

said feedback contains suggestions to the user for actions that enhance effectiveness of images captured by the user.

14. The method of claim 13, in which said feedback is in a form of written instructions advising the user to reposition or refocus the camera in the wireless device.

15. The method of claim 13, in which said feedback is image captured by the user, processed by the server, and transmitted back to a user'"'"'s imaging device.

16. The method of claim 13, in which said feedback is in a form of voice instructions advising the user to reposition or refocus the camera in the wireless device.

17. The method of claim 13, in which the feedback is in a form of a visual clue suggesting to the user what should be done to reposition of refocus the camera in the wireless device.

18. A system for imaging an object, and using reference templates to recognize and enhance object image, the system comprising:

a user interface unit for capturing images and communicating with a server, said unit comprising a video display channel, an audio communication channel, a keypad input channel, and a video input channel;

a computational facilities comprising a data storage server, an application server, and a speech recognition server; and

a communication network for facilitating communication between the user interface unit and the computational facilities.

19. The system of claim 18, wherein the computational facilities further comprise a video and image preprocessing server.

20. The system of claim 18, wherein the computational facilities further comprise an image recognition and enhancement server.

21. The system of claim 18, wherein the computational facilities further comprise a video and image preprocessing serve, and an image recognition and enhancement server.

22. A computer program product stored on a computer readable medium for causing the computer medium to perform a method comprising:

identifying a template for a specific area of a target object to which images of the object may be compared;

using a camera on a wireless device to image the target object;

comparing images of the object within the specific area of the object to the template for that area of the object;

identifying the image from the comparison of the image to the template for the specific area of the object; and

storing the template and the identified image on a storage unit.