Form filling based on classification and identification of multimedia data

• US 9,189,468 B2
• Filed: 03/07/2013
• Issued: 11/17/2015
• Est. Priority Date: 03/07/2013
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Gormish, Michael J., Barrus, John W., Schwartz, Edward L.
• Primary Examiner(s): Mills, Frank D
• Application Number:
  US13/789,672
• Publication Number:
  US 20140258827A1
• Time in Patent Office: 985 Days
• Field of Search: 715/224
• US Class Current: 1/1
• CPC Class Codes: G06F 40/174 Form filling; Merging

Abstract

An electronic writing solution server includes a classification application that comprises a classifier and a user interface engine. The classifier receives multimedia data on a form, identifies at least one field in the form to be modified and modifies the at least one field in the form based on the multimedia data. The user interface engine provides the modified form to a user.

Claims

1. A computer-implemented method comprising:

receiving multimedia data on a form;

identifying, using one or more computing devices, at least one field in the form to be modified;

modifying, using the one or more computing devices, the at least one field in the form based on the multimedia data;

identifying an object based on the multimedia data;

determining a set of characteristics that are associated with the object, wherein the multimedia data does not include the set of characteristics;

determining that the form lacks corresponding fields to include the set of characteristics determined for the object;

adding the fields corresponding to the set of characteristics to the form;

modifying the corresponding fields in the form to include the set of characteristics; and

providing the modified form to a user.

2. The method of claim 1, wherein identifying the at least one field in the form to be modified further comprises:

analyzing the multimedia data; and

identifying the at least one field in the form that is related to content in the multimedia data.

3. The method of claim 1, wherein receiving the multimedia data on the form further comprises receiving the multimedia data that is associated with the at least one field of the form.

4. The method of claim 3, wherein identifying the at least one field in the form to be modified further comprises analyzing the multimedia data to identify at least one person or the object.

5. The method of claim 3, wherein modifying the at least one field in the form based on the multimedia data further comprises populating other fields in the form based on the analysis.

6. The method of claim 1, wherein identifying the at least one field in the form to be modified further comprises:

classifying the multimedia data based on a set of classifiers associated with fields in the form; and

identifying the at least one field in the form to include the classified multimedia data.

7. The method of claim 6, wherein modifying the at least one field in the form is based on the classified multimedia data.

8. The method of claim 1, further comprising generating a form template for the form, the form template including a set of fields associated with data types and classifiers.

9. The method of claim 8, wherein generating the form template further comprises:

determining the set of fields included in the form;

associating each field in the set of fields with a data type; and

wherein the data type includes a multimedia type.

10. The method of claim 8, wherein generating the form template further comprises:

collecting samples of the form filled in by a plurality of users;

creating a classifier for each field in the set of fields using the collected samples; and

associating each field in the set of fields with the classifier.

11. A system comprising:

one or more processors;

a controller stored on a memory and executable by the one or more processors, the controller configured to receive multimedia data on a form;

a classifier configured to identify at least one field in the form to be modified and modify the at least one field in the form based on the multimedia data, identify an object based on the multimedia data, determine a set of characteristics that are associated with the object, wherein the multimedia data does not include the set of characteristics, determine that the form lacks corresponding fields to include the set of characteristics determined for the object, add the fields corresponding to the set of characteristics to the form, and modify the corresponding fields in the form to include the set of characteristics; and

a user interface engine configured to provide the modified form to a user.

12. The system of claim 11, wherein identifying the at least one field in the form to be modified further comprises:

analyzing the multimedia data; and

identifying the at least one field in the form that is related to content in the multimedia data.

13. The system of claim 11, wherein receiving the multimedia data on the form further comprises receiving the multimedia data that is associated with the at least one field of the form.

14. The system of claim 13, wherein identifying the at least one field in the form to be modified further comprises analyzing the multimedia data to identify at least one person or the object.

15. The system of claim 13, wherein modifying the at least one field in the form based on the multimedia data further comprises populating other fields in the form based on the analysis.

16. The system of claim 11, wherein identifying the at least one field in the form to be modified further comprises:

classifying the multimedia data based on a set of classifiers associated with fields in the form; and

identifying the at least one field in the form to include the classified multimedia data.

17. The system of claim 16, wherein modifying the at least one field in the form is based on the classified multimedia data.

18. A computer program product comprising a non-transitory computer useable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

receive multimedia data on a form;

identify at least one field in the form to be modified;

modify the at least one field in the form based on the multimedia data;

identify an object based on the multimedia data;

determine a set of characteristics that are associated with the object, wherein the multimedia data does not include the set of characteristics;

determine that the form lacks corresponding fields to include the set of characteristics determined for the object;

add the fields corresponding to the set of characteristics to the form;

modify the corresponding fields in the form to include the set of characteristics; and

provide the modified form to a user.