Synthetic image and video generation from ground truth data

• US 8,238,609 B2
• Filed: 06/24/2011
• Issued: 08/07/2012
• Est. Priority Date: 01/18/2007
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Lookingbill, Andrew, Antunez, Emilio, Erol, Berna, Hull, Jonathan J., Ke, Qifa
• Primary Examiner(s): STREGE, JOHN B
• Application Number:
  US13/168,638
• Publication Number:
  US 20110310110A1
• Time in Patent Office: 410 Days
• Field of Search: 382/103, 382/255, 382/291, 382/292, 382/294
• US Class Current: 382/103
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/1456 based on user interactions
• CPC Class Codes: G06V 30/1607 Correcting image deformation, e.g. trapezoidal deformation caused by perspective
• CPC Class Codes: H04N 1/107 with manual scanning
• CPC Class Codes: H04N 2201/0414 Scanning an image in a series of overlapping zones

Abstract

A system and a method are disclosed for generating video. Object information is received. A path of motion of the object relative to a reference point is generated. A series of images and ground for a reference frame are generated from the ground truth and the generated path. A system and a method are disclosed for generating an image. Object information is received. Image data and ground truth may be generated using position, the image description, the camera characteristics, and image distortion parameters. A positional relationship between the document and a reference point is determined. An image of the document and ground truth are generated from the object information and the positional relationship and in response to user specified environment of the document.

Claims

1. A method for generating a virtual image, the method comprising:

receiving, from a device, object information representative of an object;

determining a positional relationship between the object and the device;

generating a plurality of simulated effects for the object; and

generating the virtual image of the object and ground truth data for the virtual image from the object information, the plurality of simulated effects, the positional relationship and a user specified environment of the object.

2. The method of claim 1, wherein generating the virtual image of the object and ground truth data for the virtual image comprises:

generating image data and ground truth data using at least one of a position, an image description, a characteristic of the device and an image distortion parameter.

3. The method of claim 1, further comprising determining the positional relationship using a model for human behavior for movement of the device.

4. The method of claim 1, wherein the plurality of simulated effects includes at least one of a focus blur, a motion blur, a histogram effect, a shadow, a sensor noise, a bleed through effect, an image compression and a background clutter.

5. The method of claim 1, wherein the user specified environment of the object includes at least one of a characteristic of the device, a characteristic of the object and a lighting of the object.

6. The method of claim 5 wherein the characteristic of the object includes a shape of the object.

7. The method of claim 1, wherein the device is a capture device.

8. The method of claim 1, wherein the object is a document.

9. A system for generating a virtual image, the system comprising:

an interface to receive, from a device, object information representative of an object;

a path generator to determine a positional relationship between the object and the device; and

an image generator to generate a plurality of simulated effects for the object and to generate the virtual image of the object and ground truth data for the virtual image from the object information, the plurality of simulated effects, the positional relationship and a user specified environment of the object.

10. The system of claim 9, wherein the image generator generates image data and ground truth data using at least one of a position, an image description, a characteristic of the device and an image distortion parameter.

11. The system of claim 9, wherein the path generator further determines the positional relationship using a model for human behavior for movement of the device.

12. The system of claim 9, wherein the device is a handheld imaging device.

13. The system of claim 9, wherein the device is a capture device.

14. The system of claim 9, wherein the object is a document.

15. A computer program product comprising a non-transitory computer useable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to perform steps comprising:

receiving, from a device, object information representative of an object;

determining a positional relationship between the object and the device;

generating a plurality of simulated effects for the object; and

generating a virtual image of the object and ground truth data for the virtual image from the object information, the plurality of simulated effects, the positional relationship and a user specified environment of the object.

16. The computer readable program of claim 15 when executed causes the computer to perform a further step comprising:

generating image data and ground truth data using at least one of a position, an image description, a characteristic of the device and an image distortion parameter.

17. The computer readable program of claim 15, wherein determining the positional relationship further comprises using a model for human behavior for movement of the device.

18. The computer readable program of claim 15, wherein the plurality of simulated effects includes at least one of a focus blur, a motion blur, a histogram effect, a shadow, a sensor noise, a bleed through effect, an image compression and a background clutter.

19. The computer readable program of claim 15, wherein the user specified environment of the object includes at least one of a characteristic of the device, a characteristic of the object and a lighting of the object.

20. The computer readable program of claim 15 wherein the characteristic of the object includes a shape of the object.