SYSTEMS AND METHODS FOR IMPROVING VIDEO CAPTURED USING MOBILE DEVICES

• US 20160112645A1
• Filed: 12/28/2015
• Published: 04/21/2016
• Est. Priority Date: 05/03/2013
• Status: Active Grant

• Current Assignee: Tungsten Automation Corp.
• Original Assignee: Kofax Incorporated
• Inventors: Amtrup, Jan W., Ma, Jiyong, Macciola, Anthony
• Granted Patent: US 9,584,729 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06V 2201/09 Recognition of logos
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: H04N 1/00251 with an apparatus for taking photographic images, e.g. a camera
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00801 according to characteristics of the original
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 2201/0032 where the still picture apparatus acts as the slave
• CPC Class Codes: H04N 2201/0075 by a user operated remote control device, e.g. receiving instructions from a user via a computer terminal or mobile telephone handset
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/0458 Additional arrangements for improving or optimising scanning resolution or quality
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/265 Mixing

Abstract

Systems, methods, and computer program products for capturing and analyzing image data, preferably video data, are disclosed. The inventive concepts include using multiple frames of image data to generate a composite image, where the composite image may be characterized by a higher resolution than one or more of the individual frames used to generate the composite image, and/or absence of a blurred region present in one or more of the individual frames. Inventive techniques also include determining a minimum capture resolution appropriate for capturing images of particular objects for downstream processing, and optionally triggering generation of a composite image having sufficient resolution to facilitate the downstream processing in response to detecting one or more frames of image data are characterized by a resolution, and/or a region having a resolution, less than the minimum capture resolution appropriate for capturing images of those particular objects.

Claims

1. A computer-implemented method, comprising:

receiving image data via a mobile device, the image data comprising a plurality of frames; and

generating a composite image based on at least two of the plurality of frames.

2. The method as recited in claim 1, wherein the at least two of the plurality of frames are each characterized by a reduced resolution;

and

wherein the composite image is characterized by a higher resolution.

3. The method as recited in claim 2, wherein the reduced resolution is a resolution in a range from about 256 pixels by about 256 pixels to about 480 pixels by about 270 pixels;

and

wherein the higher resolution is at least about 1000 pixels by about 1000 pixels.

4. The method as recited in claim 1, wherein the at least two of the plurality of frames are each characterized by a blurred region;

and

wherein the composite image is characterized by an absence of the blurred region.

5. The method as recited in claim 4, wherein a location of the blurred region in each of the at least two of the plurality of frames is the same;

and

wherein a location of the absence of the blurred region in the composite image is the same as the location of the blurred region in each of the at least two of the plurality of frames.

6. The method as recited in claim 1, wherein each of the at least two of the plurality of frames comprises binary image data, and the method comprising one or more of comparing, merging, and extracting data from one or more of the composite image and the at least two of the plurality of frames.

7. The method as recited in claim 6, wherein the data comprises text characters.

8. The method as recited in claim 1, comprising capturing the image data, wherein the image data comprise video data.

9. The method as recited in claim 1, wherein the image data depict a plurality of objects,

wherein each of the plurality of objects is depicted in a different set of one or more of the plurality of frames;

wherein the composite image depicts at least one of the plurality of objects;

wherein one or more of the at least two frames are selected from one of the different sets of one or more frames; and

wherein one or more other of the at least two frames are selected from another of the different sets of one or more frames.

10. The method as recited in claim 1, wherein each of the plurality of frames is Characterized by a different resolution ranging from about 25 pixels by about 25 pixels to about 256 pixels by about 256 pixels.

11. The method as recited in claim 10, comprising determining whether one or more of the frames depict an object exhibiting one or more defining characteristics.

12. The method as recited in claim 11, comprising, in response to determining one or more of the frames depict the object, setting a minimum capture resolution for capturing other objects exhibiting the one or more defining characteristics.

13. The method as recited in claim 12, comprising receiving user feedback confirming or negating whether the one or more frames depict the object, wherein the minimum capture resolution is set in further response to determining the user feedback confirms the one or more frames depict the object.

14. The method as recited in claim 12, wherein the minimum capture resolution is at least as high as a lowest solution of the one or more frames determined to depict the object.

15. The method as recited in claim 10, comprising determining whether one or more of the frame(s) determined to depict the object satisfy one or more predetermined quality control criteria.

16. The method as recited in claim 15, comprising, in response to determining one or more of the frames depict the object, setting a minimum capture resolution for capturing other objects exhibiting the one or more defining characteristics.

17. The method as recited in claim 16, wherein the minimum capture resolution is at least as high as a lowest resolution of the one or more frames determined to depict the object.

18. A computer program product comprising:

a computer readable storage medium having program code embodied therewith, the program code readable/executable by a processor to;

receive image data via a mobile device, the image data comprising a plurality of frames; and

generate a composite image based on at least two of the plurality of frames.

19. The computer program product as recited in claim 18, wherein the at least two of the plurality of frames are each characterized by a reduced resolution;

and

wherein the composite image is characterized by a higher resolution.

20. The computer program product as recited in claim 18, wherein the at least two of the plurality of frames are each characterized by a blurred region;

and

wherein the composite image is characterized by absence of the blurred region.