Systems and methods for improving video captured using mobile devices

• US 9,584,729 B2
• Filed: 12/28/2015
• Issued: 02/28/2017
• Est. Priority Date: 05/03/2013
• Status: Active Grant

• Current Assignee: Kofax Incorporated
• Original Assignee: Kofax Incorporated
• Inventors: Amtrup, Jan W., Ma, Jiyong, Macciola, Anthony
• Primary Examiner(s): Safaipour, Houshang
• Application Number:
  US14/981,759
• Publication Number:
  US 20160112645A1
• Time in Patent Office: 428 Days
• Field of Search: 358/1.15, 358/1.9, 358/473, 358/1.14
• US Class Current: 1/1
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06V 2201/09 Recognition of logos
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: H04N 1/00251 with an apparatus for taking photographic images, e.g. a camera
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00801 according to characteristics of the original
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 2201/0032 where the still picture apparatus acts as the slave
• CPC Class Codes: H04N 2201/0075 by a user operated remote control device, e.g. receiving instructions from a user via a computer terminal or mobile telephone handset
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/0458 Additional arrangements for improving or optimising scanning resolution or quality
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/265 Mixing

Abstract

Systems, methods, and computer program products for capturing and analyzing image data, preferably video data, are disclosed. The inventive concepts include using multiple frames of image data to generate a composite image, where the composite image may be characterized by a higher resolution than one or more of the individual frames used to generate the composite image, and/or absence of a blurred region present in one or more of the individual frames. Inventive techniques also include determining a minimum capture resolution appropriate for capturing images of particular objects for downstream processing, and optionally triggering generation of a composite image having sufficient resolution to facilitate the downstream processing in response to detecting one or more frames of image data are characterized by a resolution, and/or a region having a resolution, less than the minimum capture resolution appropriate for capturing images of those particular objects.

Claims

1. A computer-implemented method, comprising:

receiving image data via a mobile device, the image data comprising a plurality of frames; and

generating a composite image based on at least two of the plurality of frames;

determining whether one or more of the frames depict an object exhibiting one or more defining characteristics; and

in response to determining one or more of the frames depict the object, setting a minimum capture resolution for capturing other objects exhibiting the one or more defining characteristics.

2. The method as recited in claim 1, wherein the at least two of the plurality of frames are each characterized by a reduced resolution;

and wherein the composite image is characterized by a higher resolution.

3. The method as recited in claim 2,

wherein the higher resolution is at least about 1000 pixels by about 1000 pixels.

4. The method as recited in claim 1, wherein the at least two of the plurality of frames are each characterized by a blurred region;

and

wherein the composite image is characterized by an absence of the blurred region.

5. The method as recited in claim 4, wherein a location of the blurred region in each of the at least two of the plurality of frames is the same;

and

wherein a location of the absence of the blurred region in the composite image is the same as the location of the blurred region in each of the at least two of the plurality of frames.

6. The method as recited in claim 1, wherein each of the at least two of the plurality of frames comprises binary image data, and the method comprising one or more of comparing and extracting data from one or more of the composite image and the at least two of the plurality of frames.

7. The method as recited in claim 6, wherein the data comprises text characters.

8. The method as recited in claim 1, comprising capturing the image data, wherein the image data comprise video data.

9. The method as recited in claim 1, wherein each of the plurality of frames is characterized by a different resolution ranging from about 25 pixels by about 25 pixels to about 256 pixels by about 256 pixels.

10. The method as recited in claim 9, comprising determining whether one or more of the frame(s) determined to depict the object satisfy one or more predetermined quality control criteria.

11. The method as recited in claim 10, wherein the predetermined quality control criteria are selected from a group consisting of:

a minimum illumination level;

a maximum illumination level;

a minimum illumination evenness;

a minimum resolution;

a minimum sharpness;

a minimum projection;

a glare presence; and

a classification of the object.

12. The method as recited in claim 10, comprising determining whether the one or more frames satisfying the one or more predefined control criteria correspond to a high-resolution image stored on the mobile device;

and

processing the high-resolution image upon determining the one or more frames satisfying the one or more predefined control criteria correspond to the high-resolution image.

13. The method as recited in claim 1, comprising receiving user feedback confirming or negating whether the one or more frames depict the object, wherein the minimum capture resolution is set in further response to determining the user feedback confirms the one or more frames depict the object.

14. The method as recited in claim 1, wherein the minimum capture resolution is at least as high as a lowest resolution of the one or more frames determined to depict the object.

15. A computer program product comprising:

a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a processor to;

receive image data via a mobile device, the image data comprising a plurality of frames;

generate a composite image based on at least two of the plurality of frames;

determine whether one or more of the frames depict an object exhibiting one or more defining characteristics; and

in response to determining one or more of the frames depict the object, set a minimum capture resolution for capturing other objects exhibiting the one or more defining characteristics.

16. The computer program product as recited in claim 15, wherein the at least two of the plurality of frames are each characterized by a reduced resolution;

and

wherein the composite image is characterized by a higher resolution.

17. The computer program product as recited in claim 15, wherein the at least two of the plurality of frames are each characterized by a blurred region;

and

wherein the composite image is characterized by an absence of the blurred region.

18. The computer program product as recited in claim 15, wherein the minimum capture resolution is at least as high as a lowest resolution of the one or more frames determined to depict the object.

19. The computer program product as recited in claim 15, wherein the at least two of the plurality of frames are each characterized by a blurred region;

wherein the composite image is characterized by an absence of the blurred region

wherein a location of the blurred region in each of the at least two of the plurality of frames is the same; and

wherein a location of the absence of the blurred region in the composite image is the same as the location of the blurred region in each of the at least two of the plurality of frames.

20. A computer-implemented method, comprising:

receiving image data via a mobile device, the image data comprising a plurality of frames; and

generating a composite image based on at least two of the plurality of frames;

wherein the at least two of the plurality of frames are each characterized by a blurred region;

wherein the composite image is characterized by an absence of the blurred region;

wherein a location of the blurred region in each of the at least two of the plurality of frames is the same; and

wherein a location of the absence of the blurred region in the composite image is the same as the location of the blurred region in each of the at least two of the plurality of frames.