Apparatus and method for increasing a digital camera image capture rate by delaying image processing

• US RE39,213 E1
• Filed: 02/02/2001
• Issued: 08/01/2006
• Est. Priority Date: 04/11/1996
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: Anderson, Eric C., Masukawa, Mike M.
• Primary Examiner(s): Garber, Wendy R.
• Assistant Examiner(s): MISLEH, JUSTIN P
• Application Number:
  US09/775,720
• Time in Patent Office: 2,006 Days
• Field of Search: 348/220.1, 348/231, 348/232, 348/233, 348/319, 348/231.1, 348/231.2, 348/231.3, 348/231.7, 348/231.99, 348/207.1, 386/4, 386/33, 386/45, 386/51, 386/111, 386/112, 386/125, 386/126
• US Class Current: 348/231.99
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 1/2141 in a multi-frame buffer
• CPC Class Codes: H04N 1/215 Recording a sequence of still pictures, e.g. burst mode
• CPC Class Codes: H04N 2101/00 Still video cameras

Abstract

An apparatus for increasing a digital camera image capture rate comprises an imaging device for capturing raw image data, a frame buffer for receiving the image data, a first RAM spooler for transferring the raw image data to a RAM disk, a first flash spooler for transferring the raw image data from the RAW disk to a flash memory, an image processor for processing and compressing the raw data, a second RAM spooler for storing the compressed image data into the RAM disk, and a second flash spooler for transferring the compressed image data from the RAM disk to the flash memory.

Claims

1. A method for increasing a digital camera image capture rate, comprising the steps of:

capturing an image upon detecting an image capture request;

storing the image in a memory device;

repeating the capturing and storing steps if another image capture request is detected;

performing image processing and compression on the image;

halting the image processing/compression step and returning to the capturing step if another image capture request is detected; and

resuming the image processing/compression step after the capturing, storing and repeating steps have been performed.

2. The method of claim 1 further comprising the steps of:

deleting the image before the storing step if an image deletion request is detected; and

deleting the image before the image processing/compression step if the image deletion request is detected.

3. The method of claim 1 wherein:

the image is a raw image;

the capturing step further comprises the step of placing the raw image in a frame buffer;

the memory device is comprised of a first memory device and a second memory device, and

the storing step further comprises the steps of;

(a) skipping to step (e), if the first memory device does not have room for another raw image;

(b) copying the raw image from the frame buffer to the first memory device;

(c) deleting the raw image from the frame buffer;

(d) returning to said capturing step if another raw image capture request is detected;

(e) skipping to the image processing and compression step if the second memory device does not have room for another raw image;

(f) copying the raw image from the first memory device to the second memory device;

(g) halting step (f) and returning to step (a) if the image capture request is detected;

(h) deleting the raw image from the first memory device; and

(i) returning to step (b) if another raw image can be moved from the frame buffer to the first memory device.

4. The method of claim 3, wherein the image processing and compression step further comprises the steps of:

processing the raw image from the frame buffer if the raw image is located in the frame buffer;

processing the raw image from the first memory device if the raw image is located in the first memory device;

processing the raw image from the second memory device if the raw image is located in the second memory device;

halting the image processing and compression step and returning to said capturing step if the image capture request is detected;

halting the image processing and compression step and returning to step (b) if at least one more raw image can be copied from the frame buffer to the first memory device;

halting the image processing and compression step and returning to step (f) if at least one more raw image can be copied from the first memory device to the second memory device; and

storing a compressed image in a memory device.

5. The method of claim 4 wherein the first memory device is a RAM disk and the second memory device is a removable flash memory.

20. The method of claim 1 wherein the memory device is a flash memory.

21. The method of claim 1 wherein the memory device is comprised of a first memory device and a second memory device and at least one of either the first memory device or the second memory device is a flash memory.

6. An apparatus for increasing a digital camera image capture rate, comprising:

means for capturing an image upon detecting an image capture request;

means for storing the image in a memory device;

means for repeating the capturing and storing if another image capture request is detected;

means for performing image processing and compression on the image;

means for halting the image processing and compression means and returning to the capturing means if another image capture request is detected; and

means for resuming the image processing and compression means after the capturing, storing and repeating means have been performed.

7. The apparatus of claim 6 further comprising:

means for deleting the image before the storing means if an image deletion request is detected; and

means for deleting the image before the image processing and compression means if the image deletion request is detected.

8. The apparatus of claim 6 wherein:

the image is a raw image;

the means for capturing further comprises means for placing the raw image in a frame buffer;

the memory device is comprised of a first memory device and a second memory device, and

the storing means further comprises;

(a) means for skipping to means (e) if the first memory device does not have room for another raw image;

(b) means for copying the raw image from the frame buffer to the first memory device;

(c) means for deleting the raw image from the frame buffer;

(d) means for returning to means for capturing if another raw image capture request is detected;

(e) means for skipping to the image processing and compression means if the second memory device does not have room for another raw image;

(f) means for copying the raw image from the first memory device to the second memory device;

(g) means for halting means (f) and returning to means (a) if the image capture request is detected;

(h) means for deleting the raw image from the first memory device; and

(i) means for returning to means (b) if another raw image can be moved from the frame buffer to the first memory device.

9. The apparatus of claim 8, wherein the image processing and compression means further comprises:

means for processing the raw image from the frame buffer if the raw image is located in the frame buffer;

means for processing the raw image from the first memory device if the raw image is located in the first memory device;

means for processing the raw image from the second memory device if the raw image is located in the second memory device;

means for halting the image processing and compression means and returning to the means for capturing if the image capture request is detected;

means for halting the image processing and compression means and returning to means (b) if at least one more raw image can be copied from the frame buffer to the first memory device;

means for halting the image processing and compression means and returning to means (f) if at least one more raw image can be copied from the first memory device to the second memory device; and

means for storing a compressed image in a memory device.

10. The apparatus of claim 9 wherein the first memory device is a RAM disk and the second memory device is a removable flash memory.

22. The apparatus of claim 6 wherein the memory device is a flash memory.

23. The apparatus of claim 6 wherein the memory device is comprised of a first memory device and a second memory device and at least one of either the first memory device or the second memory device is a flash memory.

11. A computer readable medium comprising program instructions for:

capturing an image upon detecting an image capture request;

storing the image in a memory device;

repeating the capturing and storing steps if another image capture request is detected;

performing image processing and compression on the image;

halting the image processing and compression step and returning to the capturing step if another image capture request is detected; and

resuming the image processing and compression step after the capturing, storing and repeating steps have been performed.

12. The medium of claim 11 further comprising instructions for:

deleting the image before the storing step if an image deletion request is detected; and

deleting the image before the image processing and compression step if the image deletion request is detected.

13. The medium of claim 11 wherein:

the image is a raw image;

the capturing step further comprises the step of placing the raw image in a frame buffer;

the memory device is comprised of a first memory device and a second memory device, and

the storing step further comprises the steps of;

(a) skipping to step (e) if the first memory device does not have room for another raw image;

(b) copying the raw image from the frame buffer to the first memory device;

(c) deleting the raw image from the frame buffer;

(d) returning to said capturing step if another raw image capture request is detected;

(e) skipping to the image processing and compression step if the second memory device does not have room for another raw image;

(f) copying the raw image from the first memory device to the second memory device;

(g) halting step (f) and returning to said capturing step if the image capture request is detected;

(h) deleting the raw image from the first memory device; and

(i) returning to step (b) if another raw image can be moved from the frame buffer to the first memory device.

14. The medium of claim 13 wherein the image processing and compression step further comprises the steps of:

processing the raw image from the frame buffer if the raw image is located in the frame buffer;

processing the raw image from the first memory device if the raw image is located in the first memory device;

processing the raw image from the second memory device if the raw image is located in the second memory device;

halting the image processing and compression step and returning to said capturing step if the image capture request is detected;

halting the image processing and compression step and returning to step (b) if at least one more raw image can be copied from the frame buffer to the first memory device;

halting the image processing and compression step and returning to step (f) if at least one more raw image can be copied from the first memory device to the second memory device; and

storing a compressed image in a memory device.

15. The medium of claim 14 wherein the first memory device is a RAM disk and the second memory device is a removable flash memory.

16. An apparatus for increasing a digital camera image capture rate, comprising:

an imaging device for generating raw image data responsive to an image capture request;

a digital memory buffer for initially storing the raw image data;

first routines for conveying the initially stored raw image data away from the frame digital memory buffer to a second memory location to provide space for storing additional, subsequently captured images, wherein the raw image data is stored in uncompressed form in the second memory location and wherein the second memory has the capacity to store complete raw image data for multiple raw images;

second routines for conveying said raw image data from the second memory to a processor for processing said raw image data and for storing said processed image data; and

a central processing unit coupled to the imaging device and to the digital memory buffer, for executing according to a predetermined set of priorities the first and second routines;

wherein the first routines are assigned priority over the second routines to thereby facilitate the rapid conveyance of raw image data away from the frame digital memory buffer.

17. The apparatus of claim 16, wherein the first routines are configured to convey the initially stored raw image data from the frame digital memory buffer to a RAM disk.

18. The apparatus of claim 17, wherein the second routines include:

a routine for transferring raw image data from the RAM disk to a flash memory;

a routine for compressing raw image data;

a routine for storing the compressed image data in the RAM disk; and

a routine for transferring the compressed image data from the RAM disk to the flash memory;

wherein the routine for transferring raw image data from the RAM disk to a flash memory has priority over the routine for compressing raw image data, the routine for compressing raw image data has priority over the routine for storing the compressed image data in the RAM disk, and the routine for storing the compressed image data in the RAM disk has priority over the routine for transferring the compressed image data from the RAM disk to the flash memory.

31. The apparatus of claim 16 wherein the central processing unit and imaging device are both embedded in a single physical apparatus.

32. The apparatus of claim 16 wherein the central processing unit is physically embedded in a personal computer to which the imaging device is communicatively coupled.

19. An apparatus for increasing image capture rate, comprising:

an imaging device for generating raw image data responsive to an image capture request;

a digital memory buffer for storing the raw image data; and

a central processing unit coupled to the imaging device and the digital memory buffer, for transferring the raw image data to a second memory that is external to any processing chip, transferring the raw image data from the second memory to a processor for processing the raw image data and storing the processed image data according to a predetermined set of priorities, wherein transferring the raw image data to the second memory has a higher priority than transferring the raw image data to a processor.

24. An apparatus for increasing a digital camera capture rate comprising:

a first spooler routine which moves raw image data out of a digital frame buffer and into a second memory that is external to any processor, the first spooler routine having a highest priority;

a processing/compression routine which compresses raw image data from the second memory, the processing/compression routine having a middle priority;

a second spooler routine which moves compressed image data into flash memory, the second spooler routine having a lowest priority; and

a processor for executing the routines according to their priority and according to available processor time.

25. The apparatus of claim 24 further comprising:

a third spooler routine which moves raw image data out of the second memory, the third spooler routine having a priority between that of the first spooler routine and that of the processing/compression routine.

26. The apparatus of claim 24 further comprising:

a third spooler routine which moves compressed image data back to the second memory, the third spooler routine having a priority between that of the processing/compression routine and that of the second spooler routine.

27. A method for increasing a digital camera capture rate comprising the steps of:

transferring raw image data out of a digital frame buffer and into a second independent memory;

processing and compressing raw image data from the second independent memory if either

the transferring raw image data step is complete or

processor time is available during the transferring raw image data step; and

transferring compressed image data from the second independent memory to flash memory if either

the processing and compressing step is complete or

processor time is available during the processing and compressing step.

28. An apparatus for increasing image capture rate comprising:

a raw-image input coupled to a raw-image storage, the raw-image input for capturing a raw image and storing it in the raw image storage;

a processor that

compresses a raw image only when either

the raw-image input is no longer capturing and storing raw images, or processor time becomes available; and

pauses the compression of raw images if the raw image input begins to capture new raw images, and resumes compressing raw images when either

the raw-image input is no longer capturing and storing raw images, or processor time becomes available.

29. The apparatus of claim 28 wherein the raw-image storage comprises a first storage device and a second storage device.

30. The apparatus of claim 29 wherein at least one of either the first storage device or the second storage device is a flash memory.

33. The apparatus of claim 28 wherein the processor and raw image input are both embedded in a single physical apparatus.

34. The apparatus of claim 28 wherein the processor is physically embedded in a personal computer to which the raw image input is communicatively coupled.

35. An apparatus for increasing image capture rate, comprising:

an imaging device for generating raw image data responsive to an image capture request;

a digital memory buffer for initially storing the raw image data;

first routines for conveying the initially stored raw image data to a second memory to provide space for storing additional, subsequently captured images in the digital memory buffer, wherein the second memory has the capacity to store complete raw image data for multiple raw images;

second routines for compressing said raw image data, wherein the second routines are not conducted until there are no pending image capture requests and the first routines have conveyed all initially stored raw image data away from the digital memory buffer.

36. An apparatus for increasing image capture rate, comprising:

an imaging device for generating raw image data responsive to an image capture request;

a digital memory buffer for receiving and storing the raw image data; and

a central processing unit coupled to the imaging device and the digital memory buffer, for transferring the raw image data to a second memory, processing the raw image data without the assistance of a second processor and storing the processed image data according to a predetermined set of priorities, wherein transferring the raw image data has a higher priority than processing the raw image data.