Gesture-Based Configuration of Image Processing Techniques

• US 20120242852A1
• Filed: 03/21/2011
• Published: 09/27/2012
• Est. Priority Date: 03/21/2011
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Hayward, David, Zhang, Chendi
• Application Number:
  US13/052,895
• Publication Number:
  US 20120242852A1
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

This disclosure pertains to apparatuses, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image filters, while simultaneously setting auto exposure, auto focus, auto white balance, and/or other image processing technique input parameters based on the appropriate underlying image sensor data in a way that provides a seamless, dynamic, and intuitive experience for both the user and the client application software developer. Such techniques may handle the processing of image filters applying location-based distortions as well as those image filters that do not apply location-based distortions to the captured image data. Additionally, techniques are provided for increasing the performance and efficiency of various image processing systems when employed in conjunction with image filters that do not require all of an image sensor'"'"'s captured image data to produce their desired image filtering effects.

Claims

1. An image processing method, comprising:

applying an image filter to an unfiltered image to generate a first filtered image at an electronic device;

receiving input indicative of a location in the first filtered image from one or more sensors in communication with the electronic device;

associating an input parameter for a first image processing technique with the received input;

translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image;

assigning a value to the input parameter based on the translated received input;

applying the first image processing technique to generate a second filtered image, the input parameter having the assigned value; and

storing the second filtered image in a memory.

2. The method of claim 1, wherein the first image processing technique comprises one of:

auto exposure, auto focus, and auto white balance.

3. The method of claim 1, wherein the act of receiving input indicative of a location in the first filtered image from one or more sensors in communication with the electronic device comprises receiving gesture input from an electronic device having a touch-sensitive display.

4. The method of claim 3, wherein the act of receiving gesture input comprises receiving gesture input corresponding to a single point of contact with the touch-sensitive display.

5. The method of claim 3, wherein the act of assigning a value to the input parameter comprises mapping the gesture input to a value, wherein the value is limited to a predetermined range, and wherein the predetermined range is based on the input parameter.

6. The method of claim 1, further comprising the act of displaying the second filtered image on a display.

7. The method of claim 1, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image comprises applying an inverse of the image filter to the location in the first filtered mage.

8. The method of claim 1, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image comprises determining a position and size of a region in the unfiltered image.

9. The method of claim 1, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image is based on a characteristic of the image filter.

10. The method of claim 1, further comprising the act of:

receiving a stream of unfiltered images captured by a camera of the electronic device,

wherein the act of assigning a value to the input parameter based on the received input comprises adjusting the input parameter incrementally towards the value over the course of a determined number of consecutively captured unfiltered images from the stream.

33. An apparatus comprising:

an image sensor for capturing an image representative of a scene;

a display;

a memory in communication with the image sensor; and

a programmable control device communicatively coupled to the image sensor, the display, and the memory, wherein the memory includes instructions for causing the programmable control device to perform the method of claim 1.

34. The apparatus of claim 33, wherein the display comprises a touch-sensitive display.

35. A computer usable medium having a computer readable program code embodied therein, wherein the computer readable program code is adapted to be executed to implement the method of claim 1.

11. An image processing method, comprising.

receiving, at an electronic device, a selection of a first filter to apply to an unfiltered image;

applying the first filter to the unfiltered image to generate a first filtered image;

receiving input indicative of a location in the first filtered image from one or more sensors in communication with the electronic device;

associating a first input parameter for the first filter with the received input;

assigning a first value to the first input parameter based on the received input;

associating a second input parameter for a first image processing technique with the received input;

translating the received input from the location in the first filtered image to a corresponding location in the unfiltered image;

assigning a second value to the second input parameter based on the translated received input;

applying the first filter and the first image processing technique to generate a second filtered image, the first input parameter having the first assigned value and the second input parameter having the second assigned value; and

storing the second filtered image in a memory.

12. The method of claim 11, wherein the first image processing technique comprises one of:

auto exposure, auto focus, and auto white balance.

13. The method of claim 11, wherein the act of receiving input indicative of a location in the first filtered image from one or more sensors in communication with the electronic device comprises receiving gesture input from an electronic device having a touch-sensitive display.

14. The method of claim 13, wherein the act of receiving gesture input comprises receiving gesture input corresponding to a single point of contact with the touch-sensitive display.

15. The method of claim 13, wherein the act of assigning a first value to the first input parameter comprises mapping the gesture input to a value, wherein the value is limited to a predetermined range, and wherein the predetermined range is based on the input parameter.

16. The method of claim 11, further comprising the act of displaying the second filtered image on a display.

17. The method of claim 11, wherein the act of assigning a first value to the first input parameter based on the received input comprises applying a first translation to the received input, wherein the first translation applied is based on the received input.

18. The method of claim 17, wherein the received input is indicative of a position on a touch-sensitive display of the electronic device.

19. The method of claim 17, wherein the electronic device comprises a plurality of cameras, and wherein the first translation applied to the received input is based on the camera used by the electronic device to capture the image.

20. The method of claim 11, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image comprises applying an inverse of the first filter to the location in the first filtered image.

21. The method of claim 11, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image comprises determining a position and size of a region in the unfiltered image.

22. The method of claim 11, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image is based on a characteristic of the first filter.

23. The method of claim 11, further comprising the act of:

receiving a stream of unfiltered images captured by a camera of the electronic device,

wherein the act of assigning a first value to the first input parameter based on the received input comprises adjusting the first input parameter incrementally towards the first value over the course of a determined number of consecutively captured unfiltered images from the stream.

24. The method of claim 11, further comprising the act of:

receiving a stream of unfiltered images captured by a camera of the electronic device,

wherein the act of assigning a second value to the second input parameter based on the translated received input comprises adjusting the second input parameter incrementally towards the second value over the course of a determined number of consecutively captured unfiltered images from the stream.

25. An image processing method, comprising:

applying an image filter to an unfiltered image to generate a first filtered image at an electronic device;

receiving input indicative of a location in the first filtered image from one or more sensors in communication with the electronic device;

associating an input parameter for a first image processing technique with the received input;

translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image;

determining a relevant portion of the unfiltered image based on a characteristic of the image filter;

assigning a value to the input parameter based on the translated received input;

applying the first image processing technique based on the determined relevant portion of the unfiltered image to generate a second filtered image, the input parameter having the assigned value; and

storing the second filtered image in a memory.

26. The method of claim 25, wherein the first image processing technique comprises one of:

auto exposure, auto focus, and auto white balance.

27. The method of claim 25, further comprising the act of:

receiving a stream of unfiltered images captured by a camera of the electronic device,

wherein the amount of image data captured by an image sensor of the camera is limited based on the determined relevant portion.

28. The method of claim 25, further comprising the act of displaying the second filtered image on a display.

29. The method of claim 25, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image comprises applying an inverse of the image filter to the location in the first filtered image.

30. The method of claim 25, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image comprises determining a position and size of a region in the unfiltered image.

31. The method of claim 25, wherein the act of translating the received input from a location in the first filtered image to a corresponding location in the unfiltered image is based on a characteristic of the image filter.

32. The method of claim 25, further comprising the acts of:

associating a first input parameter for the image filter with the received input;

assigning a first value to the first input parameter based on the received input; and

applying the image filter in conjunction with the first image processing technique based on the determined relevant portion of the unfiltered image to generate the second filtered image, the first input parameter having the first assigned value.