Intelligent feature selection and pan zoom control

• US 7,248,294 B2
• Filed: 07/05/2002
• Issued: 07/24/2007
• Est. Priority Date: 07/10/2001
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Slatter, David Neil
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US10/188,993
• Publication Number:
  US 20030025812A1
• Time in Patent Office: 1,845 Days
• Field of Search: 348/240.99
• US Class Current: 348/240.99
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/20132 Image cropping
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

A method of automatically selecting regions of interest within an image in response to a selection signal, and panning across an image so as to keep the selected region in view is disclosed, together with an image processing system employing the method.

Claims

1. An electronic image processing device including an image processor arranged to analyse an image to identify a plurality of regions of interest within the image, and in which the image processor presents the results of its analysis to a user such that a user can operate an image selector to select one of the regions of interest as a zoom target, wherein the image processor compares the regions of interest to determine if individual regions of interest can be grouped together to form a composite region of interest.

2. An electronic image processing device as claimed in claim 1 further comprising a zoom control allowing the user to zoom towards or away from the zoom target.

3. An electronic image processing device as claimed in claim 1, in which the image processor identifies non-overlapping regions of interest within the image.

4. An electronic image processing device as claimed in claim 1, where the image processor is further arranged to calculate crop boundaries for the regions of interest, and where each crop conforms to at least one rule of image composition.

5. An electronic image processing device as claimed in claim 1 wherein, for any view of the image, analysis of the image can be invoked by the user to cause the image processor to identifly further regions of interest.

6. An electronic image processing device as claimed in claim 1, wherein said image processor assigns an interest rating to the or each region of interest.

7. An electronic image processing device according to claim 6, wherein said regions of interest are selected for display according to said interest rating.

8. An electronic image processing device as claimed in claim 1, wherein said image processor calculates a cropped view for the regions of interest and assigns a quality rating to each of said cropped views.

9. An electronic image processing device according to claim 8, wherein in response to said image selector said image processor sequentially selects said views according to said quality ratings.

10. An electronic image processing device as claimed in claim 1, wherein the image processor is responsive to a user operated zoom control, and as a zoom is varied, the image processor automatically pans over the image to maintain the selected region of interest within the portion of the image displayed on the display.

11. An electronic image processing system as claimed in claim 1, wherein said image selector is wirelessly coupled to said image processor.

12. An electronic camera system for capturing an electronic image

comprising an electronic image processing device as claimed in claim 1 and a display responsive to the image processing device.

13. An electronic image processing device including an image processor arranged to analyse an image to identify a plurality of regions of interest within the image, and in which the image processor presents the results of its analysis to a user such that a user can operate an image selector to select one of the regions of interest as a zoom target wherein for a user selected level of zoom the image processor searches for neighbours of the selected regions of interest, and if such regions exist, pans across the image so as to optimise the number of regions of interest displayed for a given amount of zoom.

14. An electronic image processing device as claimed in claim 13, in which the number of whole regions of interest that can be displayed is maximised.

15. An electronic image processing device as claimed in claim 14, in which the image processor seeks to minimise the number of partially displayed regions of interest.

16. An electronic device for displaying digital images, comprising an image processor, a user operable input device for identifying a zoom target and a user operable zoom control, wherein the image processor automatically analyses an image to identify at least one region of interest, and wherein the results of the analysis are presented to a user such that he user can select one region of interest as a zoom target and control via the zoom control the level of zoom, wherein the image processor compares the regions of interest to determine if individual regions of interest can be grouped together to form a composite region of interest.

17. An electronic device as claimed in claim 16, in which the image processor automatically pans the displayed image so as to keep the zoom target displayed as the level of zoom is varied.

18. An electronic device as claimed in claim 17 in which the image is pans smoothly as the zoom changes.

19. An electronic device as claimed in claim 16, in which the electronic image is a single still image.

20. An electronic device as claimed in claim 19, in which the image processor automatically calculates a crop boundary associated with each region of interest.

21. An electronic device for displaying digital images, comprising an image processor, a user operable input device for identifying a zoom target and a user operable zoom control, wherein the image processor automatically analyses an image to identify at least one region of interest, and wherein the results of the analysis are presented to a user such that he user can select one region of interest as a zoom target and control via the zoom control the level of zoom, wherein the image processor automatically pans the displayed image so as to keep the zoom target displayed as the level of zoom is varied, and in which the image processor searches for regions of interest other than the selected regions of interest and seeks to include these in the displayed image.

22. A method of displaying an electronic image, the method comprising the steps of analysing an image to select a plurality of regions of interest within the image and in which the results of the analysis are presented to a user such that the user can select one of the regions of interest as a zoom target which remains displayed irrespective of a user selected zoom wherein the image processor compares the regions of interest to determine if individual regions of interest can be grouped together to form a composite region of interest.

23. A method as claimed in claim 22, in which a crop boundary is calculated for each region of interest and the user can vary the zoom between no zoom and a level limited by the entirety of the image within the crop boundary being displayed.

24. A method as claimed in claim 22, in which the level of zoom is user controllable.

25. A method as claimed in claim 22, in which the image processor identifies non-overlapping regions of interest within the image.

26. A method as claimed in claim 22, where the target crop conforms to at least one rule of image composition.

27. A method as claimed in claim 22 wherein, for any view of the image, analysis of the image can be invoked by the user to cause the image processor to identify further regions of interest.

28. A method as claimed in claim 22, further comprising the step of evaluating a level of interest of each region of interest and assigning a rating to each region of interest indicative of said level of interest.

29. A method as claimed in claim 22, in which for any given level of zoom, the image processor pans across the image such that the number of whole regions of interest displayed is maximised.

30. A method of displaying an electronic image, the method comprising the steps of analysing an image to select a plurality of regions of interest within the image and in which the results of the analysis are presented to a user such that the user can select one of the regions of interest as a zoom target which remains displayed irrespective of a user selected zoom;

further comprising the step of evaluating a level of interest of each region of interest and assigning a rating to each region of interest indicative of said level of interest, wherein said regions are sequentially displayed in order of said assigned rating in response to said region of interest selection signal.

31. A method of displaying an electronic image, the method comprising the steps of automatically analysing an image to identify at least one region of interest and an associated crop boundary and wherein the results of the analysis are presented to a user such that the user can select one region of interest as the zoom target and control via a zoom control a level of zoom;

and searching for regions of interest other than the selected region of interest and seeking to include these in the displayed image if the level of zoom so permits.

32. A method as claimed in claim 31, in which the image is automatically panned so as to keep the zoom target displayed as the level of zoom is varied.