Image processing device, electronic equipment, image processing method and non-transitory computer-readable medium for enlarging objects on display

• US 10,440,277 B2
• Filed: 12/08/2017
• Issued: 10/08/2019
• Est. Priority Date: 12/08/2016
• Status: Active Grant

• Current Assignee: Morpho Incorporated
• Original Assignee: Morpho Incorporated
• Inventors: Hirai, Shun, Lee, Jaesung, Chen, Zhengyu, Satoh, Masaki, Ono, Ryo
• Primary Examiner(s): Ye, Lin
• Assistant Examiner(s): Morehead, III, John H
• Application Number:
  US15/835,464
• Publication Number:
  US 20180167558A1
• Time in Patent Office: 669 Days
• CPC Class Codes: G03B 13/12 to compensate for change of camera lens or size of picture
• CPC Class Codes: G03B 17/565 Optical accessories, e.g. converters for close-up photography, tele-convertors, wide-angle convertors
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G09G 2320/103 Detection of image changes, e.g. determination of an index representative of the image change
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: G09G 5/36 characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6815 by distinguishing pan or tilt from motion
• CPC Class Codes: H04N 23/682 Vibration or motion blur correction
• CPC Class Codes: H04N 23/683 : performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/70 : Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof

Abstract

It is an object of the present disclosure to enable displaying information on unused area of an input image while displaying an enlarged image of the input image An image processing device includes a specified area setting part configured to set a specified area in an input image, an additional information setting part configured to set additional information on at least a part of non-specified area which is an area in the input image other than the specified area, and a display control part configured to display the specified area and the additional information on the display as an output image. The user can view the image of the specified area and the additional information at the same time. Therefore, the device can utilize the information of the input image more effectively.

Claims

1. An image processing device, comprising:

a display;

an input part to which an image is input; and

a hardware processor configured to implement;

a specified area setting part configured to set a specified area in the input image;

a display control part configured to display the specified area on the display;

an additional information setting part configured to set additional information on at least a part of a non-specified area that is an area other than the specified area of the input image; and

an additional information display control part configured to display the additional information on the display,

wherein the specified area setting part updates the specified area corresponding to an update of the input image, and

the additional information setting part updates the additional information corresponding to the update of the input image, wherein the additional information comprises information on an object in the non-specified area, and the additional information display control part makes a determination as to whether to display the additional information of the object on the display based on a distance from a location of the object to the specified area.

2. The image processing device according to claim 1, wherein the additional information display control part displays the additional information on the display in such a manner that reflects a positional relationship between the additional information and the specified area.

3. The image processing device according to claim 1, wherein the additional information comprises information on a location of the object.

4. The image processing device according to claim 1, wherein the object matches a preset characteristic.

5. The image processing device according to claim 1, wherein the object is selected by a user or matches a characteristic set by the user.

6. The image processing device according to claim 1, wherein the additional information display control part displays the additional information outside a display area of the specified area on the display.

7. The image processing device according to claim 1, wherein the additional information comprises a deformed image of the non-specified area.

8. The image processing device according to claim 7, wherein the additional information comprises an image of the non-specified area that is deformed according to a distance to the specified area.

9. The image processing device according to claim 1, wherein the specified area setting part updates the specified area in a shorter cycle than the additional information setting part updating the additional information.

10. The image processing device according to claim 1, wherein the specified area setting part sets the specified area so that a target object is included in the specified area, in which the target object is selected by a user or matches a condition set by the user.

12. The image processing device according to claim 10, wherein the specified area setting part updates the specified area corresponding to the update of the input image so that the target object is included in the specified area.

13. The image processing device according to claim 12, wherein the specified area setting part changes a magnification of the specified area corresponding to the update of the input image so that the target object is included in the specified area.

14. The image processing device according to claim 10, wherein hardware the processor is further configured to implement:

an imaging part; and

a notification part configured to prompt the user to change a photographing direction of the imaging part such that the specified area including the target object gets close to a center of the input image.

15. The image processing device according to claim 10, wherein the hardware processor further configured to implement:

an information display control part configured to display a notification of the target object being not included in the input image on the display when the target object gets out of the input image.

16. The image processing device according to claim 1, wherein the hardware processor further configured to implement:

a brightness adjusting part configured to adjust a brightness of the input image when the input image includes an object that meets a predetermined brightness condition.

11. An image processing device, comprising:

a display;

an input part to which an image is input; and

a hardware processor configured to implement;

a specified area setting part configured to set a specified area in the input image;

a display control part configured to display the specified area on the display;

an additional information setting part configured to set additional information on at least a part of a non-specified area that is an area other than the specified area of the input image; and

an additional information display control part configured to display the additional information on the display,

wherein the specified area setting part updates the specified area corresponding to an update of the input image, and

the additional information setting part updates the additional information corresponding to the update of the input image, wherein when the additional information is selected according to a user input, the specified area setting part sets the specified area so that a corresponding object of the additional information is included in the specified area.

17. An image processing method for performing image processing, comprising:

an input step of inputting an image;

a specified area setting step of setting a specified area in the input image;

a display control step of displaying the specified area on a display;

an additional information setting step of setting additional information on at least a part of a non-specified area that is an area other than the specified area of the input image; and

an additional information display control step of displaying the additional information on the display,

wherein the specified area setting step comprises updating the specified area corresponding to an update of the input image, and

the additional information setting step comprises updating the additional information corresponding to the update of the input image, wherein the additional information comprises information on an object in the non-specified area, and the additional information display control part makes a determination as to whether to display the additional information of the object on the display based on a distance from a location of the object to the specified area.

18. A non-transitory computer-readable medium storing a program that makes a computer perform image processing that comprises:

an input step of inputting an image;

a specified area setting step of setting a specified area in the input image;

a display control step of displaying the specified area on a display;

an additional information setting step of setting additional information on at least a part of a non-specified area that is an area other than the specified area of the input image; and

an additional information display control step of displaying the additional information on the display,

wherein the specified area setting step comprises updating the specified area corresponding to an update of the input image, and

the additional information setting step comprises updating the additional information corresponding to the update of the input image, wherein the additional information comprises information on an object in the non-specified area, and the additional information display control part makes a determination as to whether to display the additional information of the object on the display based on a distance from a location of the object to the specified area.

19. An image processing method for performing image processing, comprising:

an input step of inputting an image;

a specified area setting step of setting a specified area in the input image;

a display control step of displaying the specified area on a display;

an additional information setting step of setting additional information on at least a part of a non-specified area that is an area other than the specified area of the input image; and

an additional information display control step of displaying the additional information on the display,

wherein the specified area setting step comprises updating the specified area corresponding to an update of the input image, and

the additional information setting step comprises updating the additional information corresponding to the update of the input image, wherein when the additional information is selected according to a user input, the specified area setting part sets the specified area so that a corresponding object of the additional information is included in the specified area.

20. A non-transitory computer-readable medium storing a program that makes a computer perform image processing that comprises:

an input step of inputting an image;

a specified area setting step of setting a specified area in the input image;

a display control step of displaying the specified area on a display;

an additional information setting step of setting additional information on at least a part of a non-specified area that is an area other than the specified area of the input image; and

an additional information display control step of displaying the additional information on the display,

wherein the specified area setting step comprises updating the specified area corresponding to an update of the input image, and

the additional information setting step comprises updating the additional information corresponding to the update of the input image, wherein when the additional information is selected according to a user input, the specified area setting part sets the specified area so that a corresponding object of the additional information is included in the specified area.