Image display apparatus having image-related information displaying function

• US 10,015,403 B2
• Filed: 07/19/2016
• Issued: 07/03/2018
• Est. Priority Date: 12/03/2001
• Status: Expired due to Term

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Kusaka, Yosuke, Nakamura, Shoei
• Primary Examiner(s): VILLECCO, JOHN M
• Application Number:
  US15/213,845
• Publication Number:
  US 20160330381A1
• Time in Patent Office: 714 Days
• Field of Search: 34833302, 348239, 3482313
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04N 1/00106 using land mobile radio networks, e.g. mobile telephone
• CPC Class Codes: H04N 1/00114 with transmission of additional information signals for control or supervision between transmitter and receiver H04N1/32101
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G
• CPC Class Codes: H04N 1/00153 for sharing images with a selected individual or correspondent
• CPC Class Codes: H04N 1/00251 with an apparatus for taking photographic images, e.g. a camera
• CPC Class Codes: H04N 1/00281 with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal details of transmission H04N1/00095; establishing a communication with one of a facsimile machine or another apparatus sharing a single line H04N1/32704; interfacing cordless telephone terminals with an accessory to increase the functionality of user interface H04M1/72409
• CPC Class Codes: H04N 1/0097 Storage of instructions or parameters, e.g. customised instructions or different parameters for different user IDs
• CPC Class Codes: H04N 1/2125 Display of information relating to the still picture recording
• CPC Class Codes: H04N 1/32101 Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/611 : where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/64 : Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 : Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

An image display method displays image data obtained through a photographing operation performed at an image-capturing apparatus having a photographic optical system. The method includes: (i) image-capturing in which image data are generated by photographing a subject within a photographic image plane with the image-capturing apparatus; (ii) information collection in which subject information related to the subject is collected; (iii) correlating in which the subject information is made to correlate to a position within the photographic image plane; (iv) image display in which the image data are displayed at a display screen; (v) position specification in which a position on the display screen at which the image data are displayed is specified; and (vi) information display in which the subject information made to correlate to a position within the photographic image plane corresponding to the position specified in the position specification is displayed.

Claims

1. An image display method for displaying image data obtained through a photographing operation performed at an image-capturing apparatus having a photographic optical system, the method comprising:

an image-capturing step in which image data are generated by photographing a subject within a photographic image plane with the image-capturing apparatus;

an information collection step in which subject information related to the subject is collected;

a correlating step in which the subject information is made to correlate to a position within the photographic image plane;

an image display step in which the image data are displayed at a display screen;

a position specification step in which a position on the display screen at which the image data are displayed is specified; and

an information display step in which the subject information made to correlate to a position within the photographic image plane corresponding to the position specified in the position specification step is displayed, wherein;

in the correlating step, image-plane position information indicating a subject position within the photographic image plane is detected by analyzing the subject position within the photographic image plane through an image analysis of the image data and the subject information is made to correlate with a position within the photographic image plane by using the image-plane position information.

2. The image display method according to claim 1, wherein:

the information collection step is started up in response to an operation of an electronic instrument held by the subject to collect the subject information related to the subject from the electronic instrument.

3. The image display method according to claim 1, wherein:

the information collection step comprises;

a collection step in which the subject information related to the subject is collected from an electronic instrument held by the subject through communication with the electronic instrument; and

a display step in which the collected subject information is displayed.

4. The image display method according to claim 1, wherein:

in the information collection step, the subject information related to the subject is collected from an electronic instrument held by the subject through communication with the electronic instrument executed with a timing substantially at an operational timing of the image-capturing step.

5. The image display method according to claim 1, wherein:

the information collection step is manually started up with a timing bearing no relation to an operational timing of the image-capturing step to collect the subject information related to the subject from an electronic instrument held by the subject through communication with the electronic instrument.

6. The image display method according to claim 1, wherein:

the correlating step comprises;

a positional measurement step in which photographing position information is generated by detecting a position of the image-capturing apparatus;

an attitude detection step in which photographing attitude information is generated by detecting the attitude of the image-capturing apparatus;

a step in which subject position information indicating a position of the subject is collected from an electronic instrument held by the subject through communication with the electronic instrument;

a step in which the image-plane position information indicating the position of the subject within the photographic image plane is detected based upon photographic field angle information obtained in conformance to a focal length of the photographic optical system and an image-capturing size at the image-capturing apparatus, the subject position information, the photographing position information and the photographing attitude information; and

a step in which the subject information is made to correlate to a position within the photographic image plane by using the image-plane position information.

7. The image display method according to claim 1, wherein:

the correlating step comprises;

a step in which wireless communication with an electronic instrument held by the subject is executed while scanning inside the photographic image plane with a wireless communication antenna having extreme directivity;

a step in which the image-plane position information indicating the position of the subject within the photographic image plane is detected based upon a scanning position assumed within the photographic image plane when the wireless communication with the electronic instrument is achieved; and

a step in which the subject information is made to correlate to a position within the photographic image plane by using the image-plane position information.

8. The image display method according to claim 1, wherein:

the correlating step comprises;

a step in which an infrared light beam emitted from a point source of an infrared light provided at an electronic instrument held by the subject is received at a two-dimensional infrared sensor;

a step in which the image-plane position information indicating the position of the subject within the photographic image plane is detected by detecting a position at which the infrared light beam is received at the two-dimensional infrared sensor; and

a step in which the subject information is made to correlate to the position in the photographic image plane by using the image-plane position information.

9. The image display method according to claim 1, wherein:

the correlating step is executed with a timing substantially at a timing with which the subject is photographed in the image-capturing step.

10. The image display method according to claim 1, wherein:

the correlating step is manually started up with a timing bearing no relation to a timing with which the subject is photographed in the image-capturing step to detect the image-plane position information.

11. The image display method according to claim 1, wherein;

in the information collection step, a search of similar image data bearing similarity to the image data obtained by photographing the subject is conducted and subject information appended to the similar image data obtained through the search is extracted; and

in the correlating step, the subject information is made to correlate to a position within the photographic image plane by using the image-plane position information obtained through the image analysis.

12. The image display method according to claim 1, wherein:

in the information collection step, a subject is identified through image analysis of the image data and subject information related to the identified subject is obtained from an information source on a network by executing network communication; and

in the correlating step, the subject information is made to correlate to a position within the photographic image plane by using image-plane position information obtained through the image analysis.

13. The image display method according to claim 1, further comprising:

a storing step in which an image file is generated by appending to the image data the subject information associated with a position within the photographic image plane to the image data and the image file is stored in memory.

14. The image display apparatus according to claim 1, wherein:

the subject information includes access information with regard to an information source on a network having stored therein detailed information on the subject; and

in the information display step, the detailed information on the subject is obtained from the information source on the network indicated by the access information included in the subject information and the obtained information is displayed.

15. The image display method according to claim 1, wherein:

a common display screen is used in the image display step and the information display step; and

in the information display step, reduced image data are displayed over an area constituting part of the display screen while displaying the subject information at the display screen.

16. The image display method according to claim 1, wherein:

the subject information includes audio information.

17. The image display method according to claim 16, wherein:

in the information collection step, audio information constituted of sound generated by the subject within the photographic image plane is collected during a photographing operation with a highly directional microphone; and

in the correlating step, the audio information is made to correlate to a position within the photographic image plane by using image-plane position information obtained along a direction in which the directional microphone manifests directivity.

18. An image display method for displaying image data obtained through a photographing operation performed at an image-capturing apparatus having a photographic optical system, the method comprising:

an image-capturing step in which image data are generated by photographing a subject within a photographic image plane with the image-capturing apparatus;

an information collection step in which subject information related to the subject is collected;

a correlating step in which the subject information is made to correlate to a position within the photographic image plane;

an image display step in which the image data are displayed at a display screen;

a position specification step in which a position on the display screen at which the image data are displayed is specified; and

an information display step in which the subject information made to correlate to a position within the photographic image plane corresponding to the position specified in the position specification step is displayed, wherein;

in the correlating step, image-plane position information indicating a subject position within the photographic image plane is detected by analyzing the subject position within the photographic image plane through an image analysis of the image data.