Imaging device and information acquisition system in which an acquired image and associated information are held on a display

• US 10,452,914 B2
• Filed: 08/03/2017
• Issued: 10/22/2019
• Est. Priority Date: 02/08/2010
• Status: Active Grant

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Inoue, Hideya
• Primary Examiner(s): Segura, Cynthia
• Application Number:
  US15/668,032
• Publication Number:
  US 20170330037A1
• Time in Patent Office: 810 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06Q 30/0207 Discounts or incentives, e.g. coupons or rebates
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/344 involving models
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 1/00323 with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/8205 : involving the multiplexing of an additional signal and the colour video signal

Abstract

An imaging device includes an imaging portion that images a subject; a positional information acquisition portion that acquires positional information of an imaging position; a control portion which acquires information on the subject based on the positional information, and displays image data of the subject and the information on the subject on a display portion; and a hold control portion that outputs a hold control signal, which holds the image data of the subject and the information on the subject, to the control portion.

Claims

1. An imaging device comprising:

a body;

an imager;

a display;

a positional information acquirer; and

a computer configured to

display, on the display, a synthesized image including (i) a real-time image acquired via the imager capturing a subject and (ii) subject information acquired based (a) on positional information acquired via the positional information acquirer or (b) on a result of an image recognition for the real-time image,

hold, on the display, the synthesized image including the real-time image and the subject information displayed on the display based on an action detection of at least one of (i) a movement of a detected characteristic point of the real-time image greater than a preset distance in a time of a preset range, (ii) a change of a detected contrast of the real-time image beyond a preset difference, and (iii) a change in an image pattern of the real-time image, which is greater than a predetermined threshold value, and

continue displaying the synthesized image including the held real-time image and the held subject information on the display after the action detection,

wherein the synthesized image being held on the display after the action detection is the same as the synthesized image being displayed before the action detection.

2. The imaging device according to claim 1, wherein the computer is configured to transmit the held real-time image and the held subject information to another terminal.

3. The imaging device according to claim 1, wherein the computer is configured to periodically transmit the held real-time image and the held subject information to another terminal.

4. The imaging device according to claim 1, wherein the display has a touch panel that is configured to be operative for a touch operation while the held real-time image and the held subject information are displayed on the display.

5. The imaging device according to claim 1, wherein the computer is configured to switch between a display mode and a non-display mode of the subject information on the display.

6. The imaging device according to claim 1, wherein the computer is configured to acquire the subject information even when a non-display mode is set.

7. The imaging device according to claim 1, wherein the computer is configured to display a past image relating the subject on the display.

8. The imaging device according to claim 1, wherein the computer is configured to display a past image relating the subject and the subject information corresponding to the past image on the display.

9. An information acquisition system comprising:

the imaging device of claim 1; and

an information retrieval system.

10. The information acquisition system according to claim 9, wherein the information retrieval system has a memory to store the held real-time image and the held subject information.

11. In combination, a server and the imaging device of claim 1, wherein the server is configured to communicate with the imaging device to acquire subject information from a database and to transmit the subject information to the imaging device.

12. A non-transitory computer-readable storage medium that stores a program that allows a computer to execute functions of an imaging device so that the computer executes the steps comprising:

acquiring positional information;

acquiring subject information based on the positional information or on a result of an image recognition for a real-time image, which is acquired via an imager of the imaging device capturing a subject;

augmented reality-displaying a synthesized image including the real-time image and the subject information on a display;

holding, on the display, the synthesized image including the real-time image and the subject information displayed on the display based on an action detection of at least one of (i) a movement of a detected characteristic point of the real-time image greater than a preset distance in a time of a preset range, (ii) a change of a detected contrast of the real-time image beyond a preset difference, and (iii) a change in an image pattern of the real-time image, which is greater than a predetermined threshold value; and

continuing displaying the synthesized image including the held real-time image and the held subject information on the display after the action detection,

wherein the synthesized image being held on the display after the action detection is the same as the synthesized image being displayed before the action detection.

13. An imaging device comprising:

a body;

an imager;

a display;

a positional information acquirer; and

a computer configured to

display, on the display, a synthesized image including (i) a subject image acquired via the imager and (ii) subject information acquired based (a) on positional information acquired via the positional information acquirer or (b) on a result of an image recognition for the subject image,

hold, on the display, the synthesized image including the subject image and the subject information displayed on the display when a change in an image pattern, which is greater than a predetermined threshold value, is detected, and

continue displaying the synthesized image including the held subject image and the held subject information on the display after the detection,

wherein the synthesized image being held on the display after the action detection is the same as the synthesized image being displayed before the action detection.

14. The imaging device according to claim 13, wherein the computer is configured to transmit the held subject image and the held subject information to another terminal.

15. The imaging device according to claim 13, wherein the computer is configured to periodically transmit the held subject image and the held subject information to another terminal.

16. The imaging device according to claim 13, wherein the display has a touch panel that is configured to be operative for a touch operation while the held subject image and the held subject information are displayed on the display.

17. The imaging device according to claim 13, wherein the computer is configured to switch between a display mode and a non-display mode of the subject information on the display.

18. The imaging device according to claim 13, wherein the computer is configured to acquire the subject information even when a non-display mode is set.

19. The imaging device according to claim 13, wherein the computer is configured to display a past subject image on the display.

20. The imaging device according to claim 13, wherein the computer is configured to display a past subject image and the subject information corresponding to the past subject image on the display.

21. An information acquisition system comprising:

the imaging device of claim 13; and

an information retrieval system.

22. The information acquisition system according to claim 21, wherein the information retrieval system has a memory to store the held subject image and the held subject information.

23. In combination, a server and the imaging device of claim 13, wherein the server is configured to communicate with the imaging device to acquire subject information from a database and to transmit the subject information to the imaging device.

24. A non-transitory computer-readable storage medium that stores a program that allows a computer to execute functions of an imaging device so that the computer executes the steps comprising:

acquiring positional information;

acquiring subject information based on the positional information or on a result of an image recognition for a subject image, which is imaged via an imager of the imaging device;

augmented reality-displaying a synthesized image including the subject image and the subject information on a display;

holding, on the display, the synthesized image including the subject image and the subject information displayed on the display when a change in an image pattern, which is greater than a predetermined threshold value, is detected; and

continuing displaying the synthesized image including the held subject image and the held subject information on the display after the detection,

wherein the synthesized image being held on the display after the action detection is the same as the synthesized image being displayed before the action detection.