Imaging device and information acquisition system in which an acquired image and associated information are held on a display

• US 9,756,253 B2
• Filed: 07/11/2016
• Issued: 09/05/2017
• Est. Priority Date: 02/08/2010
• Status: Active Grant

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Inoue, Hideya
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): Segura, Cynthia
• Application Number:
  US15/207,228
• Publication Number:
  US 20160323515A1
• Time in Patent Office: 421 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06Q 30/0207 Discounts or incentives, e.g. coupons or rebates
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/344 involving models
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 1/00323 with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/8205 : involving the multiplexing of an additional signal and the colour video signal

Abstract

An imaging device includes an imaging portion that images a subject; a positional information acquisition portion that acquires positional information of an imaging position; a control portion which acquires information on the subject based on the positional information, and displays image data of the subject and the information on the subject on a display portion; and a hold control portion that outputs a hold control signal, which holds the image data of the subject and the information on the subject, to the control portion.

Claims

1. An imaging device comprising:

a body;

an imager;

a positional information acquirer configured to acquire positional information;

a computer configured to;

display, on a display of the imaging device, (i) a subject image acquired via the imager and (ii) subject information acquired based (a) on the positional information or (b) on a result of an image recognition for the subject image, and

output a hold control signal based on a user action, the hold control signal causing the computer to hold, on the display, the subject image and the subject information displayed on the display and to continue displaying the held subject image and the held subject information on the display after completion of the user action; and

operation equipment with which post information is posted while the held subject image and the held subject information are displayed.

2. The imaging device according to claim 1, wherein, the computer is configured to switch between the display and the non-display of the subject information on the display.

3. The imaging device according to claim 1, wherein the computer is configured to transmit the held subject information and the held subject image to another terminal based on the hold control signal.

4. The imaging device according to claim 1, wherein the display has a touch panel that is configured to be operative for a touch operation while the held subject image and the held subject information are displayed on the display.

5. The imaging device according to claim 1, wherein the operation equipment has an input that is used to input the post information while the subject image and the subject information are displayed on the display.

6. The imaging device according to claim 1, wherein at least a part of the operation equipment is provided at the display.

7. The imaging device according to claim 1, wherein the display has a mode in which an icon is displayed for posting the post information while the subject image and the subject information are displayed on the display.

8. The imaging device according to claim 1,

wherein the subject information includes coupon information, and

wherein the computer is configured to hold the coupon information on the display based on the hold control signal.

9. The imaging device according to claim 1, wherein the user action includes at least one of (i) an action by which a button provided on the body is pressed-down, (ii) an action by which the display is touched, (iii) an action by which the body is moved, (iv) an action by which a posture of the body is changed, (v) an action by which a detected characteristic point of an image is moved in a preset distance in a time of a preset range, (vi) an action by which a detected contrast of an image is changed beyond a preset difference, and (vii) an action by which a change in an image pattern, which is equal to or greater than a predetermined threshold value, is to be detected.

10. The imaging device according to claim 1, wherein the computer transmits the held subject information to an external when the hold control signal is detected.

11. The imaging device according to claim 1, wherein the computer acquires further subject information when the display is touched after the holding.

12. The imaging device according to claim 1, wherein the computer acquires second subject information, which is different from the subject information, when the display is touched after the holding.

13. The imaging device according to claim 1, wherein the subject information includes coupon information.

14. The imaging device according to claim 1, wherein the subject information includes an icon that is arranged to be displayed overlapped on the subject image on the display and such that the displayed icon can continue to be displayed after completion of the user action.

15. The imaging device according to claim 1, wherein the subject information includes past information.

16. An information acquisition system comprising:

the imaging device of claim 1; and

an information retrieval system.

17. In combination, a server and the imaging device of claim 1, wherein the server is configured to communicate with the imaging device to acquire subject information from a database and to transmit the subject information to the imaging device.

18. A non-transitory computer-readable storage medium that stores a program that allows a computer to execute functions of an imaging device so that the computer executes the steps comprising:

acquiring positional information;

acquiring subject information based on the positional information or on a result of an image recognition for a subject image, which is imaged via an imager of the imaging device;

AR-displaying the subject image and the subject information on the display;

outputting a hold control signal based on a user action during the AR-displaying, the hold control signal causing holding, on the display, of the subject image and the subject information and continued displaying of the held subject image and the held subject information on the display after completion of the user action; and

posting post information while the held subject image and the held subject information are displayed.

19. An imaging device comprising:

a body;

an imager;

a positional information acquirer configured to acquire positional information; and

a computer configured to;

display, on a display of the imaging device, (i) a subject image acquired via the imager and (ii) subject information acquired based (a) on the positional information or (b) on a result of an image recognition for the subject image, and

output a hold control signal based on a motion of the body according to a user action, the hold control signal causing the computer to hold, on the display, the subject image and the subject information displayed on the display and to continue displaying the held subject image and the held subject information on the display after completion of the user action.

20. The imaging device according to claim 19, wherein, the computer is configured to switch between the display and the non-display of the subject information on the display.

21. The imaging device according to claim 19, wherein the computer is configured to transmit the held subject information and the held subject image to another terminal based on the hold control signal.

22. The imaging device according to claim 19, wherein the display has a touch panel that is configured to be operative for a touch operation while the held subject image and the held subject information are displayed on the display.

23. The imaging device according to claim 19, wherein the display has an input that is used to input post information while the subject image and the subject information are displayed on the display.

24. The imaging device according to claim 19, wherein at least a part of operation equipment is provided at the display.

25. The imaging device according to claim 19, wherein the display has a mode in which an icon is displayed for posting post information while the subject image and the subject information are displayed on the display.

26. The imaging device according to claim 19,

wherein the subject information includes coupon information, and

wherein the computer is configured to hold the coupon information on the display based on the hold control signal.

27. The imaging device according to claim 19, wherein the user action includes at least one of (i) an action by which a button provided on the body is pressed-down, (ii) an action by which the display is touched, (iii) an action by which the body is moved, (iv) an action by which a posture of the body is changed, (v) an action by which a detected characteristic point of an image is moved in a preset distance in a time of a preset range, (vi) an action by which a detected contrast of an image is changed beyond a preset difference, and (vii) an action by which a change in an image pattern, which is equal to or greater than a predetermined threshold value, is to be detected.

28. The imaging device according to claim 19, wherein the computer transmits the held subject information to an external when the hold control signal is detected.

29. The imaging device according to claim 19, wherein the computer acquires further subject information when the display is touched after the holding.

30. The imaging device according to claim 19, wherein the subject information includes coupon information.

31. An information acquisition system comprising:

the imaging device according to claim 19; and

an information retrieval system.

32. A non-transitory computer-readable storage medium that stores a program that allows a computer to execute functions of an imaging device so that the computer executes the steps comprising:

acquiring positional information;

acquiring subject information based (a) on the positional information or (b) on a result of an image recognition for a subject image, which is imaged via an imager of the imaging device;

AR-displaying the subject image and the subject information on the display;

outputting a hold control signal based on a motion of the imaging device according to a user action during the AR-displaying, the hold control signal causing holding, on the display, of the subject image and the subject information and continued displaying of the held subject image and the held subject information on the display after completion of the user action; and

posting post information while the held subject image and the held subject information are displayed.