Portable information device having real-time display with relevant information

• US 9,743,003 B2
• Filed: 04/08/2014
• Issued: 08/22/2017
• Est. Priority Date: 08/08/2008
• Status: Active Grant

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Inoue, Hideya, Iwaoka, Toru, Noborisaka, Michiko, Hatori, Masayuki, Hamada, Tomohide
• Primary Examiner(s): VU, NGOC YEN T
• Application Number:
  US14/247,737
• Publication Number:
  US 20140218581A1
• Time in Patent Office: 1,232 Days
• Field of Search: 34833301-33303
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/32117 in a separate transmission or protocol signal prior to or subsequent to the image data transmission, e.g. in digital identification signal [DIS], in non standard setup [NSS] or in non standard field [NSF] for mode signalling H04N1/333
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3205 of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 2201/3276 of a customised additional information profile, e.g. a profile specific to a user ID
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

A portable information device including a body, a position information portion that is provided in the body and that outputs position information, an image sensor that is provided in the body, a display system that is provided in the body and that displays, on a local field in a screen field, relevant information based on the position information such that the displayed relevant information is overlapped on a real-time image, an input portion that is provided on the body and, by use of which user operates an icon, the icon being displayed on the local field such that the displayed icon is overlapped on the real-time image and an imaging button that is provided, separately from the input portion, on the body and that is operated by user to capture a subject image via the image sensor.

Claims

1. A portable information device comprising:

a body;

a locator that is provided in the body and that outputs position information;

an image sensor that is provided in the body;

a display system, having a display and a controller, that is provided in the body and that displays, on a local field in a real-time display through the display, relevant information based on the position information such that the displayed relevant information is overlapped on at least a real-time field that is not a still image, and such that a plurality of operation icons are displayed while the relevant information is displayed, the operation icons being displayed in an icon display area on the local field such that the displayed operation icons are overlapped on at least the real-time field that is not a still image, the icon display area being arranged at a predetermined location, each of the operation icons being operable to cause performance of an operation;

an inputter that is provided on the body and, by use of which a user operates at least one of the operation icons while the real-time field that is not a still image is presently browsed to the user through the display; and

an imaging button that is provided, separately from the inputter, and that is operated by the user to capture a subject image via the image sensor.

2. The portable information device according to claim 1,

wherein the controller controls a display state of the relevant information and the operation icons on the local field.

3. The portable information device according to claim 1,

wherein the inputter detects the user'"'"'s operation for the inputter, the user'"'"'s operation including at least one of a touch operation, a press-down operation, and a slide operation.

4. The portable information device according to claim 3,

wherein the operation icons have at least one of a browsing icon for displaying the relevant information, a CM icon for displaying commercial information, a post browsing icon for displaying post information, a mail icon for a mail operation, a read-out icon for a read-out operation of captured image, a search icon for a search operation, a past image icon for displaying a past image, and a completion icon for a termination operation of a predetermined process.

5. The portable information device according to claim 1,

wherein the operation icons have a signage image for an operation guide for the user.

6. The portable information device according to claim 1,

wherein the display system displays, on the local field, (a) the subject image via the image sensor and (b) the relevant information such that, in the local field, the displayed relevant information is overlapped on the displayed subject image.

7. The portable information device according to claim 1,

wherein the displayed operation icons are arranged in a line on the local field arranged at the predetermined locations such that the displayed icons are overlapped on at least the real-time field that is not a still image.

8. The portable information device according to claim 1,

wherein the displayed operation icons have substantially the same size and are arranged in a line on the local field arranged at the predetermined locations such that the displayed icons are overlapped on at least the real-time field that is not a still image.

9. The portable information device according to claim 1,

wherein the displayed operation icons are arranged on the local field such that the arrangement of the displayed operation icons are in no relation to contents of the real-time field.

10. The portable information device according to claim 1,

wherein the displayed operation icons stay on the local field arranged at the predetermined locations when the body is changed in attitude.

11. The portable information device according to claim 1,

wherein the imaging button is arranged such that an operation direction of the imaging button intersects with an optical axis direction of the display.

12. The portable information device according to claim 1,

wherein the operation icons are displayed such that the displayed operation icons do not substantially overlap the displayed relevant information.

13. The portable information device according to claim 1,

wherein the icon display area is provided, separately from an area in which the relevant information is displayed.

14. The portable information device according to claim 1,

wherein the icon display area is provided adjacent to a side of the real-time field.

15. The portable information device according to claim 1,

wherein the icon display area has an area that is arranged adjacent to a corner of the real-time field.

16. The portable information device according to claim 1,

wherein the icon display area has an area that is arranged adjacent to one side or the other side of the real-time field in a direction that intersects with a width direction of the real-time field.

17. The portable information device according to claim 1,

wherein the icon display area has an area that is arranged adjacent to one side or the other side of the real-time field in a width direction of the real-time field.

42. An information acquisition system comprising:

a server; and

a portable information device as recited in claim 1.

18. A portable information device comprising:

a body;

an image sensor that is provided in the body;

a display system that has a display and a controller each provided in the body;

an inputter that is provided on the body and, by use of which a user operates while a real-time field that is not a still image is presently browsed to the user through the display, a display content, which is displayed through the display portion; and

an imaging button that is provided, separately from the inputter, and that is operated by the user to capture a subject image via the image sensor,

wherein the display system adds, to the display content, the subject image via the image sensor in order to display, in the real-time field, the subject image such that the displayed subject image is overlapped on a local field that is smaller than the real-time field and is overlapped on the real-time field,

wherein the display system adds, to the display content, relevant information in order to display, in the real-time field, the relevant information such that the displayed relevant information is overlapped on the local field that is smaller than the real-time field and is overlapped on the real-time field, and

wherein the display system adds, to the display content, a plurality of operation icons in order to display the operation icons while the relevant information is displayed, each of the operation icons being operable to cause performance of an operation.

19. The portable information device according to claim 18,

wherein the relevant information is obtained based on one of (a) position information from a locator that is provided in the body, and (b) a result of an image recognition for the subject image via the image sensor.

20. The portable information device according to claim 18,

wherein the controller controls a display state of the subject image and the relevant information on the local field.

21. The portable information device according to claim 18,

wherein the inputter detects the user'"'"'s operation for the inputter, the user'"'"'s operation including at least one of a touch operation, a press-down operation, and a slide operation.

22. The portable information device according to claim 18,

wherein the display system displays the operation icons having a signage image, which guides the user'"'"'s operation, such that the displayed icon is overlapped on the real-time field.

23. The portable information device according to claim 22,

wherein the operation icons have at least one of a browsing icon for displaying the relevant information, a CM icon for displaying commercial information, a post browsing icon for displaying post information, a mail icon for a mail operation, a read-out icon for a read-out operation of captured image, a search icon for a search operation, a past image icon for displaying a past image, and a completion icon for a termination operation of a predetermined process.

24. The portable information device according to claim 18,

wherein the display system displays, on the local field, (a) the subject image via the image sensor and (b) the relevant information such that, in the local field, the displayed relevant information is overlapped on the displayed subject image.

43. An information acquisition system comprising:

a server; and

a portable information device as recited in claim 18.

25. A portable information device comprising:

a body;

a locator provided in the body and configured to output position information;

an image sensor provided in the body;

a display system having a display and a controller each provided in the body and configured to display, on a local field in a real-time field, relevant information based on the position information such that the displayed relevant information is overlapped on at least a live view that is not a still image, and such that a plurality of operation icons are displayed while the relevant information is displayed, the operation icons being displayed in an icon display area on the local field such that the displayed operation icons are overlapped on at least the real-time field that is not a still image, the icon display area being arranged at a predetermined location, each of the operation icons being operable to cause performance of an operation;

an inputter provided on the body and, by use of which a user operates at least one of the operation icons while the real-time field that is not a still image is presently browsed to the user through the display; and

an imaging button provided, separately from the inputter, and configured to be operated by the user to capture a subject image via the image sensor.

26. A portable information device comprising:

a body;

an image sensor provided in the body;

a display system having a display and a controller each provided in the body;

an inputter provided on the body and, by use of which a user operates while a real-time field that is not a still image is presently browsed to the user through the display, a display content, which is displayed through the display; and

an imaging button provided, separately from the inputter, and configured to be operated by the user to capture a subject image via the image sensor,

wherein the display system is configured to add, to the display content, the subject image via the image sensor in order to display, in a live view, the subject image such that the displayed subject image is overlapped on a local field that is overlapped on the live view, the local field being arranged shifted with respect to a center of the live view,

wherein the display system is configured to add, to the display content, relevant information in order to display, in the live view, the relevant information such that the displayed relevant information is overlapped on the local field that is overlapped on the live view, the local field being arranged shifted with respect to a center of the live view, and

wherein the display system adds, to the display content, a plurality of operation icons in order to display the operation icons while the relevant information is displayed, each of the operation icons being operable to cause performance of an operation.

27. A portable information device comprising:

a body;

an image sensor that is provided in the body;

a display system that has a display and a controller each provided in the body;

an inputter that is provided on the body and, by use of which a user operates while a real-time field that is not a still image is presently browsed to the user through the display, a display content, which is displayed through the display; and

an imaging button that is provided, separately from the inputter, and that is operated by the user to capture a subject image via the image sensor,

wherein the display system adds, to the display content, a plurality of operation icons that guides the user'"'"'s operation in order to display, in the real-time field, such that the displayed operation icons are overlapped on a local field that is smaller than the real-time field and are overlapped on the real-time field, each of the operation icons being operable to cause performance of an operation; and

wherein the display system adds, to the display content, relevant information in order to display, in the real-time field, the relevant information such that the displayed relevant information is overlapped on the local field that is smaller than the real-time field and is overlapped on the real-time field, and such that the operation icons are displayed while the relevant information is displayed.

28. The portable information device according to claim 27,

wherein the relevant information is obtained based on one of (a) position information from a locator that is provided in the body, and (b) a result of an image recognition for the subject image via the image sensor.

29. The portable information device according to claim 27,

wherein the controller controls a display state of the relevant information and the operation icons on the local field.

30. The portable information device according to claim 27,

wherein the inputter detects the user'"'"'s operation for the inputter, the user'"'"'s operation including at least one of a touch operation, a press-down operation, and a slide operation.

31. The portable information device according to claim 30,

wherein the operation icons have at least one of a browsing icon for displaying the relevant information, a CM icon for displaying commercial information, a post browsing icon for displaying post information, a mail icon for a mail operation, a read-out icon for a read-out operation of captured image, a search icon for a search operation, a past image icon for displaying a past image, and a completion icon for a termination operation of a predetermined process.

32. The portable information device according to claim 27,

wherein the operation icons have a signage image for an operation guide for the user.

33. The portable information device according to claim 27,

wherein the display system displays, on the local field, (a) the subject image via the image sensor and (b) the relevant information such that, in the local field, the displayed relevant information is overlapped on the displayed subject image.

34. A method of overlapping relevant information on a real-time field via a portable device, comprising:

displaying a local field in a real-time display through a display system of the portable device, the portable device having a body, the display system controlling a display and being provided in the body;

displaying a plurality of operation icons of an inputter in an icon display area on the local field such that the displayed operation icons overlap on at least the real-time field, the icon display area being arranged at a predetermined location, the inputter being provided in the body and separate from an imaging button, at least one of the operation icons being operable by a user to cause performance of an operation while the real-time field that is not a still image is presently browsed to the user through the display, the imaging button being operable by the user to capture a subject image via an image sensor provided in the body; and

overlapping the relevant information on at least the real-time field such that the operation icons are displayed while the relevant information is displayed, the real-time field being instantly sensed via the image sensor and not being a still image, the relevant information being based on position information obtained from a locator provided in the body.

35. A non-transitory computer-readable storage medium imbedded therein computer-executable instructions that, when executed by a computer, causes the computer to:

display a local field in a real-time display through a display system of a portable device, the portable device having a body, the display system controlling a display and being provided in the body;

display a plurality of operation icons of an inputter in an icon display area on the local field such that the displayed operation icons overlap on at least a real-time field, the icon display area being arranged at a predetermined location, the inputter being provided in the body and separate from an imaging button, at least one of the operation icons being operable by a user to cause performance of an operation while the real-time field that is not a still image is presently browsed to the user through the display, the imaging button being operable by the user to capture a subject image via an image sensor provided in the body; and

overlap relevant information on at least the real-time field such that the operation icons are displayed while the relevant information is displayed, the real-time field being instantly sensed via the image sensor and not being a still image, the relevant information being based on position information obtained from a locator provided in the body.

36. A method of overlapping information on a real-time field via a portable device, comprising:

displaying a local field in a real-time display through a display system of the portable device, the portable device having a body, the display system controlling a display and being provided in the body, the local field being smaller than the real-time field;

capturing a subject image via an image sensor based on operation of an imaging button by a user, the imaging button being provided separate from an inputter, the inputter being provided on the body such that a display content displayed through the display system is operable by the user while the real-time field that is not a still image is presently browsed to the user through the display;

adding, at the display system, the subject image via the image sensor to the display content in order to display, in the real-time field, the subject image such that the displayed subject image is overlapped on the local field and is overlapped on the real-time field;

adding, at the display system, relevant information to the display content in order to display, in the real-time field, the relevant information such that the displayed relevant information is overlapped on the local field and is overlapped on the real-time field, and

adding, at the display system, a plurality of operation icons in order to display the operation icons while the relevant information is displayed, each of the operation icons being operable to cause performance of an operation.

37. A non-transitory computer-readable storage medium imbedded therein computer-executable instructions that, when executed by a computer, causes the computer to:

display a local field in a real-time display through a display system of a portable device, the portable device having a body, the display system controlling a display and being provided in the body, the local field being smaller than a real-time field;

capture a subject image via an image sensor based on operation of an imaging button by a user, the imaging button being provided separate from an inputter, the inputter being provided on the body such that a display content displayed through the display system is operable by the user while the real-time field that is not a still image is presently browsed to the user through the display;

add, at the display system, the subject image via the image sensor to the display content in order to display, in the real-time field, the subject image such that the displayed subject image is overlapped on the local field and is overlapped on the real-time field;

add, at the display system, relevant information to the display content in order to display, in the real-time field, the relevant information such that the displayed relevant information is overlapped on the local field and is overlapped on the real-time field, and

add, at the display system, a plurality of operation icons in order to display the operation icons while the relevant information is displayed, each of the operation icons being operable to cause performance of an operation.

38. A portable information device comprising:

a body;

a locator that is provided in the body and that outputs position information;

an image sensor that is provided in the body;

a display system, having a display and a controller, that is provided in the body and that displays, on a local field in a real-time display through the display, relevant information based on the position information such that the displayed relevant information is overlapped on at least a real-time field that is not a still image, and such that a plurality of operation icons are displayed while the relevant information is displayed, the operation icons being displayed on the local field arranged adjacent to a side of the real-time display such that the displayed operation icons are overlapped on at least the real-time field that is not a still image, each of the operation icons being operable to cause performance of an operation;

an inputter that is provided on the body and, by use of which a user operates at least one of the operation icons while the real-time field that is not a still image is presently browsed to the user through the display; and

an imaging button that is provided, separately from the inputter, and that is operated by the user to capture a subject image via the image sensor.

39. A portable information device comprising:

a body;

a locator that is provided in the body and that outputs position information;

an image sensor that is provided in the body;

a display system, having a display and a controller, that is provided in the body and that displays, on a local field in a real-time display through the display, relevant information based on the position information such that the displayed relevant information is overlapped on at least a real-time field that is not a still image, and such that a plurality of operation icons are displayed while the relevant information is displayed, the operation icons being displayed on the local field such that the displayed operation icons are aligned and overlapped on at least the real-time field that is not a still image;

an inputter that is provided on the body and, by use of which a user operates at least one of the operation icons to cause performance of an operation while the real-time field that is not a still image is presently browsed to the user through the display; and

an imaging button that is provided, separately from the inputter, and that is operated by the user to capture a subject image via the image sensor.

40. A portable information device comprising:

a body;

an image sensor that is provided in the body;

a display system that has a display and a controller each provided in the body;

an inputter that is provided on the body and, by use of which a user operates while a real-tithe field that is not a still image is presently browsed to the user through the display, a display content, which is displayed through the display; and

an imaging button that is provided, separately from the inputter, and that is operated by the user to capture a subject image via the image sensor,

wherein the display system adds, to the display content, the subject image via the image sensor in order to display, in the real-time field, the subject image such that the displayed subject image is overlapped on a local field that is smaller than the real-time field and is overlapped on the real-time field,

wherein the display system adds, to the display content, relevant information in order to display, in the real-time field, the relevant information such that the displayed relevant information is overlapped on the local field that is smaller than the real-time field and is overlapped on the real-time field,

wherein the display system adds, to the display content, a plurality of operation icons in order to display the operation icons while the relevant information is displayed, each of the operation icons being operable to cause performance of an operation, and

wherein the subject image is captured based on a first user action for the imaging button and the display content is operated based on a second user action, which is different from the first user action, for the inputter.

41. A portable information device comprising:

a body;

a locator provided in the body and configured to output position information;

an image sensor provided in the body;

a display system having a display and a controller each provided in the body and configured to display, on a local field in a real-time field, relevant information based on the position information such that the displayed relevant information is overlapped on at least a live view, and such that a plurality of operation icons are displayed while the relevant information is displayed, the operation icons being displayed on the local field such that the displayed icons are overlapped on at least the live view, each of the operation icons being operable to cause performance of an operation;

an inputter provided on the body and, by use of which a user operates the operation icons while a real-time field that is not a still image is presently browsed to the user through the display; and

an imaging button configured to be operated by the user to capture a subject image via the image sensor.

44. A non-transitory computer-readable storage medium imbedded therein computer-executable instructions that, when executed by a computer, causes the computer to:

display a local field in a real-time field through a display system of a portable device, the portable device having a body, the display system controlling a display and being provided in the body;

display a plurality of operation icons of an inputter on the local field such that the displayed operation icons overlap on at least a live view, the inputter being provided in the body and separate from an imaging button, each of the operation icons being operable by a user to cause performance of an operation while the real-time field that is not a still image is presently browsed to the user through the display, the imaging button being provided operable by the user to capture a subject image via an image sensor provided in the body; and

overlap relevant information on at least the live view such that the operation icons are displayed while the relevant information is displayed, the relevant information being based on position information obtained from a locator provided in the body.

45. A portable information device comprising:

a body;

a locator that is provided in the body and that outputs position information;

an image sensor that is provided in the body;

a display system, having a display and a controller, that is provided in the body and that displays, on a local field in a real-time display through the display, relevant information based on the position information such that the displayed relevant information is overlapped on at least a real-time field that is not a still image, and such that a plurality of operation icons are displayed while the relevant information is displayed, the operation icons being displayed in an icon display area on the local field such that the displayed operation icons are overlapped on at least the real-time field that is not a still image, the icon display area being arranged at a predetermined location; and

an inputter that is provided on the body and, by use of which a user operates, while the real-time field that is not a still image is presently browsed to the user through the display, at least one of the operation icons to cause performance of an operation.