Image displaying apparatus with changed menu based on detection of mobile information terminal placed thereon

• US 10,318,076 B2
• Filed: 09/03/2015
• Issued: 06/11/2019
• Est. Priority Date: 10/16/2006
• Status: Active Grant

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Achiwa, Ken, Tomi, Hideyasu, Hasui, Shigeki
• Primary Examiner(s): Yi, Rinna
• Application Number:
  US14/844,933
• Publication Number:
  US 20150378516A1
• Time in Patent Office: 1,377 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/0035 User-machine interface; Control console input or output arrangements for computers G06F3/00
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/0041 Point to point H04N2201/0039 takes precedence
• CPC Class Codes: H04N 2201/0055 By radio
• CPC Class Codes: H04N 2201/0058 Docking-station, cradle or the like

Abstract

In an image processing apparatus which generates an input signal when a mobile information terminal contacts a display surface and makes a wireless communication with the contacting mobile information terminal, it is difficult to make an appropriate display by discriminating whether a contact object is a mobile information terminal or a user'"'"'s finger. To accomplish this, when a mobile information terminal (200) is placed on a touch panel (104), this placement is recognized based on a wireless communication response (701), and a processing menu for the terminal is displayed. On the other hand, if the user'"'"'s finger (300) is placed, since no wireless communication response (701) is detected, it is recognized that the contact object is not the mobile information terminal (200), and a general manipulation menu is displayed.

Claims

1. An image displaying apparatus, comprising:

a display;

a memory storing instructions;

one or more processors which execute the instructions and cause the image displaying apparatus to function as;

a detecting unit configured to detect a mobile terminal placed on a display panel of the display;

a determining unit configured to determine a display position of a display item in accordance with a position of the detected mobile terminal; and

a control unit configured to control to display the display item at the determined display position;

wherein the determining unit determines the display position to be a position of a predetermined distance from the position of the detected mobile terminal, and the display item is an item in accordance with a type of the detected mobile terminal and the display item includes at least a print item, and

in a case where the detecting unit detects a plurality of mobile terminals placed on the display panel, the control unit controls the display to display a corresponding plurality of display items for selecting processing modes of the respective mobile terminals.

2. The apparatus according to claim 1, wherein the detecting unit includes an imaging unit to capture an image of an object on the display panel, and

in a case where it is judged that the image of the object captured by the imaging unit is a finger of a human, the control unit controls the display to display first information based on a display item displayed at a position of the finger.

3. The apparatus according to claim 1, wherein the detecting unit includes an imaging unit to capture an image of an object on the display panel, and

in a case where it is judged that the image of the object captured by the imaging unit is the mobile terminal, the control unit controls the display to display the display item for selecting the processing mode of the mobile terminal.

4. The apparatus according to claim 3, wherein the mobile terminal is a mobile phone, a digital still camera, a notebook type personal computer, or a PDA.

5. The apparatus according to claim 3, wherein the control unit controls the display to display the display item for selecting the processing mode of the mobile terminal at a position in close visual proximity to the detected mobile terminal so that correspondence with the detected mobile terminal can be recognized.

6. The apparatus according to claim 3, further comprising a communication unit configured to communicate with the detected mobile terminal.

7. The apparatus according to claim 6, wherein the communication unit is a wireless communication unit.

8. The apparatus according to claim 7, wherein the wireless communication unit communicates with the mobile terminal by a WiMAX (Worldwide Interoperability for Microwave Access), UWB (Ultra Wide Band), or Wifi protocol.

9. The apparatus according to claim 3, wherein, in a case where the display has displayed plural display items before the object is placed on the display panel of the display and it is judged that the image of the object captured by the imaging unit is the mobile terminal, the control unit controls the display to display the display item for selecting a processing mode of the mobile terminal together with the plural display items.

10. The apparatus according to claim 3, wherein the imaging unit is a camera.

11. The apparatus according to claim 2, wherein, if the display item displayed at a position of the finger is copy icon, the control unit controls the display to display a copy screen on the display panel of the display, for performing a copy processing.

12. The apparatus according to claim 2, wherein the display is touch panel.

13. A method of controlling an image displaying apparatus, the method comprising the step of:

detecting a mobile terminal placed on a display panel of a display;

determining a display position of a display item in accordance with a position of the detected mobile terminal; and

controlling to display the display item at the determined display position;

wherein the display position is determined to be a position of a predetermined distance from the position of the detected mobile terminal, and the display item is an item in accordance with a type of the detected mobile terminal and the display item includes at least a print item, and

in a case where a plurality of mobile terminals placed on the display panel are detected, further controlling the display to display a corresponding plurality of display items for selecting processing modes of the respective mobile terminals.