Enlarging image based on proximity of a pointing object to a display screen

• US 9,772,757 B2
• Filed: 03/15/2013
• Issued: 09/26/2017
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Nakao, Masatoshi
• Primary Examiner(s): Parker, Jeanette J
• Application Number:
  US14/394,782
• Publication Number:
  US 20150052476A1
• Time in Patent Office: 1,656 Days
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/367 Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A display device includes a display section which displays an image in a screen, a proximity detecting section which detects proximity of a finger to the screen, an image generating section which generates, in accordance with the detected proximity of the finger, an enlarged image by enlarging the image displayed in the screen with a prescribed enlarged display magnification, and a display control section which controls to display a local enlarged image corresponding to a part of the generated enlarged image in a superimposed manner over the image in a position in the screen vertically below the finger whose proximity has been detected.

Claims

1. A display apparatus comprising:

a display; and

a detector, wherein,

when the display displays a first screen on a first layer, and

the detector detects contactless proximity of an object to the display displaying the first screen and first coordinates of the object in contactless proximity to the display displaying the first screen,

a first area of the first screen,

which includes the first coordinates of the object in contactless proximity to the display and has a predetermined correspondence with the first coordinates,

is enlarged to a first enlarged area having a predetermined shape and a predetermined size, and the display displays the first enlarged area on a second layer overlapping the first screen;

while the display is displaying the first enlarged area overlapping the first screen and the detector is detecting the contactless proximity of the object to the display and the first coordinates of the object,

when the detector detects the contactless proximity of the object to the display and second coordinates of the object in contactless proximity to the display, the second coordinates being different from the first coordinates and within the first enlarged area,

a second area of the first screen,

which includes the second coordinates of the object in contactless proximity to the display and has the predetermined correspondence with the second coordinates,

is enlarged to a second enlarged area having the predetermined shape and the predetermined size,

the second enlarged area is centered at a centering coordinate, wherein a distance between the centering coordinate and the first coordinates is a result of multiplication of a ratio between a display magnification of the first layer and a display magnification of the first enlarged area on the second layer and a relative movement amount of the object from the first coordinates to the second coordinates; and

the display displays the second enlarged area overlapping the first screen;

while the display is displaying the second enlarged area overlapping the first screen and the detector is detecting the contactless proximity of the object to the display and the second coordinates of the object,

when the detector detects a contact of the object to the display and third coordinates of the object contacting the display within the second enlarged area,

an item displayed within the second enlarged area and at the third coordinate of the object contacting the display is selected,

wherein the object in contactless proximity to the display is in a plane parallel to the display within a prescribed distance threshold value with respect to the display.

2. The display apparatus according to claim 1, wherein

the second enlarged area changes a position from a position of the first enlarged area, regardless of a position of the second coordinates with respect to a boundary of the first enlarged area.

3. The display apparatus according to claim 1, wherein the object is a finger of a user.

4. The display apparatus according to claim 1, wherein the object is a stylus.

5. The display apparatus according to claim 1, wherein when the item displayed within the second enlarged area is selected, the display apparatus starts an operation.

6. The display apparatus according to claim 1, wherein a distance between the first coordinates and the first area is equal to a distance between the second coordinates and the second area, and the first area and the second area have a same shape and a same size.

7. A display control method for a display apparatus including a display and a detector,

the display control method comprising:

displaying a first screen on a first layer on the display;

detecting, by the detector, contactless proximity of an object to the display displaying the first screen and first coordinates of the object in contactless proximity to the display displaying the first screen;

enlarging a first area of the first screen,

which includes the first coordinates of the object in contactless proximity to the display and has a predetermined correspondence with the first coordinates,

to a first enlarged area having a predetermined shape and a predetermined size,

when the display displays the first screen and the detector detects the contactless proximity of the object to the display and the first coordinates of the object in contactless proximity to the display;

displaying, on the display, the first enlarged area on a second layer overlapping the first screen;

detecting, by the detector, the contactless proximity of the object to the display and second coordinates of the object in contactless proximity the display,

while the display is displaying the first enlarged area overlapping the first screen and the detector is detecting the contactless proximity of the object and the first coordinates of the object,

the second coordinates being different from the first coordinates and within the first enlarged area;

enlarging a second area of the first screen,

which includes the second coordinates of the object in contactless proximity to the display and has a predetermined correspondence with the second coordinates,

to a second enlarged area having the predetermined shape and a predetermined size,

the second enlarged area is centered at a centering coordinate, wherein a distance between the centering coordinate and the first coordinates is a result of multiplication of a ratio between a display magnification of the first layer and a display magnification of the first enlarged area on the second layer and a relative movement amount of the object from the first coordinates to the second coordinates,

when the detector detects the contactless proximity of the object to the display displaying the first enlarged area overlapping the first screen and the second coordinates of the object in contactless proximity to the display;

displaying, on the display, the second enlarged area overlapping the first screen;

detecting, by the detector, a contact of the object to the display and third coordinates of the object contacting the display within the second enlarged area, while the display is displaying the second enlarged area overlapping the first screen and the detector is detecting the contactless proximity of the object to the display and the second coordinates of the object; and

selecting an item displayed within the second enlarged area and corresponding to the third coordinates of the object contacting the display, when the detector detects the contact of the object to the display and the third coordinates of the object contacting the display within the second enlarged area,

wherein the object in contactless proximity to the display is in a plane parallel to the display within a prescribed distance threshold value with respect to the display.

8. The display control method according to claim 7, wherein

the second enlarged area changes a position from a position of the first enlarged area, regardless of a position of the second coordinates with respect to a boundary of the first enlarged area.

9. The display control method according to claim 7, wherein the object is a finger of a user.

10. The display control method according to claim 7, wherein the object is a stylus.

11. The display control method according to claim 7, wherein when the item displayed within the second enlarged area is selected, the display apparatus starts an operation.

12. The display control method according to claim 7, wherein a distance between the first coordinates and the first area is equal to a distance between the second coordinates and the second area, and the first area and the second area have a same shape and a same size.

13. A non-transitory computer readable recording medium storing a program, when executed by a processor provided in a display apparatus having a display and a detector, that causes the processor to perform a process comprising:

displaying a first screen on a first layer on the display;

detecting, by the detector, contactless proximity of an object to the display displaying the first screen and first coordinates of the object in contactless proximity to the display displaying the first screen;

enlarging a first area of the first screen,

which includes the first coordinates of the object in contactless proximity to the display and has a predetermined correspondence with the first coordinates,

to a first enlarged area having a predetermined shape and a predetermined size,

when the display displays the first screen and the detector detects the contactless proximity of the object to the display and the first coordinates of the object in contactless proximity to the display;

displaying, on the display, the first enlarged area on a second layer overlapping the first screen;

detecting, by the detector, the contactless proximity of the object to the display and second coordinates of the object in contactless proximity the display,

while the display is displaying the first enlarged area overlapping the first screen and the detector is detecting the contactless proximity of the object and the first coordinates of the object,

the second coordinates being different from the first coordinates and within the first enlarged area;

enlarging a second area of the first screen,

which includes the second coordinates of the object in contactless proximity to the display and has a predetermined correspondence with the second coordinates,

to a second enlarged area having the predetermined shape and a predetermined size,

the second enlarged area is centered at a centering coordinate, wherein a distance between the centering coordinate and the first coordinates is a result of multiplication of a ratio between a display magnification of the first layer and a display magnification of the first enlarged area on the second layer and a relative movement amount of the object from the first coordinates to the second coordinates,

when the detector detects the contactless proximity of the object to the display displaying the first enlarged area overlapping the first screen and the second coordinates of the object in contactless proximity to the display;

displaying, on the display, the second enlarged area overlapping the first screen;

detecting, by the detector, a contact of the object to the display and third coordinates of the object contacting the display within the second enlarged area, while the display is displaying the second enlarged area overlapping the first screen and the detector is detecting the contactless proximity of the object to the display and the second coordinates of the object; and

selecting an item displayed within the second enlarged area and corresponding to the third coordinates of the object contacting the display, when the detector detects the contact of the object to the display and the third coordinates of the object contacting the display within the second enlarged area,

wherein the object in contactless proximity to the display is in a plane parallel to the display within a prescribed distance threshold value with respect to the display.

14. The non-transitory computer readable recording medium according to claim 13, wherein

the second enlarged area changes a position from a position of the first enlarged area, regardless of a position of the second coordinates with respect to a boundary of the first enlarged area.

15. The non-transitory computer readable recording medium according to claim 13, wherein the object is a finger of a user.

16. The non-transitory computer readable recording medium according to claim 13, wherein the object is a stylus.

17. The non-transitory computer readable recording medium according to claim 13, wherein a distance between the first coordinates and the first area is equal to a distance between the second coordinates and the second area, and the first area and the second area have a same shape and a same size.