Display device and image display method

• US 10,642,348 B2
• Filed: 12/07/2018
• Issued: 05/05/2020
• Est. Priority Date: 12/11/2017
• Status: Active Grant

• Current Assignee: KYOCERA Document Solutions, Inc. (Kyocera Corporation)
• Original Assignee: KYOCERA Document Solutions, Inc. (Kyocera Corporation)
• Inventors: Manda, Etsuko, Hiranuma, Yoichi
• Primary Examiner(s): Ma, Calvin C
• Application Number:
  US16/214,019
• Publication Number:
  US 20190179406A1
• Time in Patent Office: 515 Days
• Field of Search: 345173, 345174
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

A display device includes a controller, a display, and a display controller. The controller generates an augmented reality image based on an image displayed on a screen of an external terminal display device and a size of a screen area of the screen. The augmented reality image corresponds to the image. The display displays the augmented reality image so that the image is viewed by a user through augmented reality. The display controller controls displaying by the display. The controller generates an augmented reality image including an excess region when a size of an overall area of the image is larger than the size of the screen area. The excess region is a portion of the overall area and corresponds to an excess from the size of the screen area. The display controller directs the display to display the excess region outside the screen area.

Claims

1. A display device comprising:

a controller configured to generate an augmented reality image based on an image displayed on a screen of an external terminal display device and a size of a screen area of the screen, the augmented reality image corresponding to the image;

a display configured to display the augmented reality image so that the image is viewed by a user through augmented reality; and

a display controller configured to control displaying by the display, wherein

the controller generates an augmented reality image including an excess region when a size of an overall area of the image is larger than the size of the screen area,

the excess region is a portion of the overall area and corresponds to an excess from the size of the screen area,

the display controller directs the display to display the excess region outside the screen area,

the display has a vision area defining a field of view of the user,

the display controller directs the display to display the augmented reality image within the vision area,

the image includes a first region and a second region continuous from the first region,

the first region and the second region constitute the overall area,

in a situation in which the second region is protruding from the vision area, the display controller changes a position of the second region so that the second region is displayed within the vision area, and

when changing the position of the second region so that the second region is displayed within the vision area, the display controller determines a boundary between the first region and the second region by determining a range of the first region according to a distance between an end of the screen area and an end of the vision area, and causes the second region to be displayed within the vision area with the second region separated from the first region.

2. The display device according to claim 1, wherein

the augmented reality image includes the overall area and a terminal image exhibiting the external terminal display device, and

the display controller directs the display to display the overall area and the terminal image in a stack.

3. The display device according to claim 1, wherein

the first region includes an end portion adjacent to the second region, and

in a situation in which the second region is protruding from the vision area, the display controller changes the position of the second region so that the second region is displayed within the vision area together with a copy region exhibiting the same image as the end portion.

4. The display device according to claim 1, wherein

the display controller directs the display to change the augmented reality image being displayed, based on a touch position detected on the screen.

5. The display device according to claim 4, wherein

the display controller directs the display to display a scaled image obtained by scaling the image based on the touch position, and

in a situation in which a pre-defined touch position is detected on the screen after the scaled image has been displayed, the display controller directs the display to display a reference image over the scaled image based on the pre-defined touch position, the reference image exhibiting the image before being scaled.

6. The display device according to claim 5, wherein

the augmented reality image includes a terminal image exhibiting the external terminal display device,

the terminal image includes a bezel image exhibiting a bezel of the screen, and

the display controller directs the display to display a scaled bezel image obtained by scaling the bezel image according to a size of the scaled image.

7. An image display method comprising implementation by a processor of:

generating an augmented reality image based on an image displayed on a screen of an external terminal display device and a size of a screen area of the screen, the augmented reality image corresponding to the image;

displaying the augmented reality image so that the image is viewed by a user through augmented reality; and

controlling displaying the augmented reality image, wherein

in the generating an augmented reality image, the processor generates an augmented reality image including an excess region when a size of an overall area of the image is larger than the size of the screen area,

the excess region is a portion of the overall area and corresponds to an excess from the size of the screen area, and

in the controlling displaying the augmented reality image, the processor controls displaying the augmented reality image so that the excess region is displayed outside the screen area,

the displaying the augmented reality image includes displaying, by a display, the augmented reality image, the display having a vision area defining a field of view of the user,

in the controlling displaying the augmented reality image, the processor directs the display to display the augmented reality image within the vision area,

the image includes a first region and a second region continuous from the first region,

the first region and the second region constitute the overall area,

in the controlling displaying the augmented reality image, in a situation in which the second region is protruding from the vision area, the processor changes a position of the second region so that the second region is displayed within the vision area, and

when changing the position of the second region so that the second region is displayed within the vision area, the processor determines a boundary between the first region and the second region by determining a range of the first region according to a distance between an end of the screen area and an end of the vision area, and causes the second region to be displayed within the vision area with the second region separated from the first region.