Terminal apparatus, display control method, and display control program for three dimensional perspective display

• US 8,638,292 B2
• Filed: 12/03/2009
• Issued: 01/28/2014
• Est. Priority Date: 12/05/2008
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Kawakami, Takashi, Kawakami, Hiroyuki, Ohmori, Kenta
• Primary Examiner(s): Klimowicz, Will J
• Assistant Examiner(s): FISCHER, MARK L
• Application Number:
  US12/629,928
• Publication Number:
  US 20100079371A1
• Time in Patent Office: 1,517 Days
• Field of Search: None
• US Class Current: 345/156
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

A terminal apparatus includes a display displaying a plurality of display elements representing options on a display screen, an image-capturing section capturing an image of an operator who is viewing the display screen, a face position detector detecting the position of a facial image of the operator in a captured image, and a controller controlling the display to move the plurality of display elements in a predetermined direction on the display screen and to sequentially update and display the display elements when it is detected that the facial image of the operator in the captured image is outside of a predetermined range, and to stop the movement of the plurality of display elements when it is detected that the facial image falls within the predetermined range.

Claims

1. A terminal apparatus comprising:

display means for displaying a plurality of display elements representing selection options on a display screen, the plurality of display elements being three-dimensionally displayed with perspective relative to a view point of an operator;

image-capturing means for capturing an image of the operator who is viewing the display screen;

face position detection means for detecting a position of a facial image of the operator in a captured image; and

control means (a) for controlling the display means, when the position of the facial image in the captured image is detected to be outside of a predetermined range, to move the plurality of display elements in a predetermined direction on the display screen and to sequentially change the arrangement of the display elements and display the display elements with perspective as a three-dimensional image, and (b) for controlling the display means to simultaneously (1) stop movement of the plurality of display elements when the position of the facial image in the captured image is detected to fall within the predetermined range and (2) select a display element at a predetermined position.

2. The terminal apparatus according to claim 1,

wherein, when stopping the movement of the display elements, the control means highlights the display element at the predetermined position at the present time.

3. The terminal apparatus according to claim 2,

wherein the display elements are expressed by a plurality of cards of the same size having a front surface and a rear surface, and the control means displays the plurality of cards as a card group arranged in parallel at regular intervals in a three-dimensional space in perspective view from a viewpoint where at least a part of one surface of each card of the plurality of cards is visible.

4. The terminal apparatus according to claim 3,

wherein the highlight is made such that one surface of a card corresponding to a display element at the predetermined position from among the plurality of cards is displayed so as to face the front.

5. The terminal apparatus according to claim 3,

wherein the control means switches the surface visible to the operator to the front surface or the rear surface of a card in accordance with whether the facial image exists on one side or the other side of the predetermined range.

6. The terminal apparatus according to claim 3,

wherein the control means changes the distance between the viewpoint and the card group in accordance with a size of the facial image.

7. The terminal apparatus according to claim 1,

wherein the control means displays a projection image projected on a virtual projection plane facing the operator.

8. The terminal apparatus according to claim 1,

wherein a card group serving as the plurality of display elements in a three-dimensional space is arranged in a plurality of columns, and the control means moves at least one card column in a horizontal direction in accordance with a movement of the facial image in a horizontal direction and selects a card column in accordance with the movement of the facial image in a vertical direction.

9. The terminal apparatus according to claim 8,

wherein a movement of the selected card column in the vertical direction and an update of the selected card column are performed in accordance with a position of the facial image.

10. The terminal apparatus according to claim 1,

wherein, when the facial image is outside of the predetermined range, the control means variably controls a speed of movement and an update of the display elements in accordance with a position or a size of the facial image.

11. A display control method for a terminal apparatus including a display section displaying a plurality of display elements representing selection options on a display screen, the plurality of display elements being three-dimensionally displayed with perspective relative to a view point of an operator, and an image-capturing section capturing an image of the operator who is viewing the display screen, the method comprising the steps of:

detecting a position of a facial image of the operator in an image captured by the image-capturing section;

determining whether or not the facial image of the operator in the captured image is outside of a predetermined range;

when it is detected that the position of the facial image in the captured image is outside of the predetermined range, moving the plurality of display elements in a predetermined direction on the display screen, and sequentially changing the arrangement of the display elements and displaying the display elements with perspective as a three-dimensional image; and

when it is detected that the position of the facial image in the captured image fails within the predetermined range, controlling the display section to simultaneously (1) stop movement of the plurality of display elements and (2) select a display element at a specific position at the present time.

12. A display control program product embodied on a non-transitory computer readable medium which is executed by a terminal apparatus including a display section displaying a plurality of display elements representing selection options on a display screen, the plurality of display elements being three-dimensionally displayed with perspective relative to a view point of an operator, and an image-capturing section capturing the image of an operator who is viewing the display screen, the program product causing a computer to execute the steps of:

detecting a position of a facial image of the operator in an image captured by the image capturing section;

determining whether or not the facial image of the operator in the captured image is outside of a predetermined range;

when it is detected that the position of the facial image in the captured image is outside of the predetermined range, moving the plurality of display elements in a predetermined direction on the display screen, and sequentially changing the arrangement of the display elements and displaying the display elements with perspective as a three-dimensional image; and

when it is detected that the position of the facial image in the captured image falls within the predetermined range, controlling the display section to simultaneously (1) stop movement of the plurality of display elements and (2) select a display element at a specific position at the present time.

13. A terminal apparatus comprising:

a display displaying a plurality of display elements representing selection options on a display screen, the plurality of display elements being three-dimensionally displayed with perspective relative to a view point of an operator;

an image-capturing section capturing an image of the operator who is viewing the display screen;

a face position detector detecting a position of a facial image of the operator in a captured image; and

a controller (a) controlling the display, when the position of the facial image of the operator in the captured image is detected to be outside of a predetermined range, to move the plurality of display elements in a predetermined direction on the display screen and to sequentially change the arrangement of the display elements and display the display elements with perspective as a three-dimensional image, and (b) controlling the display to simultaneously (1) stop movement of the plurality of display elements when the position of the facial image in the captured image is detected to fail within the predetermined range and (2) select a display element of a predetermined position.