Display apparatus with a plurality of screens and method of controlling the same

• US 9,619,019 B2
• Filed: 05/12/2014
• Issued: 04/11/2017
• Est. Priority Date: 05/10/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Chung, Sue-young, Phang, Joon-ho, Park, Nam-hyun, Jung, Do-sung, Moon, Joo-sun, Park, Yi-sak, Bangle, Christopher E.
• Primary Examiner(s): Abdulselam, Abbas
• Application Number:
  US14/275,082
• Publication Number:
  US 20140333531A1
• Time in Patent Office: 1,065 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/440263 by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 21/4858 for modifying screen layout parameters, e.g. fonts, size of the windows

Abstract

A display apparatus and a control method thereof are provided. The display apparatus includes a display configured to display a plurality of images received from a plurality of sources on each of a first screen, a second screen, and a third screen of a display screen, a user interface configured to detect a user interaction, and a controller configured to control the display to move locations of the first to third screens in accordance with a detected rotation interaction in response to the rotation interaction being detected through the user interface.

Claims

1. A display apparatus, the display apparatus comprising:

a display;

an audio output; and

a controller configured to control the display to display a first moving image on a main screen, a second moving image on a left sub-screen, and a third moving image on a right sub-screen, and control the audio output to output audio associated with the first moving image being displayed on the main screen,

wherein the controller is further configured to, in response to receiving user input, control the display to move the first moving image from the main screen to the left sub-screen and move the third moving image from the right sub-screen to the main screen and control the audio output to output audio associated with the third moving image being displayed on the main screen.

2. The display apparatus of claim 1, wherein the left sub-screen is disposed at a left side of the main screen and has a trapezoid shape configured to display an image thereon at a first inclined viewing angle, and

the right sub-screen is disposed at a right side of the main screen and has a trapezoid shape configured to display an image thereon at a second inclined viewing angle different from the first inclined viewing angle.

3. The display apparatus of claim 2, wherein the controller is further configured to, in response to the user input being a user'"'"'s head rotation interaction, control the display by detecting the user'"'"'s head rotation and moving the first, second, and third moving images in accordance with a direction of the detected user'"'"'s head rotation.

4. The display apparatus of claim 3, wherein the controller is further configured to control the display to:

increase a ratio of the third moving image on the display which is located on a right side among the first, second, and third moving images by moving the first, second, and third moving images in a left direction in response to detecting that the user'"'"'s head rotates in a right direction, and

increase a ratio of the first moving image on the display which is located on a left side among the first, second, and third moving images by moving the first, second, and third moving images in a right direction in response to detecting that the user'"'"'s head rotates in a left direction.

5. The display apparatus of claim 4, wherein the controller is further configured to perform a control operation to move the first, second, and third moving images on a real-time basis in accordance with an angle of the user'"'"'s detected head rotation.

6. The display apparatus of claim 5, wherein the controller is further configured to:

set the third moving image which is moved in a left direction as the main screen in response to detecting that the user'"'"'s head rotation angle is greater than a predetermined value while the user'"'"'s head moves in a right direction, and

sets the first moving image which is moved in a right direction as the main screen in response to detecting that the user'"'"'s head rotation angle is greater than the predetermined value while the user'"'"'s head moves in a left direction.

7. The display apparatus of claim 2, wherein the controller is further configured to, in response to the user input being an interaction to rotate a remote controller after pressing a button on the remote controller, control the display to move a moving image which corresponds to a rotation direction of the remote controller in a direction towards a center of the display.

8. The display apparatus of claim 1, wherein the user input is received via a remote controller being moved in a first rotational direction.

9. The display apparatus of claim 8, wherein the controller is further configured to, in response to receiving another user input via moving the remote controller in a second rotational direction opposite to the first rotational direction, control the display to move the first moving image from the main screen to the right sub-screen and move the second moving image from the left sub-screen to the main screen and control the audio output to output audio associated with the second moving image being displayed on the main screen.

10. The display apparatus of claim 1, wherein the user input comprises a user gesture moving in a first rotational direction determined based on processing of images obtained via a camera.

11. The display apparatus of claim 10, wherein, the controller is further configured to, in response to receiving another user input via moving the user gesture in a second rotational direction opposite to the first rotational direction, control the display to move the first moving image from the main screen to the right sub-screen and move the second moving image from the left sub-screen to the main screen and control the audio output to output audio associated with the second moving image being displayed on the main screen.

12. The display apparatus of claim 1, wherein the controller is further configured to control the audio output to output only an audio of a moving image displayed on the main screen which takes up a largest ratio of the display, among the first, second, and third moving images.

13. The display apparatus of claim 12, wherein the controller is further configured to, in response to the user input being a user'"'"'s head rotation interaction, control the audio output to increase an audio output of a moving image having a ratio on the display that increases in response to the user'"'"'s head rotation being detected.

14. The display apparatus of claim 13, wherein the controller is further configured to:

set the third moving image which is located on a right side as a new main screen and to control the audio output to output only an audio of content displayed on the third moving image in response to detecting that an angle of the user'"'"'s head rotation is greater than a predetermined value while the user'"'"'s head moves in a right direction, and

set the first moving image which is located on a left side as a new main screen and to control the audio output to output only an audio of content displayed on the first moving image in response to detecting that the user'"'"'s head rotation angle is greater than the predetermined value while the user'"'"'s head moves in a left direction.

15. The display apparatus of claim 13, wherein the controller is further configured to control the audio output to increase an audio output of a moving image having a ratio on the display that increases, among the first, second, and third moving images, in accordance with a moving image ratio of the display.

16. The display apparatus of claim 13, wherein the controller is further configured to:

increase an audio output of the third moving image in response to detecting that the user'"'"'s head rotates in a right direction, and

increase an audio output of the first moving image in response to detecting that the user'"'"'s head rotates in a left direction.

17. The apparatus of claim 1, wherein the user input comprises a user'"'"'s eye movement interaction in which a movement of the user'"'"'s eye is detected.

18. The apparatus of claim 1, further comprising a storage configured to store a plurality of modules for operating the display apparatus.

19. The apparatus of claim 18, wherein the modules include at least one of a voice recognition module, a touch recognition module, and a gesture module.

20. The apparatus of claim 1, wherein the controller is further configured to control the display to display information related to the first, second, and third moving images.

21. A method for controlling a display apparatus, the method comprising:

displaying a first moving image on a main screen, a second moving image on a left sub-screen, and a third moving image on a right sub-screen;

outputting audio associated with the first moving image being displayed on the main screen; and

in response to receiving user input, moving the first moving image from the main screen to the left sub-screen and moving the third moving image from the right sub-screen to the main screen, and changing the output audio to audio associated with the third moving image being displayed on the main screen.

22. The method of claim 21, wherein the left sub-screen is disposed at a left side of the main screen and has a trapezoid shape configured to display an image thereon at a first inclined viewing angle, and

the right sub-screen is disposed at a right side of the main screen and has a trapezoid shape configured to display an image thereon at a second inclined viewing angle different from the first inclined viewing angle.

23. The method of claim 22, further comprising detecting a user'"'"'s head rotation interaction as the user input,

wherein the moving further comprises moving the first, second, and third moving images in accordance with a direction of the user'"'"'s detected head rotation.

24. The method of claim 23, wherein the moving further comprises:

increasing a ratio of the third moving image which is located on a right side of a display among the first, second, and third moving images by moving the first, second, and third moving images in a left direction in response to detecting that the user'"'"'s head rotates in a right direction; and

increasing a ratio of the first moving image which is located on a left side of the display among the first, second, and third moving images by moving the first, second, and third moving images in a right direction in response to detecting that the user'"'"'s head rotates in a left direction.

25. The method of claim 24, wherein the moving further comprises moving the first, second, and third moving images on a real-time basis in accordance with an angle of the user'"'"'s detected head rotation.

26. The method of claim 25, wherein the moving further comprises:

determining the third moving image which is moved in a left direction as the main screen in response to detecting that the user'"'"'s head rotation angle is greater than a predetermined value while the user'"'"'s head moves in a right direction; and

determining the first moving image which is moved in a right direction as the main screen in response to detecting that the user'"'"'s head rotation angle is greater than the predetermined value while the user'"'"'s head moves in a left direction.

27. The method of claim 21, wherein the user input is received via a remote controller being moved in a first rotational direction.

28. The method of claim 27, wherein the moving further comprises, in response to receiving another user input via moving the remote controller in a second rotational direction opposite to the first rotational direction, moving the first moving image from the main screen to the right sub-screen and moving the second moving image from the left sub-screen to the main screen, and changing the output audio to audio associated with the second moving image being displayed on the main screen.

29. The method of claim 21, wherein the user input comprises a user gesture moving in a first rotational direction determined based on processing of images obtained via a camera.

30. The method of claim 29, wherein the moving further comprises, in response to receiving another user input via moving the user gesture in a second rotational direction opposite to the first rotational direction, moving the first moving image from the main screen to the right sub-screen and moving the second moving image from the left sub-screen to the main screen, and changing the output audio to audio associated with the second moving image being displayed on the main screen.

31. The method of claim 21, wherein the changing further comprises outputting audio related to a moving image displayed on the main screen which takes up a largest ratio of a display, among the first, second, and third moving images.

32. The method of claim 31, wherein the method further comprises detecting a user'"'"'s head rotation interaction as the user input, and

wherein the changing further comprises increasing an audio output of a moving image having a ratio on the display that increases in accordance with a direction of the detected user'"'"'s head rotation among the first, second, and third moving images.

33. The method of claim 32, wherein the changing further comprises:

increasing an audio output of a moving image in response to detecting that the user'"'"'s head is rotated in a right direction, and

increasing an audio output of a moving image in response to detecting that the user'"'"'s head is rotated in a left direction.

34. The method of claim 32, wherein the changing further comprises increasing an audio output of a moving image having a ratio on the display that increases in accordance with a ratio of the display, among the first, second, and third moving images.

35. The method of claim 32, wherein the changing further comprises:

determining the third moving image located on a right side among the first, second, and third moving images as a new main screen in response to detecting that the user'"'"'s head rotation angle is greater than a predetermined value while the user'"'"'s head moves in a right direction, and outputting an audio of content displayed on the third moving image, and

determining a first moving image located on a left side among the first, second, and third moving images as a new main screen in response to detecting that the user'"'"'s head rotation angle is greater than the predetermined value while the user'"'"'s head moves in a left direction, and outputting an audio of content displayed on the first moving image.

36. The method of claim 32, wherein the detecting comprises detecting a user interaction which rotates a remote controller after pressing a button on the remote controller as the user input, and

wherein the moving comprises moving a moving image which corresponds to a direction of a rotation of the remote controller in a direction towards a center of the display.