Mobile terminal and operating method thereof

• US 10,594,927 B2
• Filed: 03/10/2017
• Issued: 03/17/2020
• Est. Priority Date: 10/10/2016
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Jisun, Lee, Suyoung
• Primary Examiner(s): Sheleheda, James R
• Application Number:
  US15/456,345
• Publication Number:
  US 20180103196A1
• Time in Patent Office: 1,103 Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 2013/0074 Stereoscopic image analysis
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/44504 Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits

Abstract

A mobile terminal includes: a display; and a controller configured to: cause the display to display a plurality of videos captured by a 360-degree camera; generate a 360-degree video by combining or stitching the plurality of videos; and cause the display to display a stitching region corresponding to a focused photographing object when the focused photographing object included in the 360-degree video is placed in the stitching region that is a boundary region in which at least two of the plurality of videos are connected.

Claims

1. A mobile terminal comprising:

a display; and

a controller configured to;

acquire a plurality of videos captured by a 360-degree camera;

generate a 360-degree video by combining or stitching the plurality of videos;

cause the display to display a partial area of a whole region of the generated 360-degree video, wherein the whole region includes a plurality of focused photographing objects and at least one of the plurality of focused photographing objects is not included in the displayed partial area;

cause the display to display a stitching region corresponding to a first focused photographing object on the displayed partial area, when the first focused photographing object included in the 360-degree video is displayed and placed in a boundary region in which at least two of the plurality of videos are connected;

increase an area of the displayed stitching region as a distance between the 360-degree camera and the first focused photographing object decreases; and

cause the display to display an identifier corresponding to a second focused photographing object when the second focused photographing object among the plurality of focused photographing objects is not displayed,

wherein the identifier includes information indicating that the second focused photographing object is placed in the boundary region when the second focused photographing object, which is not displayed, is placed in the boundary region.

2. The mobile terminal of claim 1, wherein the controller is further configured to provide a guide for the first focused photographing object to avoid the stitching region in response to an input for selecting the stitching region.

3. The mobile terminal of claim 2, wherein the stitching region corresponding to the first focused photographing object is no longer displayed when the 360-degree camera is turned toward a different direction or angle.

4. The mobile terminal of claim 2, wherein the guide is provided in at least one of a text format or a voice format.

5. The mobile terminal of claim 1, wherein the controller is further configured to cause the display to display the stitching region as a bold dashed-line.

6. The mobile terminal of claim 1, wherein the first focused photographing object is a human or an object.

7. The mobile terminal of claim 1, wherein the first focused photographing object is set by a user.

8. The mobile terminal of claim 1, wherein:

the 360-degree camera comprises a plurality of cameras such that each of the plurality of cameras captures a respectively corresponding one of the plurality of videos; and

the controller is further configured to cause the display to display information of each of the plurality of cameras on the respectively corresponding one of the plurality of videos.

9. The mobile terminal of claim 8, wherein the controller is further configured to cause the display to display information of at least one of a resolution, a type, or a position of each of the plurality of cameras on the respectively corresponding one of the plurality of videos.

10. The mobile terminal of claim 8, wherein the controller is further configured to cause the display to display a central region of a view angle of each of the plurality of cameras on the respectively corresponding one of the plurality of videos.

11. The mobile terminal of claim 8, wherein:

the plurality of cameras comprise a high resolution camera and a low resolution camera; and

the controller is further configured to cause the display to display a first video captured by the high resolution camera and a second video captured by the low resolution camera such that the first video and the second video are distinguished from each other among the plurality of videos.

12. The mobile terminal of claim 11, wherein the controller is further configured to cause the display to display the first video in a first region indicated by a bold dashed-line.

13. The mobile terminal of claim 12, wherein the controller is further configured to cause the display to display the second video in a second region faintly relative to the first video in the first region.

14. The mobile terminal of claim 1, wherein:

the second focused photographing object included in the whole region is not included in the displayed partial area; and

the information is not included in the identifier when the second focused photographing object is not placed in the boundary region.

15. The mobile terminal of claim 14, wherein the controller is further configured to cause the display to display the second focused photographing object in response to selection of the identifier.

16. A method of operating a mobile terminal, the method comprising:

acquiring a plurality of videos captured by a 360-degree camera;

generating a 360-degree video by combining or stitching the plurality of videos;

displaying a partial area of a whole region of the generated 360-degree video, wherein the whole region includes a plurality of focused photographing objects and at least one of the plurality of focused photographing objects is not included in the displayed partial area;

displaying a stitching region corresponding to a first focused photographing object on the displayed partial area, when the first focused photographing object included in the 360-degree video is displayed and placed in a boundary region in which at least two of the plurality of videos are connected;

increasing an area of the displayed stitching region as a distance between the 360-degree camera and the first focused photographing object decreases; and

displaying an identifier corresponding to a second focused photographing object when the second focused photographing object among the plurality of focused photographing objects is not displayed,

wherein the identifier includes information indicating that the second focused photographing object is placed in the boundary region when the second focused photographing object, which is not displayed, is placed in the boundary region.

17. The method of claim 16, further comprising providing a guide for the first focused photographing object to avoid the stitching region in response to an input for selecting the stitching region.

18. The method of claim 17, wherein the stitching region corresponding to the first focused photographing object is no longer displayed when the 360-degree camera is turned toward a different direction or angle.

19. The method of claim 16, wherein the first focused photographing object is a human or an object.

20. The method of claim 16, wherein:

the 360-degree camera comprises a plurality of cameras such that each of the plurality of cameras captures a respectively corresponding one the plurality of videos; and

information of each of the plurality of cameras is displayed on the respectively corresponding one of the plurality of videos.