System and method for 360-degree video navigation

• US 10,558,353 B2
• Filed: 07/18/2016
• Issued: 02/11/2020
• Est. Priority Date: 11/18/2015
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Dickerson, Andrew J., Antonelli, Nick, Wilkinson, Jeff
• Primary Examiner(s): Tran, Tan H
• Application Number:
  US15/213,264
• Publication Number:
  US 20170139578A1
• Time in Patent Office: 1,303 Days
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence

Abstract

A method is provided for navigating a 360-degree video. The method includes displaying a portion of the 360-degree video on a display. The method also includes displaying a graphical indicator overlaid on the 360-degree video. The graphical indicator represents a plurality of viewing directions within the 360-degree video. The graphical indicator includes at least one marker identifying a first viewing direction corresponding to the portion of the 360-degree video. The method also includes receiving an input at a position along the graphical indicator corresponding to a second viewing direction. The method also includes displaying another portion of the 360-degree video on the display, the other portion corresponding to the second viewing direction.

Claims

1. A method for navigating a 360-degree video, the method comprising:

displaying, on a display of an electronic device, a portion of the 360-degree video corresponding to a first viewing direction and a graphical indicator overlaid on the portion of the 360-degree video, the graphical indicator representing a plurality of viewing directions within the 360-degree video, the graphical indicator including a first navigation bar for navigation in a vertical direction and a second navigation bar for navigation in a horizontal direction, wherein the second navigation bar is longer than the first navigation bar;

displaying a first marker at a location on the first navigation bar corresponding to a vertical distance that the first viewing direction is from a reference viewing direction within the 360-degree video, a second marker at a location on the second navigation bar corresponding to a horizontal distance that the first viewing direction is from the reference viewing direction, and a third marker on at least one of the first navigation bar or the second navigation bar, the third marker indicating a point of interest (POI) within the 360-degree video;

receiving an input at a position on the first navigation bar or the second navigation bar that is different than the location of the first marker or the second marker;

when the input is received on the first navigation bar, displaying a second viewing direction based on the vertical distance between the input and the reference viewing direction;

when the input is received on the second navigation bar, displaying the second viewing direction based on the horizontal distance between the input and the reference viewing direction; and

when the input is received on the third marker, displaying the second viewing direction including the POI.

2. The method of claim 1, wherein:

the first navigation bar represents 180 degrees in the vertical direction, and

the second navigation bar represents 360 degrees in the horizontal direction.

3. The method of claim 1, further comprising:

responsive to identifying a period of inactivity after the input, removing the graphical indicator from the 360-degree video; and

responsive to receiving an additional input after the period of inactivity, displaying the graphical indicator overlaid on the 360-degree video.

4. The method of claim 1, further comprising:

in response to displaying the second viewing direction in the 360-degree video adjusting the location of the first marker or the second marker to correspond with the second viewing direction in the 360-degree video.

5. The method of claim 1, further comprising:

displaying, on the display, the second viewing direction independent of an orientation of the electronic device,

wherein the first viewing direction is determined based on the orientation of the electronic device,

wherein the orientation of the electronic device is determined based on the input detected by a sensor of the electronic device,

wherein the plurality of viewing directions allows for directly transitioning, independently of the orientation of the electronic device, from the first viewing direction to any portion of the 360-degree video.

6. The method of claim 1, wherein the reference viewing direction is zero degrees along a horizontal plane and zero degrees along a vertical plane of the 360-degree video.

7. An apparatus for navigating a 360-degree video, the apparatus comprising:

a memory element configured to store the 360-degree video; and

at least one processor coupled to the memory element, the at least one processor configured to;

display, on a display of the apparatus, a portion of the 360-degree video corresponding to a first viewing direction and a graphical indicator overlaid on the portion of the 360-degree video, the graphical indicator representing a plurality of viewing directions within the 360-degree video, the graphical indicator including a first navigation bar for navigation in a vertical direction and a second navigation bar for navigation in a horizontal direction, wherein the second navigation bar is longer than the first navigation bar;

display a first marker at a location on the first navigation bar corresponding to a vertical distance that the first viewing direction is from a reference viewing direction within the 360-degree video, a second marker at a location on the second navigation bar corresponding to a horizontal distance that the first viewing direction is from the reference viewing direction, and a third marker on at least one of the first navigation bar or the second navigation bar, the third marker indicating a point of interest (POI) within the 360-degree video;

receive an input at a position on the first navigation bar or the second navigation bar that is different than the location of the first marker or the second marker;

when the input is received on the first navigation bar, display a second viewing direction based on the vertical distance between the input and the reference viewing direction;

when the input is received on the second navigation bar, displaying the second viewing direction based on the horizontal distance between the input and the reference viewing direction; and

when the input is received on the third marker, display the second viewing direction including the POI.

8. The apparatus of claim 7, wherein:

the first navigation bar represents 180 degrees in the vertical direction, and

the second navigation bar represents 360 degrees in the horizontal direction.

9. The apparatus of claim 7, wherein the at least one processor is further configured to:

responsive to identifying a period of inactivity after the input, remove the graphical indicator from the 360-degree video; and

responsive to receiving an additional input after the period of inactivity, display the graphical indicator overlaid on the 360-degree video.

10. The apparatus of claim 7, wherein the at least one processor is further configured to:

in response to displaying the second viewing direction in the 360-degree video adjust the location of the first marker or the second marker to correspond with the second viewing direction in the 360-degree video.

11. The apparatus of claim 7, wherein the at least one processor is further configured to:

display, on the display, the second viewing direction independent of an orientation of the apparatus,

wherein the first viewing direction is determined based on the orientation of the apparatus,

wherein the orientation of the apparatus is determined based on the input detected by a sensor of the apparatus,

wherein the plurality of viewing directions allows for directly transitioning, independently of the orientation of the apparatus, from the first viewing direction to any portion of the 360-degree video.

12. The apparatus of claim 7, wherein the reference viewing direction is zero degrees along a horizontal plane and zero degrees along a vertical plane of the 360-degree video.

13. A non-transitory computer-readable medium comprising program code for navigating a 360-degree video that, when executed by at least one processor, causes an electronic device to:

display, on a display of the electronic device, a portion of the 360-degree video corresponding to a first viewing direction and a graphical indicator overlaid on the portion of the 360-degree video, the graphical indicator representing a plurality of viewing directions within the 360-degree video, the graphical indicator including a first navigation bar for navigation in a vertical direction and a second navigation bar for navigation in a horizontal direction, wherein the second navigation bar is longer than the first navigation bar;

display a first marker at a location on the first navigation bar corresponding to a vertical distance that the first viewing direction is from a reference viewing direction within the 360-degree video, a second marker at a location on the second navigation bar corresponding to a horizontal distance that the first viewing direction is from the reference viewing direction, and a third marker on at least one of the first navigation bar or the second navigation bar, the third marker indicating a point of interest (POI) within the 360-degree video;

receive an input at a position on the first navigation bar or the second navigation bar that is different than the location of the first marker or the second marker;

when the input is received on the first navigation bar, display a second viewing direction based on the vertical distance between the input and the reference viewing direction;

when the input is received on the second navigation bar, displaying the second viewing direction based on the horizontal distance between the input and the reference viewing direction; and

when the input is received on the third marker, display the second viewing direction including the POI.

14. The non-transitory computer-readable medium of claim 13, wherein:

the first navigation bar represents 180 degrees in the vertical direction, and

the second navigation bar represents 360 degrees in the horizontal direction.

15. The non-transitory computer-readable medium of claim 13, further comprising program code that, when executed by the at least one processor, causes the electronic device to:

responsive to identifying a period of inactivity after the input, remove the graphical indicator from the 360-degree video; and

responsive to receiving an additional input after the period of inactivity, display the graphical indicator overlaid on the 360-degree video.

16. The non-transitory computer-readable medium of claim 13, further comprising program code that, when executed by the at least one processor, causes the electronic device to:

in response to displaying the second viewing direction in the 360-degree video adjust the location of the first marker or the second marker to correspond with the second viewing direction in the 360-degree video.

17. The non-transitory computer-readable medium of claim 13, further comprising program code that, when executed by the at least one processor, causes the electronic device to:

display, on the display, the second viewing direction independent of an orientation of the electronic device,

wherein the first viewing direction is determined based on the orientation of the electronic device,

wherein the orientation of the electronic device is determined based on the input detected by a sensor of the electronic device,

wherein the plurality of viewing directions allows for directly transitioning, independently of the orientation of the electronic device, from the first viewing direction to any portion of the 360-degree video.