SERVER, USER TERMINAL DEVICE, AND CONTROL METHOD THEREFOR

• US 20180068489A1
• Filed: 12/03/2015
• Published: 03/08/2018
• Est. Priority Date: 04/20/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KIM, Do-wan, WOO, Ji-hwan, YU, Han-il
• Granted Patent: US 11,024,083 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06Q 50/10 Services
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video

Abstract

A server is disclosed. A server for providing a content to a user terminal device providing a virtual reality service comprises: a communication unit for performing communication with at least one source device and the user terminal device; and a processor for, when a content transmission request for a preconfigured location is received from the user terminal device, receiving a content photographed in a real time from a source device of the preconfigured location on the basis of location information received from at least one source device, and providing the content to the user terminal device.

Claims

1. A server which provides a content to a user terminal device providing a virtual reality service, the server comprising:

a communication unit configured to communicate with at least one source device and the user terminal device; and

a processor configured to, in response to a content transmission request on a predetermined location being received from the user terminal device, receive a content photographed by a source device of the predetermined location in real time based on location information received from the at least one source device, and transmit the content to the user terminal device.

2. The server of claim 1, wherein the processor is configured to transmit a plurality of photographed contents received from a plurality of source devices to the user terminal device in sequence based on location information received from the plurality of source devices, or is configured to combine the plurality of photographed contents received from the plurality of source devices based on the location information received from the plurality of source devices and transmit a combined content to the user terminal device.

3. The server of claim 1, wherein the processor is configured to select a content corresponding to authority information from among the contents received from the source devices, based on the authority information regarding a content sharing level of a content that is set by the at least one source device to be able to be shared with the user terminal device, and transmit the content to the user terminal device.

4. The server of claim 1, wherein the processor is configured to process the content received from the source device according to a predetermined condition set at the user terminal device, and transmit the content to the user terminal device.

5. The server of claim 4, wherein, in response to the content received from the source device being a 3D content, the processor is configured to generate a left-eye 3D space image and a right-eye 3D space image by projecting a left-eye image and a right-eye image included in the 3D content onto a virtual 3D space, and, in response to information corresponding to a motion state of the user terminal device being received from the user terminal device, the processor is configured to extract a view point region corresponding to the motion state of the user terminal device from the generated left-eye and right-eye 3D space images, and transmit an image of the view point region to the user terminal device.

6. A user terminal device providing a virtual reality service, the user terminal device comprising:

a display;

a communication unit configured to communicate with a server; and

a processor configured to, in response to a user command to specify a predetermined location being inputted, transmit information related to the corresponding location to the server, and receive a real-time photographed content related to the corresponding location from the server and display the content through the display.

7. The user terminal device of claim 6, wherein the processor is configured to receive only a content selected at the server based on authority information regarding a content sharing level of a content that is set by at least one source device providing the real-time photographed content to be able to be shared with the user terminal device.

8. The user terminal device of claim 6, wherein, in response to a user command to set a first point and a second point on a UI screen being inputted, the processor is configured to control to transmit information corresponding to a predetermined path connecting the first point and the second point to the server, and receive a plurality of contents related to the predetermined path from the server and display the plurality of contents.

9. The user terminal device of claim 6, wherein, in response to a user command to set a first point and a second point on a UI screen being inputted, the processor is configured to control to transmit information corresponding to a predetermined path connecting the first point and the second point to the server, and receive a combined content in which a plurality of contents related to the predetermined path are combined from the server and display the combined content.

10. The user terminal device of claim 6, wherein, in response to a user command to set a predetermined area being inputted, the processor is configured to control to transmit information related to the corresponding area to the server, and receive location information of at least one source device located in the predetermined area from the server and display a GUI indicating the location of the at least one source device.

11. The user terminal device of claim 10, wherein the processor is configured to receive authority information regarding a content sharing level of a content that the at least one source device is able to share with the user terminal device from the server, and display the authority information on a region adjacent to a GUI indicating the location of the source device.

12. The user terminal device of claim 11, wherein, in response to a user command to specify the predetermined location on a UI screen providing a virtual experience service being inputted, the processor is configured to control to transmit information related to the corresponding location to the server, and receive a virtual experience content photographed at the corresponding location from the server and display the virtual experience content.

13. The user terminal device of claim 12, wherein the virtual experience service comprises at least one of a virtual road experience service, a virtual tour service, and a virtual event experience service.

14. A control method of a server which provides a content to a user terminal device providing a virtual reality service, the control method comprising:

receiving a content transmission request on a predetermined location from the user terminal device; and

receiving a real-time photographed content from a source device of the predetermined location based on location information received from at least one source device, and providing the content to the user terminal device in the form of streaming.

15. A control method of a user terminal device which provides a virtual reality service, the control method comprising:

in response to a user command to specify a predetermined location being inputted, transmitting information related to the corresponding location to the server; and

receiving a real-time photographed content related to the corresponding location from the server and displaying the content through a display.