PERSONALIZED POINT OF INTEREST GUIDANCE IN 360-DEGREE VIEWS

• US 20180232905A1
• Filed: 02/15/2017
• Published: 08/16/2018
• Est. Priority Date: 02/15/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bostick, James E., Ganci, JR., John M., Keen, Martin G., Rakshit, Surbajit K.
• Granted Patent: US 10,217,239 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597

Abstract

Shifting of a focus of a first user within a first 360-view data is tracked during an observation of the first 360-view data by the first user to determine a first set of POIs in the 360-view data where the first user pauses for a duration. A subset of the first set of POIs is regarded as non-obvious POIs in the first 360-view data. For a second user who has not observed the 360-view data, a second set of POIs is computed and includes a second subset of non-obvious POIs. A non-obvious POI from the second subset is matched to a particular non-obvious POI in the first subset. During an observation of the first 360-view data by the second user, a location of focus is computed. Guidance is provided by computing a movement of the focus from the location to a non-obvious POI in the first 360-view data.

Claims

1. A method comprising:

tracking a shifting of a focus of a first user within a first 360-view data during an observation of the first 360-view data by the first user, the tracking producing tracking data;

analyzing the tracking data to determine a first set of POIs in the 360-view data, wherein the first user pauses for a duration greater than a threshold duration at each POI in the first set of POIs, wherein a POI in the first set of POIs is a non-obvious POI when the 360-view data excludes any data configured to attract the focus of the first user to the POI;

recording a subset of the first set of POIs as non-obvious POIs in the first 360-view data;

computing, for a second user who has not observed the 360-view data, a second set of POIs, the second set of POIs including a second subset of non-obvious POIs;

matching a non-obvious POI from the second subset to a particular non-obvious POI in the first subset;

computing, during an observation of the first 360-view data by the second user, a location of focus of the second user;

computing a parameter of a movement of the focus of the second user from the location to the particular non-obvious POI in the first 360-view data; and

guiding the second user from the location to the particular non-obvious POI using the parameter of the movement.

2. The method of claim 1, further comprising:

tracking a shifting of a focus of a second user within a second 360-view data during an observation of the second 360-view data by the second user, to produce second tracking data;

analyzing the second tracking data to compute the second set of POIs; and

computing a characteristic from a non-obvious POI in the second subset of non-obvious POIs, wherein the characteristic is used in the matching.

3. The method of claim 2, wherein the second user observes the second 360-view data prior to observing the first 360-view data.

4. The method of claim 1, further comprising:

analyzing a profile of the second user, wherein a characteristic of a non-obvious POI in the second subset of non-obvious POIs is specified in the profile, and wherein the characteristic is used in the matching.

5. The method of claim 1, further comprising:

analyzing a social data of the second user, wherein a characteristic of a non-obvious POI in the second subset of non-obvious POIs is deduced from the social data, and wherein the characteristic is used in the matching.

6. The method of claim 1, further comprising:

configuring a biometric sensor to perform the tracking by measuring eye movements of the first user during the observation.

7. The method of claim 1, further comprising:

analyzing the first 360-view data to determine that a portion of the first 360-view data is configured to attract an attention of any user towards a second subset of the first set of POIs in the first 360-view data;

recording the second subset of the first set of POIs as obvious POIs in the first 360-view data.

8. The method of claim 1, wherein the parameter of movement is a direction of the movement.

9. The method of claim 1, wherein the parameter of movement is an amount of the movement.

10. The method of claim 1, wherein the guiding further provides additional data associated with the particular non-obvious POI in the first 360-view data.

11. The method of claim 1, wherein the first 360-view data comprises a 360-degree video.

12. The method of claim 1, wherein the first 360-view data comprises a 360-degree graphical representation of a virtual visual environment.

13. A computer usable program product comprising one or more computer-readable storage devices, and program instructions stored on at least one of the one or more storage devices, the stored program instructions comprising:

program instructions to track a shifting of a focus of a first user within a first 360-view data during an observation of the first 360-view data by the first user, the tracking producing tracking data;

program instructions to analyze the tracking data to determine a first set of POIs in the 360-view data, wherein the first user pauses for a duration greater than a threshold duration at each POI in the first set of POIs, wherein a POI in the first set of POIs is a non-obvious POI when the 360-view data excludes any data configured to attract the focus of the first user to the POI;

program instructions to record a subset of the first set of POIs as non-obvious POIs in the first 360-view data;

program instructions to compute, for a second user who has not observed the 360-view data, a second set of POIs, the second set of POIs including a second subset of non-obvious POIs;

program instructions to match a non-obvious POI from the second subset to a particular non-obvious POI in the first subset;

program instructions to compute, during an observation of the first 360-view data by the second user, a location of focus of the second user;

program instructions to compute a parameter of a movement of the focus of the second user from the location to the particular non-obvious POI in the first 360-view data; and

program instructions to guide the second user from the location to the particular non-obvious POI using the parameter of the movement.

14. The computer usable program product of claim 13, further comprising:

program instructions to track a shifting of a focus of a second user within a second 360-view data during an observation of the second 360-view data by the second user, to produce second tracking data;

program instructions to analyze the second tracking data to compute the second set of POIs; and

program instructions to compute a characteristic from a non-obvious POI in the second subset of non-obvious POIs, wherein the characteristic is used in the matching.

15. The computer usable program product of claim 14, wherein the second user observes the second 360-view data prior to observing the first 360-view data.

16. The computer usable program product of claim 13, further comprising:

program instructions to analyze a profile of the second user, wherein a characteristic of a non-obvious POI in the second subset of non-obvious POIs is specified in the profile, and wherein the characteristic is used in the matching.

17. The computer usable program product of claim 13, further comprising:

program instructions to analyze a social data of the second user, wherein a characteristic of a non-obvious POI in the second subset of non-obvious POIs is deduced from the social data, and wherein the characteristic is used in the matching.

18. The computer usable program product of claim 13, wherein the computer usable code is stored in a computer readable storage device in a data processing system, and wherein the computer usable code is transferred over a network from a remote data processing system.

19. The computer usable program product of claim 13, wherein the computer usable code is stored in a computer readable storage device in a server data processing system, and wherein the computer usable code is downloaded over a network to a remote data processing system for use in a computer readable storage device associated with the remote data processing system.

20. A computer system comprising one or more processors, one or more computer-readable memories, and one or more computer-readable storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the stored program instructions comprising:

program instructions to track a shifting of a focus of a first user within a first 360-view data during an observation of the first 360-view data by the first user, the tracking producing tracking data;

program instructions to analyze the tracking data to determine a first set of POIs in the 360-view data, wherein the first user pauses for a duration greater than a threshold duration at each POI in the first set of POIs, wherein a POI in the first set of POIs is a non-obvious POI when the 360-view data excludes any data configured to attract the focus of the first user to the POI;

program instructions to record a subset of the first set of POIs as non-obvious POIs in the first 360-view data;

program instructions to compute, for a second user who has not observed the 360-view data, a second set of POIs, the second set of POIs including a second subset of non-obvious POIs;

program instructions to match a non-obvious POI from the second subset to a particular non-obvious POI in the first subset;

program instructions to compute, during an observation of the first 360-view data by the second user, a location of focus of the second user;

program instructions to compute a parameter of a movement of the focus of the second user from the location to the particular non-obvious POI in the first 360-view data; and

program instructions to guide the second user from the location to the particular non-obvious POI using the parameter of the movement.