Directing field of vision based on personal interests

• US 9,892,648 B2
• Filed: 02/07/2017
• Issued: 02/13/2018
• Est. Priority Date: 06/27/2014
• Status: Active Grant

• Current Assignee: Roblox Corp.
• Original Assignee: International Business Machines Corporation
• Inventors: Anderson, Brian M., Katzman, Scott B., Schneider, Jacob C., Walton, Kaleb D.
• Primary Examiner(s): CHIO, TAT CHI
• Application Number:
  US15/426,424
• Publication Number:
  US 20170148334A1
• Time in Patent Office: 371 Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04N 1/2129 Recording in, or reproducing from, a specific memory area or areas, or recording or reproducing at a specific moment

Abstract

A method for directing the field of vision based on personal interests. The method includes receiving a keyword and/or an image file and processing the keyword and/or image file to generate data representing a user interest. The method includes receiving a video input from a camera representative of the field of vision of the camera and processing the video input to identify a visible element in the field of vision of the camera. The method further includes comparing the visible element in the field of vision of the camera and the data representing the user interest to determine whether the visible element is of interest to the user. A notification is provided to the user for identified visible elements that are of interest to the user.

Claims

1. A method comprising:

receiving, by one or more processors, video input from a camera as the user navigates an environment in real-time, wherein the video input from the camera comprises data representative of a field of vision of the camera;

processing, by one or more processors, the video input from the camera to identify, in real-time, a visible element in the field of vision of the camera;

comparing, by one or more processors, the visible element in the field of vision of the camera and the data representative of the interest of the user to determine whether the visible element is of interest to the user; and

responsive to determining that the visible element is of interest to the user, providing a notification to the user.

2. The method of claim 1, further comprising:

determining, by one or more processors, whether the visible element is in the field of vision of the camera; and

responsive to determining that the visible element is in the field of vision of the camera, visually notifying the user of the visible element.

3. The method of claim 2, further comprising:

responsive to determining that the visible element is not within the field of vision of the camera, providing an indication to the user of a direction of the visible element relative to the field of vision of the camera.

4. The method of claim 1, wherein the field of vision of the camera is coextensive with a real-time field of vision of the user.

5. The method of claim 3, wherein the indication to the user of the direction of the visible element relative to the field of vision of the camera comprises one or more of:

a visual notification;

an aural notification; and

a haptic notification.

6. The method of claim 2, wherein responsive to determining that the visible element is not within the field of vision of the camera, providing an indication to the user of a direction to turn in order to see the visible element.

7. The method of claim 2, wherein visually notifying the user of the visible element further comprises at least one of:

shading the visible element;

highlighting the visible element; and

displaying an arrow beside the visible element.

8. A computer program product comprising:

a computer readable storage medium and program instructions stored on the computer readable storage medium, the program instructions comprising;

program instructions to receive video input from a camera as the user navigates an environment in real-time, wherein the video input from the camera comprises data representative of a field of vision of the camera;

program instructions to process the video input from the camera to identify, in real-time, a visible element in the field of vision of the camera;

program instructions to compare the visible element in the field of vision of the camera, and the data representative of the interest of the user to determine whether the visible element is of interest to the user; and

responsive to determining that the visible element is of interest to the user, program instructions to provide a notification to the user.

9. The computer program product of claim 8, wherein the program instructions stored on the one or more computer readable storage media further comprise:

program instructions to determine whether the visible element is in the field of vision of the camera; and

responsive to determining that the visible element is in the field of vision of the camera, program instructions to visually notify the user of the visible element.

10. The computer program product of claim 9, wherein the program instructions stored on the one or more computer readable storage media further comprise:

responsive to determining that the visible element is not within the field of vision of the camera, program instructions to provide an indication to the user of a direction of the visible element relative to the field of vision of the camera.

11. The computer program product of claim 8, wherein the field of vision of the camera is coextensive with a real-time field of vision of the user.

12. The computer program product of claim 10, wherein the indication to the user of the direction of the visible element relative to the field of vision of the camera comprises one or more of:

a visual notification;

an aural notification; and

a haptic notification.

13. The computer program product of claim 9, wherein the program instructions to, responsive to determining that the visible element is not within the field of vision of the camera comprise:

program instructions to provide an indication to the user of a direction to turn in order to see the visible element.

14. The computer program product of claim 9, wherein program instructions to visually notify the user of the visible element further comprise at least one of:

shading the visible element, highlighting the visible element, and displaying an arrow beside the visible element.

15. A computer system comprising:

one or more computer processors;

one or more computer readable storage media;

program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to receive video input from a camera as the user navigates an environment in real-time, wherein the video input from the camera comprises data representative of a field of vision of the camera;

program instructions to process the video input from the camera to identify, in real-time, a visible element in the field of vision of the camera;

program instructions to compare the visible element in the field of vision of the camera, and the data representative of the interest of the user to determine whether the visible element is of interest to the user; and

responsive to determining that the visible element is of interest to the user, program instructions to provide a notification to the user.

16. The computer system of claim 15, wherein the program instructions stored on the one or more computer readable storage media further comprise:

program instructions to determine whether the visible element is in the field of vision of the camera; and

responsive to determining that the visible element is in the field of vision of the camera, program instructions to visually notify the user of the visible element.

17. The computer system of claim 16, wherein the program instructions stored on the one or more computer readable storage media further comprise:

responsive to determining that the visible element is not within the field of vision of the camera, program instructions to provide an indication to the user of a direction of the visible element relative to the field of vision of the camera.

18. The computer system of claim 15, wherein the field of vision of the camera is coextensive with a real-time field of vision of the user.

19. The computer system of claim 17, wherein the indication to the user of the direction of the visible element relative to the field of vision of the camera comprises one or more of:

a visual notification;

an aural notification; and

a haptic notification.

20. The computer system of claim 16, wherein the program instructions to, responsive to determining that the visible element is not within the field of vision of the camera comprise:

program instructions to provide an indication to the user of a direction to turn in order to see the visible element.