Method and apparatus for modifying the presentation of information based on the visual complexity of environment information

• US 9,339,726 B2
• Filed: 06/29/2012
• Issued: 05/17/2016
• Est. Priority Date: 06/29/2012
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Ashbrook, Daniel L., Nguyen, David H.
• Primary Examiner(s): McDowell, Jr., Maurice L
• Application Number:
  US13/538,358
• Publication Number:
  US 20140002474A1
• Time in Patent Office: 1,418 Days
• Field of Search: 345/589, 345/619, 345/8, 345/633
• US Class Current: 1/1
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/60 Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

Methods, apparatuses, and computer program products are herein provided for modifying the presentation of information based on the visual complexity of environment information. A method may include causing presentation of information on a display. The method may further include determining a visual complexity level of environment information. The method may further include causing, based at least in part on the determined visual complexity level, modification of presentation of at least a portion of the information on the display. Corresponding apparatuses and computer program products are also provided.

Claims

1. A method comprising:

causing presentation of overlay information on a display in at least partially transparent form over environment information, wherein the environment information is currently visible to a user of a device through the display, wherein the overlay information is different than the environment information, wherein the display defines a plurality of portions that each correspond to different portions of the environment information;

receiving current input from at least one forward-facing camera, wherein the current input includes the environment information;

determining, by a processor, a visual complexity level of a portion of the environment information that corresponds to a portion of the display from the current input, wherein the visual complexity level is based on at least one of;

a degree of contrast in colors of the environment information, a size of features within the environment information, a proximity of features within the environment information to the user, an intensity level of the environment information, or a clarity level of the environment information;

determining a current view of the user through the display based on input received from a gaze tracker; and

causing, based at least in part on the determined visual complexity level of the portion of the environment information and the current view of the user, in an instance in which the visual complexity level of the portion of the environment information is determined to be lower than a threshold visual complexity level, modification of a position of at least a portion of the overlay information on the display by causing the portion of the overlay information to be presented over and affixed to the portion of the environment information from perspective of the user such that the portion of the overlay information remains presented over the portion of the environment information from the perspective of the user independent of movement of the display relative to the portion of the environment information.

2. The method according to claim 1, further comprising causing modification of presentation of the portion of the overlay information to become less complex in an instance in which the determined visual complexity level of the portion of the environment information is greater than a second threshold visual complexity level.

3. The method according to claim 2, wherein causing presentation of the portion of the overlay information to become less complex comprises causing some of the portion of the overlay information to be removed.

4. The method according to claim 2, wherein causing modification of presentation of the portion of the overlay information comprises causing modification to the portion of the overlay information in at least one of:

size, color, or brightness.

5. The method according to claim 1, wherein determining the visual complexity level comprises determining the visual complexity level based at least further in part on output provided by the gaze tracker.

6. The method of claim 1, wherein the display defines a pass-through display.

7. An apparatus comprising at least one processor and at least one memory including computer program code, the memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

cause presentation of overlay information on a display in at least partially transparent form over environment information, wherein the environment information is currently visible to a user of a device through the display, wherein the overlay information is different than the environment information, wherein the display defines a plurality of portions that each correspond to different portions of the environment information;

receive current input from at least one forward-facing camera, wherein the current input includes the environment information;

determine a visual complexity level of a portion of the environment information that corresponds to a portion of the display from the current input, wherein the visual complexity level is based on at least one of;

a degree of contrast in colors of the environment information, a size of features within the environment information, a proximity of features within the environment information to the user, an intensity level of the environment information, or a clarity level of the environment information;

determine a current view of the user through the display based on input received from a gaze tracker; and

cause, based at least in part on the determined visual complexity level of the portion of the environment information and the current view of the user, in an instance in which the visual complexity level of the portion of the environment information is determined to be lower than a threshold visual complexity level, modification of a position of at least a portion of the overlay information on the display by causing the portion of the overlay information to be presented over and affixed to the portion of the environment information from perspective of the user such that the portion of the overlay information remains presented over the portion of the environment information from the perspective of the user independent of movement of the display relative to the portion of the environment information.

8. The apparatus of claim 7, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to cause modification of presentation of the at least a portion of the overlay information to become less complex in an instance in which the determined visual complexity level of the portion of the environment information is greater than a second threshold visual complexity level.

9. The apparatus of claim 8, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to cause presentation of the portion of the overlay information to become less complex by causing some of the portion of the overlay information being presented to be removed.

10. The apparatus of claim 8, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to cause modification of presentation of the portion of the overlay information by causing modification to the portion of the overlay information in at least one of:

size, color, or brightness.

11. The apparatus of claim 7, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to determine the visual complexity level by determining the visual complexity level based at least further in part on output provided by the gaze tracker.

12. The apparatus of claim 7, wherein the display defines a pass-through display.

13. Computer program product comprising a non-transitory computer readable medium having program code portions stored thereon, the program code portions being configured when said program product is run on a computer or network device, to:

cause presentation of overlay information on a display in at least partially transparent form over environment information, wherein the environment information is currently visible to a user of a device through the display, wherein the overlay information is different than the environment information, wherein the display defines a plurality of portions that each correspond to different portions of the environment information;

receive current input from at least one forward-facing camera, wherein the current input includes the environment information;

determine a visual complexity level of a portion of the environment information that corresponds to a portion of the display from the current input, wherein the visual complexity level is based on at least one of;

a degree of contrast in colors of the environment information, a size of features within the environment information, a proximity of features within the environment information to the user, an intensity level of the environment information, or a clarity level of the environment information;

determine a current view of the user through the display based on input received from a gaze tracker; and

cause, based at least in part on the determined visual complexity level of the portion of the environment information and the current view of the user, in an instance in which the visual complexity level of the portion of the environment information is determined to be lower than a threshold visual complexity level, modification of a position of at least a portion of the overlay information on the display by causing the portion of the overlay information to be presented over and affixed to the portion of the environment information from perspective of the user such that the portion of the overlay information remains presented over the portion of the environment information from the perspective of the user independent of movement of the display relative to the portion of the environment information.

14. The computer program product of claim 13, wherein the program code portions are further configured, when said program product is run on a computer or network device, to cause modification of presentation of the portion of the overlay information to become less complex in an instance in which the determined visual complexity level of the portion of the environment information is greater than a second threshold complexity level.

15. The computer program product of claim 14, wherein the program code portions are further configured, when said program product is run on a computer or network device, to cause presentation of the portion of the overlay information to be less complex by causing some of the portion of the overlay information to be removed.

16. The computer program product of claim 14, wherein the program code portions are further configured, when said program product is run on a computer or network device, to cause modification of presentation of the portion of the overlay information by causing modification to the portion of the overlay information in at least one of:

size, color, or brightness.

17. The computer program product of claim 13, wherein the program code portions are further configured, when said program product is run on a computer or network device, to determine the visual complexity level by determining the visual complexity level based at least further in part on output provided by the gaze tracker.

18. The computer program product of claim 13, wherein the display defines a pass-through display.