Automatically modifying presentation of mobile-device content

• US 8,619,095 B2
• Filed: 04/10/2012
• Issued: 12/31/2013
• Est. Priority Date: 03/09/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jaramillo, David, Loredo, Robert E., Palgon, Jonathan
• Primary Examiner(s): Richer, Aaron M
• Assistant Examiner(s): Akhavannik, Mohammad H
• Application Number:
  US13/443,341
• Publication Number:
  US 20130235073A1
• Time in Patent Office: 630 Days
• Field of Search: 345/619
• US Class Current: 345/619
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

Some embodiments of the inventive subject matter are directed to determining a first setting(s) for presentation of content on a display of a mobile device at a distance from a user. The first setting(s) are based on analysis of characteristics associated with the mobile device. The characteristics are related to a user, an environment external to the mobile device, and content presented via the mobile device. Some embodiments are further directed to detecting a change in one or more of the characteristics in response to presentation of the content on the mobile device. The change is an event that indicates that the first setting(s) are non-optimal for presentation of the content at the distance. Some embodiments are further directed to determining second settings for presentation of content at the distance from the user based on the change in the one or more characteristics.

Claims

1. A computer program product for modifying content presented via a mobile device, the computer program product comprising:

a non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code configured to,

determine one or more first settings for presentation of content on a display of the mobile device,

present the content on the mobile device using the one or more first settings for presentation of the content,

after presentation of the content, via analysis of one or more images that depict a user of the mobile device and a background associated with the user, detect a visible condition of an environment depicted in the background that has an appearance of movement in the background,

access a data store associated with the mobile device, wherein the data store indicates one or more activities that, if performed, would distract the user from the content, wherein the data store includes a description of an activity from the one or more activities indicated in the data store,

detect a value associated with the visible condition of the environment depicted in the background, wherein the value associated with the visible condition of the environment is associated with the description of the activity,

determine, based on the detection of the value associated with the description of the activity in the data store, that the user performs the activity,

select from the data store one or more second settings for presentation of the content on the display of the mobile device, wherein the one or more second settings are associated with the value associated with the visible condition of the environment depicted in the background, and

present the content via the display of the mobile device in accordance with the one or more second settings.

2. The computer program product of claim 1, wherein the computer readable program code is configured to detect a degree of change in appearance of one or more facial features of the user, and wherein the computer readable program code configured to determine the one or more second settings for presentation of the content on the display of the mobile device is configured to select at least one of the one or more second settings configured to set a degree of size of the content proportional to the degree of change in the appearance of the facial feature.

3. The computer program product of claim 1, wherein the computer readable program code configured to detect the visible condition of the environment depicted in the background that has the appearance of the movement in the background is configured to, one or more of, detect activity that occurs to one or more individuals in an environment around the user, detect movement of one or more individuals in an environment behind the user, and detect that the user is inside a vehicle.

4. The computer program product of claim 1, wherein the computer readable program code is configured to determine the one or more first settings for presentation of the content is based on analysis of one or more additional images taken via the mobile device prior to presentation of the content.

5. The computer program product of claim 4, wherein the computer readable program code is further configured to:

generate the one or more first settings based on the analysis of the one or more additional;

store the one or more first settings in the data store;

detect an identity of the user via facial recognition of the user via the analysis of the one or more images;

generate the one or more second settings based at least partially in response to detection of the identity of the user and based on the appearance of the movement in the background; and

store the one or more second settings in the data store.

6. The computer program product of claim 1, wherein the computer readable program code is configured to, based on the appearance of the movement associated with the background, detect one or more of movement of the user relative to the background and movement of one or more objects depicted in the background.

7. The computer program product of claim 6, wherein the computer readable program code configured to detect the one or more of the movement of the user relative to the background and the movement of the one or more objects depicted in the background is configured to one or more of detect that the user is texting on the mobile device, detect that the user is performing a hands-free task, detect that the user is talking on the mobile device, detect that the user is using a telephonic earpiece with the mobile device, detect that the user is removing prescription eyeglasses, detect that the user is driving a vehicle, and detect that the user is walking.

8. The computer program product of claim 1, wherein the computer readable program code configured to determine that the user performs the activity that distracts the user from viewing the content is configured to determine, from the change of the appearance of the background, that the user is in a location where the user can perform the activity.

9. The computer program product of claim 1, wherein the computer readable program code configured to present the content via the display of the mobile device in accordance with the one or more second settings is configured to one or more of move a position of the content on the display, scroll content automatically via the display, activate a zooming feature of the content via the display, change back lighting levels of the display, change power settings of the display, switch to a voice activation mode of the mobile device, add sounds to presentation of the content via the mobile device, present an audio version of text that is presented on the display of the mobile device, transfer presentation of at least a portion of the content to a second display, and turn off presentation of at least a portion of the content.

10. A system comprising:

a processing unit; and

a mobile device content modification module operable to, via the processing unit,

present content on a mobile device using one or more first settings for presentation of the content,

in response to presentation of the content on the mobile device, analyze one or more recorded images that depict a user of the mobile device and a background associated with the user,

detect, based on analysis of the one or more recorded images, a visible condition of an environment depicted in the background that has an appearance of movement relative to the background,

access a data store associated with the mobile device, wherein the data store indicates one or more activities that, if performed, would distract the user from the content, wherein the data store includes a description of an activity from the one or more activities indicated in the data store,

detect a value associated with the visible condition of the environment depicted in the background, wherein the value associated with the visible condition of the environment is associated with the description of the activity,

determine, based on the detection of the value associated with the description of the activity in the data store, that the user performs the activity, wherein the activity, when performed, distracts the user from perceiving the content when presented using the one or more first settings,

select from the data store one or more second settings for presentation of the content via the mobile device, wherein the one or more second settings are associated with the value, and

present the content via the mobile device in accordance with the one or more second settings.

11. The system of claim 10,

wherein the activity comprises one or more of talking on the mobile device, texting on the mobile device, walking, driving, and performing a hands-free task.

12. The system of claim 10, wherein the mobile device content modification module is operable to detect that the activity occurs by one or more individuals other than the user within the environment.

13. The system of claim 10, wherein the mobile device content modification module operable to determine the one or more first settings for presentation of the content is based on first digital analysis of one or more additional recorded images taken via the mobile device and wherein the mobile device content modification module is operable to detect, based on second digital analysis of the one or more recorded images taken via the mobile device, movement of the background relative to the user.

14. The system of claim 13, wherein the wherein the mobile device content modification module is further operable to:

generate the one or more first settings based on the first digital analysis;

store the one or more first settings in the data store;

detect an identity of the user via facial recognition of the user via the second digital analysis;

generate the one or more second settings based on the second digital analysis of the one or more recorded images at least partially in response detection of the identity of the user and based on the detection that the user performs the activity; and

store the one or more second settings in the data store.

15. A computer program product comprising:

a non-transitory, computer readable storage medium having computer readable program code embodied therewith, the computer readable program code configured to,

present content via a mobile device,

analyze an appearance of a user and a background depicted in one or more images obtained via the mobile device,

based on analysis of the appearance of the user and the background, detect a visible condition of an environment depicted in the background that has an appearance of movement,

access a data store associated with the mobile device, wherein the data store indicates a description of an activity that, if performed, would distract the user from presentation of the content via the mobile device,

detect a value in the data store associated with the visible condition of the environment depicted in the background, wherein the value associated with the visible condition of the environment is associated with the description of the activity,

select from the data store one or more settings for presentation of the content via the mobile device, wherein the one or more settings are associated with one or more of the value and the description of the activity in the data store, and

change the presentation of the content according to the one or more settings.

16. The computer program product of claim 15, wherein prior to analyzing the appearance of the user and the background, the content is presented in a visual format from a visual output mechanism of the mobile device, and wherein the computer readable program code configured to change the presentation of the content is configured to one or more of change the presentation of the content in the visual format to an audio format presented via an audio output mechanism associated with the mobile device and change the mobile device to a voice activation mode.

17. The computer program product of claim 15, wherein the computer readable program code configured to detect the visible condition of the environment depicted in the background that has the appearance of movement is configured to detect one or more of movement of the user relative to the background, movement of one or more objects depicted in the background, and movement of one or more individuals in the background other than the user.

18. The computer program product of claim 15, wherein the computer-readable program code is configured to one or more of determine that the user is talking on the mobile device, determine that the user is texting on the mobile device, determine that the user is walking, determine that the user is driving, and determine that the user is performing a hands-free task.