Distracted browsing modes

• US 10,139,898 B2
• Filed: 11/16/2015
• Issued: 11/27/2018
• Est. Priority Date: 08/30/2013
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Taylor, Brett Richard, Ames, Charley, Trahan, Matthew Lloyd, Pilarinos, Dennis
• Primary Examiner(s): McFadden, Susan
• Application Number:
  US14/942,586
• Publication Number:
  US 20160070342A1
• Time in Patent Office: 1,107 Days
• Field of Search: 704275
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1688 the I/O peripheral being integrated loudspeakers
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

Approaches to enable a computing device, such as a phone or tablet computer, to determine when a user viewing the content is being distracted or is generally viewing the content with a sufficient level of irregularity, and present an audible representation of the content during the times when the user is deemed distracted. The determination of when the user is distracted or is otherwise viewing the content with irregularity can be performed using sensor data captured by one or more sensors of the computing device. For example, the computing device may analyze the image data captured by one or more cameras, such as by tracking the movement/location of eye pupils of the user and/or tracking the head movement of the user to detect when the user is distracted.

Claims

1. A computing device, comprising:

a display screen;

an audio output device;

at least one processor; and

memory including instructions that, when executed by the at least one processor, enable the computing device to;

display content on the display screen;

obtain image data including a representation of a feature of a user of the computing device;

determine, based at least in part on a number of times the representation of the feature is obtained over a period of time, that the user is distracted;

convert the content displayed on the display screen into an audible speech representation of the content;

begin rendering the audible speech representation of the content using the audio output device;

determine that the user is no longer distracted; and

discontinue presenting the audible speech representation using the audio output device.

2. The computing device of claim 1, wherein the content displayed includes advertising content, and wherein the memory further comprises instructions that, when executed by the at least one processor, enable the computing device to:

delay the display of new advertising content until the user is no longer distracted.

3. The computing device of claim 1, wherein the memory further comprises instructions that, when executed by the at least one processor, enable the computing device to:

determine that the user of the computing device is distracted; and

perform at least one of dim the display screen, turn off the display screen, or turn off a wireless signal.

4. The computing device of claim 1, wherein the computing device further comprises a camera, and wherein the memory further comprises instructions that, when executed by the at least one processor to determine that the user is distracted, enable the computing device to:

capture image data using the camera, the image data including an additional representation of additional features of the user; and

analyze the image data to determine that the image data represents the user being distracted in viewing the content displayed on the display screen.

5. The computing device of claim 1, wherein the computing device is a mobile computing device, and wherein the memory further comprises instructions that, when executed by the at least one processor to determine that the user is distracted, enable the computing device to

detect movement of the computing device;

and

determine that the movement is greater than a threshold of allowed movement.

6. The computing device of claim 5, wherein the computing device comprises at least one of an accelerometer or a gyroscope, and wherein the memory further comprises instructions that, when executed by the at least one processor to detect the movement, enable the computing device to:

capture movement data from the accelerometer and the gyroscope; and

analyze the movement data to determine movement of the computing device.

7. The computing device of claim 1, wherein the memory further comprises instructions that, when executed by the at least one processor, enable the computing device to:

activate a voice command, the voice commend being associated with a function; and

enable the user to navigate the content using at least the voice command.

8. The computing device of claim 7, wherein the memory further comprises instructions that, when executed by the at least one processor, enable the computing device to:

detect the voice command;

suspend the rendering of the speech representation of the content; and

invoke the function associated with the voice command.

9. The computing device of claim 7 wherein the memory further comprises instructions that, when executed by the at least one processor to invoke the function, enable the computing device to:

navigate to a webpage, follow a link, or save the rendering of the speech representation of the content into an audio library of the user.

10. The computing device of claim 1, wherein the memory further comprises instructions that, when executed by the at least one processor to convert the content, enable the computing device to:

determine content selected on a web browser; and

convert the content selected into the audible speech representation.

11. A computer implemented method, comprising:

processing sensor data captured by one or more sensors of a computing device, the computing device including a display screen for displaying content;

obtaining image data including a representation of a feature of a user of the computing device;

determining, based at least in part on a number of times the representation of the feature is obtained over a period of time, that the user is distracted; and

presenting an audible representation of the content using an audio output device in response to determining that the user of the computing device is distracted.

12. The method of claim 11, wherein the content displayed includes advertising content and further comprising:

delaying the display of new advertising content until the user is no longer distracted.

13. The method of claim 11, further comprising:

determining that the user of the computing device is distracted; and

performing at least one of dimming the display screen, turning off the display screen, or turning off a wireless signal.

14. The method of claim 11, further comprising:

capturing the image data using a camera, the image data including an additional representation of additional features of the user; and

analyzing image data to determine that the image data represents the user being distracted in viewing the content displayed on the display screen.

15. The method of claim 11, wherein the computing device is a mobile computing device and wherein determining the user is distracted comprises:

detecting movement of the computing device; and

determining that the movement is greater than a threshold of allowed movement.

16. The method of claim 15, wherein the computing device comprises at least one of an accelerometer or a gyroscope, and wherein detecting the movement of the computing device comprises:

capturing movement data from the accelerometer and the gyroscope; and

analyzing the movement data to determine movement of the computing device.

17. A non-transitory computer readable storage medium storing one or more sequences of instructions that, when executed by one or more processors, cause a computing system to:

process sensor data captured by one or more sensors of a computing device, the computing device including a display screen for displaying content;

obtain image data including a representation of a feature of a user of the computing device;

determine, based at least in part on a number of times the representation of the feature is obtained over a period of time, that the user is distracted; and

present an audible representation of the content using an audio output device in response to determining that the user of the computing device is distracted.

18. The non-transitory computer readable storage medium of claim 17, wherein the content displayed includes advertising content and wherein the instructions, when executed by one or more processors, further cause a computing system to:

delay the display of new advertising content until the user is no longer distracted.

19. The non-transitory computer readable storage medium of claim 17, wherein the instructions, when executed by one or more processors, further cause a computing system to:

determine that the user of the computing device is distracted; and

perform at least one of dimming the display screen, turning off the display screen, or turning off a wireless signal.

20. The non-transitory computer readable storage medium of claim 17, wherein the instructions, when executed by one or more processors, further cause a computing system to:

capture the image data using a camera, the image data including an additional representation of additional features of the user; and

analyze the image data to determine that the image data represents the user being distracted in viewing the content displayed on the display screen.