Using spatial information with device interaction

• US 8,843,346 B2
• Filed: 05/13/2011
• Issued: 09/23/2014
• Est. Priority Date: 05/13/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Hodge, Dennis, Ming-kuang Han, Allen
• Primary Examiner(s): Breene, John
• Assistant Examiner(s): Zhang, Ruihua
• Application Number:
  US13/107,692
• Publication Number:
  US 20120290257A1
• Time in Patent Office: 1,229 Days
• Field of Search: 702/151, 702/150, 702/94, 702/156, 715/683, 715/863, 348/135
• US Class Current: 702/151
• CPC Class Codes: G01B 21/16 for measuring distance of clearance between spaced objects
• CPC Class Codes: G01C 1/00 Measuring angles
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

The amount of resources needed for an electronic device to track and/or interact with a user is reduced by utilizing a predicted relative position of that user. In some embodiments, a full 360° scan is performed using at least one image capture element to locate a primary direction to a user of the device. Once this direction is determined, a smaller range (e.g., 45°) centered around that direction can be used to capture, analyze, or provide information for the user. As the user moves, the determined direction is updated and the range adjusted accordingly. If the user moves outside the range, the device can increase the size of the range until the user is located, and the range can again be decreased around the determined direction. Such approaches limit the amount of image or audio information that must be captured and/or analyzed to track the relative position of a user.

Claims

1. A method of capturing information about a user of an electronic device, comprising:

detecting a motion of the electronic device;

storing information corresponding to the motion to temporary storage;

after detecting the motion, analyzing the information to determine an action corresponding to the motion;

predicting a direction of a user with respect to the electronic device based at least in part upon the motion, the predicted direction corresponding to a range of possible physical positions where the user is capable of causing the motion;

selecting at least one capture element of the electronic device having a field of view that includes an angular range surrounding the predicted direction; and

capturing, using the at least one capture element of the electronic device, information over the angular range surrounding the predicted direction of the user to determine an actual direction to the user from the electronic device, the information being captured based at least in part on the action.

2. The method of claim 1, wherein an extent of the angular range is determined at least in part by the action.

3. The method of claim 1, wherein determining an action corresponding to the motion includes comparing a path of the motion with a set of paths, each path corresponding to an associated action.

4. The method of claim 1, wherein the action includes at least one of removing the electronic device from an enclosure, setting down the electronic device, and picking up the electronic device.

5. The method of claim 1, wherein the motion is detected using at least one of an accelerometer, electronic gyroscope, electronic compass, and inertial sensor of the electronic device.

6. A method of managing information on an electronic device, comprising:

determining a first relative position of a user with respect to the electronic device;

selecting a region about the first relative position for which information is to be processed;

processing, using at least one processor, information over the region; and

in response to detecting movement between the user and the electronic device;

predicting a second relative position of the user with respect to the electronic device, based at least in part upon the movement;

selecting a new region about the second relative position, the new region corresponding to a range of physical positions where the user is capable of causing the movement;

selecting at least one capture element of the electronic device having a field of view that includes the new region; and

attempting to verify an actual relative position of the user after the movement using information captured over the new region.

7. The method of claim 6, wherein the movement corresponds to movement of the user, the movement being detected using at least one of image and audio information captured over the region.

8. The method of claim 6, wherein the movement corresponds to movement of the electronic device, the movement being determined using at least one of an accelerometer, electronic gyroscope, electronic compass, and inertial sensor of the electronic device.

9. The method of claim 6, wherein processing information over the region includes processing information captured over only the region or processing only captured information corresponding to the region.

10. The method of claim 6, wherein the region corresponds to an angular range about a determined direction between the electronic device and the first relative position of the user.

11. The method of claim 6, wherein the actual relative position is unable to be determined using information captured over the new region, and further comprising:

increasing a size of the new region; and

attempting to verify the actual relative position of the user using information captured over the size of the new region.

12. The method of claim 6, further comprising:

when the actual relative position is determined, selecting another region about the actual relative position for which information is to be processed.

13. The method of claim 6, further comprising:

analyzing motion information stored for the electronic device over a predetermined period of time to determine a path of travel; and

comparing the path of travel to a set of known path types,

wherein the second relative position of the user with respect to the electronic device is predicted based at least in part upon a known path type matching the path of travel.

14. The method of claim 13, further comprising:

determining an action corresponding to the known path type; and

adjusting at least one aspect of the electronic device based at least in part upon the action.

15. The method of claim 13, further comprising:

attempting to infer an unknown path type for the path of travel based at least in part upon one or more actions taken by the user before or after similar paths of travel.

16. The method of claim 13, further comprising:

adjusting a known path type to reflect a particular path of motion for a particular user.

17. The method of claim 6, wherein selecting a new range about the second relative position includes at least one of selecting at least one capture element corresponding to the new range or specifying a range over which at least one capture element is to capture information.

18. The method of claim 17, wherein the at least one capture element is oriented to capture information from a direction at least partially diagonally across the electronic device.

19. The method of claim 6, wherein the information captured over the new region includes at least one of image information or audio information.

20. The method of claim 6, wherein processing information over the region includes projecting at least one of illuminating light, infrared radiation, image information, and audio information over at least a portion of the region.

21. A computing device, comprising:

a processor;

at least one capture element; and

a memory device including instructions operable to be executed by the processor to perform a set of actions, enabling the computing device to;

determine a relative position of a user with respect to the computing device;

select a region about the relative position for which information is to be processed;

process information over the selected region; and

in response to detecting movement between the user and the computing device;

predict a new relative position of the user with respect to the computing device, based at least in part upon the detected movement;

select a new range about the new relative position, the selected new range corresponding to a range of physical positions where the user is capable of causing the movement;

select at least one capture element of the computing device having a field of view that includes the selected new range; and

attempt to verify an actual relative position of the user after the detected movement using information captured by the at least one capture element over the selected new range.

22. The computing device of claim 21, wherein the detected movement corresponds to at least one of movement of the user, being detected using at least one of image and audio information captured over the selected region, or movement of the computing device, determined using at least one of an accelerometer, electronic gyroscope, electronic compass, and inertial sensor of the computing device.

23. The computing device of claim 21, wherein the actual relative position is unable to be determined using information captured over the selected new range, and wherein the instructions when executed further cause the computing device to:

increase a size of the selected new range; and

attempt to verify the actual relative position of the user using information captured over the size of the selected new range.

24. The computing device of claim 21, wherein the instructions when executed further cause the computing device to:

analyze motion information stored for the computing device over a predetermined period of time to determine a path of travel; and

compare the path of travel to a set of known path types,

wherein the new relative position of the user with respect to the computing device is predicted based at least in part upon a known path type matching the path of travel.

25. The computing device of claim 24, wherein the instructions when executed further cause the computing device to:

determine an action corresponding to the known path type; and

adjust at least one aspect of the computing device based at least in part upon the action.

26. A non-transitory computer-readable storage medium storing processor-executable instructions for controlling a computing device, comprising:

program code for determining a relative position of a user with respect to the computing device;

program code for selecting a region about the relative position for which information is to be processed;

program code for processing information over the region; and

program code for, in response to detecting movement between the user and the computing device;

predicting a new relative position of the user with respect to the computing device, based at least in part upon the detected movement;

selecting a new range about the new relative position, the selected new range corresponding to a range of physical positions where the user is capable of causing the detected movement;

selecting at least one capture element of the computing device having a field of view that includes the selected new range; and

attempting to verify an actual relative position of the user after the detected movement using information captured by the at least one capture element over the selected new range.

27. The non-transitory computer-readable storage medium of claim 26, further comprising:

program code for analyzing motion information stored for the computing device over a predetermined period of time to determine a path of travel; and

program code for comparing the path of travel to a set of known path types,

wherein the new relative position of the user with respect to the computing device is predicted based at least in part upon a known path type matching the path of travel.

28. The non-transitory computer-readable storage medium of claim 27, further comprising:

program code for determining an action corresponding to the known path type matching the path of travel; and

program code for adjusting at least one aspect of the computing device based at least in part upon the determined action.