Viewing Angle Image Manipulation Based on Device Rotation

• US 20140320535A1
• Filed: 01/10/2014
• Published: 10/30/2014
• Est. Priority Date: 04/26/2013
• Status: Active Grant

• Current Assignee: Flipboard Incorporated
• Original Assignee: Flipboard Incorporated
• Inventors: Ying, Charles
• Granted Patent: US 9,836,875 B2
• Time in Patent Office: Days
• US Class Current: 345/649
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images

Abstract

A user device uses sensors to determine the rotation of the user device with respect to a reference orientation. Using the user device rotation, an image manipulation module accesses images that are associated with image rotations. A set of the images are selected based on the device rotation to select images that have image orientations corresponding to the device rotation. A weight may be determined for each selected image, and the images are combined to generate a blended image using the weights. The blended image is displayed to the user, and as the rotation of the user devices changes, the process is repeated to display changing blended images based on the device rotation, thereby animating the rotation effect.

Claims

1. A method for image manipulation based on device rotation, the method comprising:

determining a device rotation of a user device, the device rotation determined based on an orientation of the user device with respect to a reference orientation;

accessing a plurality of images, each image of the plurality of images associated with an image orientation;

selecting one or more near images from the plurality of images, the selection based on the determined device rotation and the image orientation associated with the one or more selected near images;

generating a blended image by combining the selected one or more near images; and

outputting the blended image for display on the user device.

2. The method of claim 1, wherein the plurality of images are images of an object.

3. The method of claim 1, wherein the image orientation of an image in the plurality of images is based on an angle at which the image was taken relative to an object.

4. The method of claim 1, wherein the image orientation of an image in the plurality of images is based on an angle at which an object in an environment was located when the image was taken.

5. The method of claim 1, wherein the image orientation of an image in the plurality of images is based on an angle at which an object was rotated when the image was taken.

6. The method of claim 1, further comprising:

determining an updated device rotation based on a changed orientation of the user device with respect to the reference orientation; and

repeating the selecting, generating, and outputting steps using the updated device rotation.

7. The method of claim 1, wherein the difference between the device rotation and the image orientation is measured in a distance on a spherical projection.

8. The method of claim 1, further comprising:

determining an angle between the device rotation and each image orientation, and wherein an image is excluded from selection in the set of near images when the excluded image is within a threshold of the angle associated with a selected image.

9. The method of claim 1, further comprising determining a weight for each selected one or more near images, the weight based on the difference between the device rotation and the image orientation, and wherein the generated blended image is based on the weight associated with each near image.

10. The method of claim 9, wherein generating the blended image comprises interpolating pixel values of each near image in the one or more near images based on the associated weights.

11. The method of claim 1, further comprising:

determining that the device rotation is within a region comprising a range of device rotations; and

performing an event based on determining that the device rotation is within the region.

12. The method of claim 11, wherein the event comprises a notification, an image overlay, a sound, or launching an application.

13. The method of claim 1, wherein a single near image is selected.

14. The method of claim 1, wherein the device rotation is determined by a sensor on the user device.

15. The method of claim 1, wherein the device rotation determined by a server that receives the orientation of the user device, and the server generates the blended image.

16. The method of claim 1, wherein the blended image is generated by the user device.

25. The computer program product of claim 1, wherein the computer-readable storage medium further includes computer program code for determining a weight for each selected one or more near images, the weight based on the difference between the device rotation and the image orientation;

and wherein the generated blended image is based on the weight associated with each near image.

26. The computer program product of claim 25, wherein generating the blended image comprises interpolating pixel values of each near image in the one or more near images based on the associated weights.

17. A computer program product for image manipulation based on device rotation, the computer program product comprising a computer-readable storage medium containing computer program code for:

determining a device rotation of a user device, the device rotation determined based on an orientation of the user device with respect to a reference orientation;

accessing a plurality of images, each image of the plurality of images associated with an image orientation;

selecting one or more near images from the plurality of images, the selection based on the determined device rotation and the image orientation associated with the one or more selected near images;

generating a blended image by combining the selected one or more near images; and

outputting the blended image for display on the user device.

18. The computer program product of claim 17, wherein the plurality of images are images of an object.

19. The computer program product of claim 17, wherein the image orientation of an image in the plurality of images is based on an angle at which the image was taken relative to an object.

20. The computer program product of claim 17, wherein the image orientation of an image in the plurality of images is based on an angle at which an object in an environment was located when the image was taken.

21. The computer program product of claim 17, wherein the image orientation of an image in the plurality of images is based on an angle at which an object was rotated when the image was taken.

22. The computer program product of claim 17, wherein the computer-readable storage medium further includes computer program code for:

determining an updated device rotation based on a changed orientation of the user device with respect to the reference orientation; and

repeating the selecting, generating, and outputting steps using the updated device rotation.

23. The computer program product of claim 17, wherein the difference between the device rotation and the image orientation is measured in a distance on a spherical projection.

24. The computer program product of claim 17, wherein the computer-readable storage medium further includes computer program code for:

determining an angle between the device rotation and each image orientation, and wherein an image is excluded from selection in the set of near images when the excluded image is within a threshold of the angle associated with a selected image.

27. The computer program product of claim 17, wherein the computer-readable storage medium further includes computer program code for:

determining that the device rotation is within a region comprising a range of device rotations; and

performing an event based on determining that the device rotation is within the region.

28. The computer program product of claim 27, wherein the event comprises a notification, an image overlay, a sound, or launching an application.

29. The computer program product of claim 17, wherein a single near image is selected.

30. The computer program product of claim 17, wherein the device rotation is determined by a sensor on the user device.