Movement based image transformation

• US 9,354,721 B2
• Filed: 09/28/2012
• Issued: 05/31/2016
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Manzari, Behkish J., Roth, Rachel A.
• Primary Examiner(s): EURICE, MICHAEL
• Application Number:
  US13/630,366
• Publication Number:
  US 20140092002A1
• Time in Patent Office: 1,341 Days
• Field of Search: 345/156, 715/255, 715/863
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour

Abstract

In some implementations, an image can be presented in an image editing interface and the image can be edited based on movement of the mobile device. In some implementations, the mobile device can be configured to provide a plurality of types edits (e.g., filters, effects, etc.) that can be applied to the image, a selection of one or more edit types can be received, movement sensor data can obtained describing movement of the mobile device, and the selected edits can be applied to the image based on the sensor data.

Claims

1. A method comprising:

presenting content of an image file in an image editing interface of a mobile device, wherein the image editing interface includes a plurality of edits that can be applied to the content of the image file;

obtaining sensor data measuring movement of the mobile device; and

applying an edit of the plurality of edits to the content of the image file based on the movement measured at the mobile device, comprising;

determining a linear or angular direction of the movement of the mobile device from the sensor data;

selecting the edit from the plurality of edits according to the linear or angular direction of the movement;

increasing or decreasing an aspect of a filter or effect associated with the edit according to an amount of the movement of the mobile device, wherein the amount of the movement controls a degree to which the edit is applied to the image, a higher amount of movement causing a higher amount of change in the content of the image file and a higher amount of visual difference between changed content of the image file and content of the image file before the change; and

applying the aspect of the filter or effect associated with the edit to the content of the image file.

2. The method of claim 1, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a rotation about an axis; and

selecting the edit comprises selecting a first edit when the rotation about the axis is to a first direction or selecting a second edit when the rotation about the axis is to a second direction.

3. The method of claim 1, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a translation along an axis; and

selecting the edit comprises selecting a first edit when the translation along the axis slides to a first direction or selecting a second edit when the translation along the axis slides to a second direction.

4. The method of claim 1, comprising:

detecting that the mobile device simultaneously moves along a first axis and along a second axis; and

selecting a first edit upon detecting that the mobile device moves along the first axis and selecting a second edit upon detecting that the mobile device moves along the axis, wherein selecting the first edit and selecting the second edit appear simultaneous to a user of the mobile device.

5. The method of claim 1, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a pattern of movement; and

selecting the edit comprises selecting a first edit when the movement includes a first pattern or selecting a second edit when the movement includes a second pattern.

6. The method of claim 5, wherein the pattern of movement is a shake or a slap, and the aspect includes at least one of a contrast, brightness, saturation, hue or chroma.

7. The method of claim 5, wherein determining that the movement includes the pattern comprises determining an amount of acceleration of the mobile device around an axis.

8. A non-transitory computer-readable medium including one or more sequences of instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

presenting content of an image file in an image editing interface of a mobile device, wherein the image editing interface includes a plurality of edits that can be applied to the content of the image file;

obtaining sensor data measuring movement of the mobile device; and

applying an edit of the plurality of edits to the content of the image file based on the movement measured at the mobile device, comprising;

determining a linear or angular direction of the movement of the mobile device from the sensor data;

selecting the edit from the plurality of edits according to the linear or angular direction of the movement;

increasing or decreasing an aspect of a filter or effect associated with the edit according to an amount of the movement of the mobile device, wherein the amount of the movement controls a degree to which the edit is applied to the image, a higher amount of movement causing a higher amount of change in the content of the image file and a higher amount of visual difference between changed content of the image file and content of the image file before the change; and

applying the aspect of the filter or effect associated with the edit to content of the image file.

9. The non-transitory computer-readable medium of claim 8, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a rotation about an axis; and

selecting the edit comprises selecting a first edit when the rotation about the axis is to a first direction or selecting a second edit when the rotation about the axis is to a second direction.

10. The non-transitory computer-readable medium of claim 8, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a translation along an axis; and

selecting the edit comprises selecting a first edit when the translation along the axis slides to a first direction or selecting a second edit when the translation along the axis slides to a second direction.

11. The non-transitory computer-readable medium of claim 8, the operations comprising:

detecting that the mobile device simultaneously moves along a first axis and along a second axis; and

selecting a first edit upon detecting that the mobile device moves along the first axis and selecting a second edit upon detecting that the mobile device moves along the axis, wherein selecting the first edit and selecting the second edit appear simultaneous to a user of the mobile device.

12. The non-transitory computer-readable medium of claim 8, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a pattern of movement; and

selecting the edit comprises selecting a first edit when the movement includes a first pattern or selecting a second edit when the movement includes a second pattern.

13. The non-transitory computer-readable medium of claim 12, wherein the pattern of movement is a shake or a slap.

14. The non-transitory computer-readable medium of claim 12, wherein determining that the movement includes the pattern comprises determining an amount of acceleration of the mobile device around an axis.

15. A system comprising:

one or more processors; and

a computer-readable medium including one or more sequences of instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising;

presenting content of an image file in an image editing interface of a mobile device, wherein the image editing interface includes a plurality of edits that can be applied to the content of the image file;

obtaining sensor data measuring movement of the mobile device;

applying an edit of the plurality of edits to the content of the image file based on the movement measured at the mobile device, comprising;

determining a linear or angular direction of the movement of the mobile device from the sensor data;

selecting the edit from the plurality of edits according to the linear or angular direction of the movement;

increasing or decreasing an aspect of a filter or effect associated with the edit according to an amount of the movement of the mobile device, wherein the amount of the movement controls a degree to which the edit is applied to the image, a higher amount of movement causing a higher amount of change in the content of the image file and a higher amount of visual difference between changed content of the image file and content of the image file before the change; and

applying the aspect of the filter or effect associated with the edit to content of the image file;

receiving user input; and

in response to receiving the user input, storing the image on a storage device.

16. The system of claim 15, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a rotation about an axis; and

selecting the edit comprises selecting a first edit when the rotation about the axis is to a first direction or selecting a second edit when the rotation about the axis is to a second direction.

17. The system of claim 15, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a translation along an axis; and

selecting the edit comprises selecting a first edit when the translation along the axis slides to a first direction or selecting a second edit when the translation along the axis slides to a second direction.

18. The system of claim 15, the operations comprising:

detecting that the mobile device simultaneously moves along a first axis and along a second axis; and

selecting a first edit upon detecting that the mobile device moves along the first axis and selecting a second edit upon detecting that the mobile device moves along the axis, wherein selecting the first edit and selecting the second edit appear simultaneous to a user of the mobile device.

19. The system of claim 15, wherein:

determining the linear or angular direction of the movement comprises determining from the sensor data that the movement of the mobile device includes a pattern of movement; and

selecting the edit comprises selecting a first edit when the movement includes a first pattern or selecting a second edit when the movement includes a second pattern.

20. The system of claim 19, wherein the pattern of movement is a shake or a slap.

21. The system of claim 19, the operations comprising:

detecting that the mobile device simultaneously moves along a first axis and along a second axis; and

selecting a first edit upon detecting that the mobile device moves along the first axis and selecting a second edit upon detecting that the mobile device moves along the axis, wherein selecting the first edit and selecting the second edit appear simultaneous to a user of the mobile device.