Information processing apparatus, information processing method, and program

• US 9,904,454 B2
• Filed: 08/30/2017
• Issued: 02/27/2018
• Est. Priority Date: 10/08/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Miyazawa, Yusuke, Ikeda, Tetsuo, Homma, Fuminori, Miyazaki, Reiko, Miyashita, Ken, Moriya, Shoichiro
• Primary Examiner(s): Wu, Xiao
• Assistant Examiner(s): Akhavannik, Mohammad H
• Application Number:
  US15/690,719
• Publication Number:
  US 20180004382A1
• Time in Patent Office: 181 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A method is provided for modifying an image. The method comprises displaying an image, the image comprising a portion of an object; and determining if an edge of the object is in a location within the portion. The method further comprises detecting movement, in a member direction, of an operating member with respect to the edge. The method still further comprises moving, if the edge is not in the location, the object in an object direction corresponding to the detected movement; and modifying, if the edge is in the location, the image in response to the detected movement, the modified image comprising the edge in the location.

Claims

1. An apparatus, comprising:

a display;

a touch panel;

a processor; and

a non-transitory computer-readable medium encoded with instructions which, when executed by the processor, cause the apparatus to;

display, in a region of the display, a portion of a scrollable display object including a plurality of respective items, the display object including an edge and having at least one of the plurality of respective items located adjacent the edge;

detect a movement operation in which an operating object moves at least partially in a first direction along the touch panel while in contact with the touch panel;

determine, during the movement operation, whether the edge of the display object has reached the region of the display;

when, during the movement operation, the edge of the display object has not reached the region, scroll the display object in the first direction within the region;

when, during the movement operation, the edge of the display object has reached the region, refrain from moving the edge of the display object in the first direction;

detect, during the movement operation, an overdrag operation in which the operating object moves at least partially in the first direction at a time after the edge of the display object has reached the region of the display; and

in response to detecting the overdrag operation and before the operating object releases contact with the touch panel, display, under control of the operating object, a graphic element in the region that at least partially overlays the at least one of the plurality of items adjacent the edge.

2. The apparatus of claim 1, wherein the computer-readable medium is encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

monitor a characteristic of the detected movement of the operating object during the movement operation; and

modify at least one feature of the graphic element during the movement operation based on changes to the monitored characteristic.

3. The apparatus of claim 2, wherein the monitored characteristic of the detected movement comprises a distance traveled by the operating object along the touch panel.

4. The apparatus of claim 3, wherein the at least one modified feature of the graphic element comprises a shape of the graphic element.

5. The apparatus of claim 4, wherein the at least one modified feature of the graphic element further comprises a size of the graphic element.

6. The apparatus of claim 1, wherein the instructions that cause the apparatus to display the graphic element in the region comprise additional instructions which, when executed by the processor, cause the apparatus to:

display the graphic element in an orientation that depends on a direction of the overdrag operation.

7. The apparatus of claim 1, wherein the computer-readable medium is encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

modify a shape of the graphic element based on an extent of the overdrag operation.

8. The apparatus of claim 7, wherein the computer-readable medium is encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

modify a size of the graphic element based on the extent of the overdrag operation.

9. The apparatus of claim 1, wherein the graphic element comprises a curved shape, and the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

update a degree of curvature of the curved shape based on an extent of the overdrag operation.

10. The apparatus of claim 9, wherein the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

orient the curved shape in the region in a direction corresponding to a direction of the overdrag operation.

11. The apparatus of claim 1, wherein the graphic element comprises a curved shape, and the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

orient the curved shape in the region in a direction corresponding to a direction of the overdrag operation.

12. The apparatus of claim 1, wherein the graphic element comprises a flat edge and a curved shape opposite the flat edge, and the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

display the graphic element in the region so that the curved shape is oriented in a direction of the overdrag operation.

13. The apparatus of claim 12, wherein the graphic element comprises a shaded area.

14. The apparatus of claim 1, wherein the computer-readable medium is encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

identify an end of the movement operation; and

cease displaying the graphic element in the region in response to identifying the end of the movement operation.

15. The apparatus of claim 14, wherein the instructions that cause the processor to cease displaying the graphic element include instructions that, when executed by the processor, cause the graphic element to gradually fade out from the region.

16. A non-transitory computer-readable medium for use with an apparatus including a display, a touch panel, and a processor, wherein the computer-readable medium is encoded with instructions which, when executed by the processor, cause the apparatus to:

display, in a region of the display, a portion of a scrollable display object including a plurality of respective items, the display object including an edge and having at least one of the plurality of respective items located adjacent the edge;

detect a movement operation in which an operating object moves at least partially in a first direction along the touch panel while in contact with the touch panel;

determine, during the movement operation, whether the edge of the display object has reached the region of the display;

when, during the movement operation, the edge of the display object has not reached the region, scroll the display object in the first direction within the region;

when, during the movement operation, the edge of the display object has reached the region, refrain from moving the edge of the display object in the first direction;

detect, during the movement operation, an overdrag operation in which the operating object moves at least partially in the first direction at a time after the edge of the display object has reached the region of the display; and

in response to detecting the overdrag operation and before the operating object releases contact with the touch panel, display, under control of the operating object, a graphic element in the region that at least partially overlays the at least one of the plurality of respective items adjacent the edge.

17. The computer-readable medium of claim 16, encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

monitor a characteristic of the detected movement of the operating object during the movement operation; and

modify at least one feature of the graphic element during the movement operation based on changes to the monitored characteristic.

18. The computer-readable medium of claim 17, wherein the monitored characteristic of the detected movement comprises a distance traveled by the operating object along the touch panel.

19. The computer-readable medium of claim 18, wherein the at least one modified feature of the graphic element comprises a shape and a size of the graphic element.

20. The computer-readable medium of claim 16, wherein the instructions that cause the apparatus to display the graphic element in the region comprise additional instructions which, when executed by the processor, cause the apparatus to:

display the graphic element in an orientation that depends on a direction of the overdrag operation.

21. The computer-readable medium of claim 16, encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

modify a shape of the graphic element based on an extent of the overdrag operation.

22. The computer-readable medium of claim 21, encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

modify a size of the graphic element based on the extent of the overdrag operation.

23. The computer-readable medium of claim 16, wherein the graphic element comprises a curved shape, and the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

update a degree of curvature of the curved shape based on an extent of the overdrag operation.

24. The computer-readable medium of claim 23, wherein the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

orient the curved shape in the region in a direction corresponding to a direction of the overdrag operation.

25. The computer-readable medium of claim 16, wherein the graphic element comprises a curved shape, and the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

orient the curved shape in the region in a direction corresponding to a direction of the overdrag operation.

26. The computer-readable medium of claim 16, wherein the graphic element comprises a flat edge and a curved shape opposite the flat edge, and the instructions that cause the apparatus to display the graphic element in the region comprise additional instruction which, when executed by the processor, cause the apparatus to:

display the graphic element in the region so that the curved shape is oriented in a direction of the overdrag operation.

27. The computer-readable medium of claim 26, wherein the graphic element comprises a shaded area.

28. The computer-readable medium of claim 16, encoded with additional instructions which, when executed by the processor, further cause the apparatus to:

identify an end of the movement operation; and

cease displaying the graphic element in the region in response to identifying the end of the movement operation.

29. The computer-readable medium of claim 28, wherein the instructions that cause the processor to cease displaying the graphic element include instructions that, when executed by the processor, cause the graphic element to gradually fade out from the region.

30. A method for operating an apparatus including a display and a touch panel, the method comprising:

displaying, in a region of the display, a portion of a scrollable display object including a plurality of respective items, the display object including an edge and having at least one of the plurality of respective items located adjacent the edge;

detecting a movement operation in which an operating object moves at least partially in a first direction along the touch panel while in contact with the touch panel;

in response to a first portion of the movement operation, scrolling the display object in the first direction within the region of the display;

determining that the edge of the display object reaches the region during the movement operation;

detecting, during a second portion of the movement operation, an overdrag operation in which the operating object moves at least partially in the first direction at a time after the edge of the display object has reached the region of the display;

refraining from moving the edge of the display object in the first direction in response to the second portion of the movement operation; and

in response to detecting the overdrag operation and before the operating object releases contact with the touch panel, displaying, under control of the operating object, a graphic element in the region that at least partially overlays the at least one of the plurality of respective items adjacent the edge.