Viewing images with tilt control on a hand-held device

• US 10,318,017 B2
• Filed: 11/28/2016
• Issued: 06/11/2019
• Est. Priority Date: 01/26/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Cook, Ralph, Molne, Anders L., Carsanaro, Joseph A.
• Primary Examiner(s): Patel, Premal R
• Application Number:
  US15/362,665
• Publication Number:
  US 20170075436A1
• Time in Patent Office: 925 Days
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 5/34 for rolling or scrolling

Abstract

A user interface suitable for use in cellular phones and personal digital assistants (PDAs), PC Tablets, as well as laptops, PCs, office equipment, medical equipment, or any other hand-held electronic device, that allows control of the image on the device display by tilting the device to either change the view in perspective, change the magnification, or both, concurrently, by moving the device. Thus, the tilt of the device controls the angle of view of the image, and moving the device perpendicular to the screen controls the magnification.

Claims

1. A method comprising:

at an electronic device with a display;

displaying a user interface on the display, including, at a first point in time, displaying the user interface with a first displayed perspective, without scrolling the user interface;

while displaying the user interface with the first displayed perspective, detecting a change in orientation of the electronic device; and

,

in response to detecting the change in orientation of the electronic device;

changing a displayed perspective of the user interface on the display based on a magnitude of the change in orientation of the electronic device; and

scrolling the user interface with the displayed perspective, wherein scrolling the user interface with the displayed perspective is distinct from changing the displayed perspective of the user interface;

wherein at a second point in time later than the first point in time, while the electronic device has an orientation different from its orientation at the first point in time, the user interface is displayed with a second displayed perspective different from the first displayed perspective, and the user interface is being scrolled in accordance with the change in orientation of the electronic device.

2. The method of claim 1, wherein:

the displayed perspective of the user interface is configured to be changed up to a maximum tilt angle as the orientation of the electronic device changes; and

the scrolling of the user interface with the displayed perspective is initiated when the orientation of the electronic device is changed beyond a threshold angle while the displayed perspective of the user interface is at the maximum tilt angle.

3. The method of claim 1, wherein:

the displayed perspective of the user interface is configured to be changed up to a maximum tilt angle as the orientation of the electronic device changes; and

the scrolling of the user interface with the displayed perspective is initiated before the displayed perspective of the user interface reaches the maximum tilt angle.

4. The method of claim 1, wherein a velocity of the scrolling is dependent on the magnitude of the change in the orientation of the electronic device.

5. The method of claim 1, including after the scrolling starts, continuing to change the displayed perspective of the user interface in response to changes in the orientation of the electronic device.

6. The method of claim 1, wherein a velocity of the scrolling has a linear relationship to the magnitude of the change in the orientation of the electronic device.

7. The method of claim 1, wherein a velocity of the scrolling has a non-linear relationship to the magnitude of the change in the orientation of the electronic device.

8. The method of claim 1, wherein the displayed perspective of the user interface on the display comprises a tilt of the user interface on the display, distinct from the scrolling of the user interface.

9. An electronic device comprising:

a processor;

a display in data communication with said processor;

a motion-sensing device in data communication with said processor for sensing movement of the electronic device, the motion-sensing device including an accelerometer;

a memory device coupled to said processor, said memory device including instructions to be executed, wherein said instructions, when executed by said processor, cause said processor to;

display a user interface on the display, including, at a first point in time, displaying the user interface with a first displayed perspective, without scrolling the user interface;

while displaying the user interface with the first displayed perspective, detect a change in orientation of the electronic device; and

,

in response to detecting the change in orientation of the electronic device;

change a displayed perspective of the user interface on the display based on a magnitude of the change in orientation of the electronic device; and

scroll the user interface with the displayed perspective, wherein scrolling the user interface with the displayed perspective is distinct from changing the displayed perspective of the user interface

wherein at a second point in time later than the first point in time, while the electronic device has an orientation different from its orientation at the first point in time, the user interface is displayed with a second displayed perspective different from the first displayed perspective, and the user interface is being scrolled in accordance with the change in orientation of the electronic device.

10. The electronic device of claim 9, wherein:

the displayed perspective of the user interface is configured to be changed up to a maximum tilt angle as the orientation of the electronic device changes; and

the scrolling of the user interface with the displayed perspective is initiated when the orientation of the electronic device is changed beyond a threshold angle while the displayed perspective of the user interface is at the maximum tilt angle.

11. The electronic device of claim 9, wherein:

the displayed perspective of the user interface is configured to be changed up to a maximum tilt angle as the orientation of the electronic device changes; and

the scrolling of the user interface with the displayed perspective is initiated before the displayed perspective of the user interface reaches the maximum tilt angle.

12. The electronic device of claim 9, wherein a velocity of the scrolling is dependent on the magnitude of the change in the orientation of the electronic device.

13. The electronic device of claim 9, wherein the memory stores instructions that cause said processor to, after the scrolling starts, continue to change the displayed perspective of the user interface in response to changes in the orientation of the electronic device.

14. The electronic device of claim 9, wherein a velocity of the scrolling has a linear relationship to the magnitude of the change in the orientation of the electronic device.

15. The electronic device of claim 9, wherein a velocity of the scrolling has a non-linear relationship to the magnitude of the change in the orientation of the electronic device.

16. A memory storing executable instructions that, when executed by an electronic device with a processor, a display in data communication with said processor, and a motion-sensing device in data communication with said processor for sensing movement of the electronic device, the motion-sensing device including an accelerometer, cause the electronic device to:

display a user interface on the display, including, at a first point in time, displaying the user interface with a first displayed perspective, without scrolling the user interface;

while displaying the user interface with the first displayed perspective, detect a change in orientation of the electronic device; and

,

in response to detecting the change in orientation of the electronic device;

change a displayed perspective of the user interface on the display based on a magnitude of the change in orientation of the electronic device; and

scroll the user interface with the displayed perspective, wherein scrolling the user interface with the displayed perspective is distinct from changing the displayed perspective of the user interface;

wherein at a second point in time later than the first point in time, while the electronic device has an orientation different from its orientation at the first point in time, the user interface is displayed with a second displayed perspective different from the first displayed perspective, and the user interface is being scrolled in accordance with the change in orientation of the electronic device.

17. The memory of claim 16, wherein:

the displayed perspective of the user interface is configured to be changed up to a maximum tilt angle as the orientation of the electronic device changes; and

the scrolling of the user interface with the displayed perspective is initiated when the orientation of the electronic device is changed beyond a threshold angle while the displayed perspective of the user interface is at the maximum tilt angle.

18. The memory of claim 16, wherein:

the displayed perspective of the user interface is configured to be changed up to a maximum tilt angle as the orientation of the electronic device changes; and

the scrolling of the user interface with the displayed perspective is initiated before the displayed perspective of the user interface reaches the maximum tilt angle.

19. The memory of claim 16, wherein a velocity of the scrolling is dependent on the magnitude of the change in the orientation of the electronic device.

20. The memory of claim 16, wherein the memory stores executable instructions that cause the electronic device to, after the scrolling starts, continue to change the displayed perspective of the user interface in response to changes in the orientation of the electronic device.

21. The memory of claim 16, wherein a velocity of the scrolling has a linear relationship to the magnitude of the change in the orientation of the electronic device.

22. The memory of claim 16, wherein a velocity of the scrolling has a non-linear relationship to the magnitude of the change in the orientation of the electronic device.