Image display and interaction using a mobile device

• US 10,671,264 B2
• Filed: 08/31/2018
• Issued: 06/02/2020
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Howard, James A., Dascola, Jonathan R.
• Primary Examiner(s): Bautista, Xiomara L
• Application Number:
  US16/119,969
• Publication Number:
  US 20190065039A1
• Time in Patent Office: 641 Days
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

A system and method are described for delivering content to a mobile device using a companion device. The companion device acts as a proxy device to send and receive signals on behalf of other proxied devices. Once content is loaded onto the mobile device, a user can navigate through the content using a navigation path determined based on a user'"'"'s item of focus. Various transitions and animations can be displayed along the navigation path. Moreover, a user can interact with the content when viewed in a specific layout using touch events or a rotation input device.

Claims

1. A method, comprising:

at a mobile device with one or more processors, a display device, and a rotation input device;

rendering a first set of a plurality of images stored by the mobile device into a first layout using the display device;

receiving rotation input from the rotation input device;

determining a second layout different from the first layout based at least in part on the rotation input;

determining a second set of the plurality of images different from the first set of the plurality of images based at least in part on a navigation path, wherein the navigation path comprises an indication of how a view of the plurality of images would change between the first layout and the second layout; and

rendering a subset of the plurality of images into the second layout using the display device.

2. The method of claim 1, wherein rendering the first or second layout comprises generating a grid of images constructed based at least in part on a density factor associated with images in their respective set.

3. The method of claim 1, wherein rendering the first or second layout comprises generating an optimized layout of images constructed using image selection rules.

4. The method of claim 1, further comprising determining the navigation path based at least in part on a center image in the first layout.

5. The method of claim 1, further comprising determining the navigation path based at least in part on user input received via a touchscreen.

6. The method of claim 1, further comprising:

receiving additional rotation input from the rotation input device; and

rendering one or more views, transitions, or animations of the images in the second layout based at least in part on the additional rotation input, wherein at least one of the one or more views, transitions, or animations includes;

generating a scroll through a set of images,

generating a stack transition,

generating deck of cards transition,

generating a tunnel view transition,

manipulating a viewport of an image quilt, or

generating a metadata view.

7. The method of claim 1, further comprising generating haptic feedback based at least in part on the rotation input.

8. The method of claim 1, further comprising generating one or more visual effects based at least in part on a rotational speed of the rotation input and a physics-based model.

9. The method of claim 1, further comprising navigating one or more metadata or image editing options using the rotation input device.

10. The method of claim 1, further comprising reversing a path through layouts of subsets of images based at least in part on a stored navigation path and using the rotation input device.

11. A device, comprising:

a memory;

a rotational input device; and

one or more processors configured to execute instructions to;

render a first set of a plurality of images stored by the device into a first layout using a display device;

receive rotation input from the rotation input device;

determine a second layout different from the first layout based at least in part on the rotation input;

determine a second set of the plurality of images different from the first set of the plurality of images based at least in part on a navigation path, wherein the navigation path comprises an indication of how a view of the plurality of images would change between the first layout and the second layout; and

render a subset of the plurality of images into the second layout using the display device.

12. The device of claim 11, wherein rendering the first or second layout comprises generating a grid of images constructed based at least in part on a density factor associated with images in their respective set or generating an optimized layout of images constructed using image selection rules.

13. The device of claim 11, further comprising instructions to:

receive additional rotation input from the rotation input device; and

render one or more views, transitions, or animations of the images in the second layout based at least in part on the additional rotation input, wherein at least one of the one or more views, transitions, or animations includes;

generating a scroll through a set of images,

generating a stack transition,

generating deck of cards transition,

generating a tunnel view transition,

manipulating a viewport of an image quilt, or

generating a metadata view.

14. The device of claim 11, further comprising instructions to generate one or more visual effects based at least in part on a rotational speed of the rotation input and a physics-based model.

15. The device of claim 11, further comprising instructions to navigate one or more metadata or image editing options using the rotation input device.

16. The device of claim 11, further comprising instructions to reverse a path through layouts of subsets of images based at least in part on a stored navigation path and using the rotation input device.

17. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors of a mobile device with a rotation input device and a memory, configure the one or more processors to perform operations comprising:

rendering a first set of a plurality of images stored by the mobile device into a first layout using a display device;

receiving rotation input from the rotation input device;

determining a second layout different from the first layout based at least in part on the rotation input;

determining a second set of the plurality of images different from the first set of the plurality of images based at least in part on a navigation path, wherein the navigation path comprises an indication of how a view of the plurality of images would change between the first layout and the second layout; and

rendering a subset of the plurality of images into the second layout using the display device.

18. The non-transitory computer-readable storage medium of claim 17, wherein rendering the first or second layout comprises at least one generating a grid of images constructed based at least in part on a density factor associated with images in their respective set or generating an optimized layout of images constructed using image selection rules.

19. The non-transitory computer-readable storage medium of claim 17, further comprising determining the navigation path based at least in part on a center image in the first layout or user input received via a touchscreen.

20. The non-transitory computer-readable storage medium of claim 17, further comprising:

receiving additional rotation input from the rotation input device; and

rendering one or more views, transitions, or animations of the images in the second layout based at least in part on the additional rotation input;

wherein at least one of the one or more views, transitions, or animations includes;

generating a scroll through a set of images,

generating a stack transition,

generating deck of cards transition,

generating a tunnel view transition,

manipulating a viewport of an image quilt, or

generating a metadata view.