IMAGE DISPLAY AND INTERACTION USING A MOBILE DEVICE

• US 20160062623A1
• Filed: 09/02/2014
• Published: 03/03/2016
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Howard, James A., Dascola, Jonathan R.
• Granted Patent: US 10,095,394 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

A system and method are described for delivering content to a mobile device using a companion device. The companion device acts as a proxy device to send and receive signals on behalf of other proxied devices. Once content is loaded onto the mobile device, a user can navigate through the content using a navigation path determined based on a user'"'"'s item of focus. Various transitions and animations can be displayed along the navigation path. Moreover, a user can interact with the content when viewed in a specific layout using touch events or a rotation input device.

Claims

1. A method comprising:

at a mobile device with one or more processors and memory;

establishing a wireless connection with a second device;

receiving using the wireless connection a first signal from the second device, the first signal indicative of a change in a collection of images accessible to the second device;

generating a signature of a collection of images stored in the memory;

sending using the wireless connection the signature to the second device;

receiving using the wireless connection a second signal generated by second device based on the signature, the second signal indicative of an identifier for each image in the collection of images accessible to the second device;

determining how the collection of images stored in the memory changes based on the second signal; and

performing an action that modifies the collection of images stored in the memory based on a determined change to the collection of images stored in the memory.

2. The method of claim 1 wherein receiving the first signal from the second device comprises receiving a dirty bit signaling a change to the mobile device.

3. The method of claim 1 wherein generating the signature of the collection of images stored in the memory comprises generating a hash of a set of identifiers associated with each image in the collection.

4. The method of claim 1 wherein receiving the second signal generated by second device based on the signature comprises receiving a set of identifiers associated images accessible to the second device, at least some of the identifiers having version information.

5. The method of claim 1 wherein determining how the collection of images stored in the memory changes based on the second signal comprises determining to delete an image from the collection, determining to add an image to the collection, determining to preserve an existing image in the collection, or determining to apply one or more edits to an image in the collection.

6. The method of claim 1 wherein performing the action that modifies the collection of images comprises deleting an image from memory when an identifier for the image is not present in the second signal, adding an image to the memory, requesting an image from the second device, downloading an image from the second device, performing one or more edits to an image, downloading a new version of an image, downloading a set of operations to apply to an existing image, or replacing an existing image with a new image.

7. A method, comprising:

at a mobile device with one or more processors, a display device, and a rotation input device;

rendering a first set of plurality of images stored by the mobile device into a first layout using the display device;

receiving rotation input from the rotation input device;

determining a second layout different from the first layout based on the rotation input;

determining a second set of the plurality of images different from the first set based on a navigation path; and

rendering the subset of the plurality of images into the second layout using the display device.

8. The method of claim 7 wherein rendering the first or second layout comprises generating a grid of images constructed based on a density factor associated with images in their respective set.

9. The method of claim 7 wherein rendering the first or second layout comprises generating an optimized layout of images constructed using image selection rules.

10. The method of claim 7 further comprising determining the navigation path based on a center image in the first layout.

11. The method of claim 7 further comprising determining the navigation path based on user input received via a touchscreen.

12. The method of claim 7 further comprising:

receiving additional rotation input from the rotation input device; and

rendering one or more views, transitions, or animations of the images in the second layout based on the additional input;

wherein at least one of the one or more views, transitions, or animations includes;

generating a scroll through a set of images,

generating a stack transition,

generating deck of cards transition,

generating a tunnel view transition,

manipulating a viewport of an image quilt, or

generating a metadata view.

13. The method of claim 7 further comprising:

generating haptic feedback based on the rotation input.

14. The method of claim 7 further comprising generating one or more visual effects based on a rotational speed of the rotation input and a physics-based model.

15. The method of claim 7 further comprising navigating one or more metadata or image editing options using the rotation input device.

16. The method of claim 7 further comprising reversing a path through layouts of subsets of images based on a stored navigation path and using the rotation input device.

17. A method comprising:

at a mobile device with one or more processors, a display device having a touch interface, and a memory;

rendering a first set of a plurality of images stored in the memory into a first layout using the display device;

receiving a touch event triggered by a user interacting with the touch interface;

determining a navigation path based on the touch event;

determining a second set of the plurality of images based on the navigation path; and

rendering the second set of the plurality of images into a second layout different from the first using the display device.

18. The method of claim 17 wherein determining the navigation path based on the touch event comprises determining a state within a tri-state view optimization.

19. The method of claim 17 further comprising:

receiving one or more gestures using the touch interface;

receiving rotation input using a rotation input device; and

manipulating a view based on the one or more gesture and the rotation input.

20. The method of claim 17 wherein rendering the first or second set of the plurality of images stored in the memory comprises:

grouping at least some of the images in a set based on selection criteria; and

determining one or more representational images for each group; and

arranging the one or more representational images for each group in a layout according to predetermined criteria.