Automated method of displaying personalized photos on a digital picture frame

• US 10,467,986 B2
• Filed: 10/11/2016
• Issued: 11/05/2019
• Est. Priority Date: 10/10/2013
• Status: Active Grant

• Current Assignee: Aura Home, Inc. (Pushd, Inc.)
• Original Assignee: Pushd, Inc.
• Inventors: Frieder, Ophir, Chowdhury, Abdur, Jensen, Eric, Cherry, Ben, Sanford, Richard, Wirt, Jonathan, Milstein, Scott, Kolcz, Alek, Waldron, Daniel
• Primary Examiner(s): Nguyen, Dustin
• Application Number:
  US15/290,188
• Publication Number:
  US 20170061931A1
• Time in Patent Office: 1,120 Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 2320/08 Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
• CPC Class Codes: G09G 2320/10 Special adaptations of display systems for operation with variable images
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/16 Digital picture frames
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

A digital picture frame including a camera integrated with the frame, and a network connection module allowing the frame for use as a Mobile Positional Social Media (MPSM) device for displaying social media pictures from a user'"'"'s social media account or her or his community members'"'"' social media accounts. The integrated camera is used to automatically determine an identity of a frame viewer, and a viewer profile automatically determined from the identity of the viewer. The displayed photos are automatically shown and/or changed according to the detected viewers.

Claims

1. A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a camera connected to the frame, and a network connection module, the method comprising:

automatically determining with the camera an identity of a user of the digital picture frame;

automatically determining a viewer profile from the identity of the user by automatically learning and uploading a profile from a social media account of the user and supplementing with information stored for the digital picture frame, wherein the viewer profile includes family information, community member information, and user favorites learned through the social media account;

automatically continually updating the viewer profile from the social media account of the user;

automatically comparing photo metadata for each of a plurality of stored user photos to the viewer profile to determine matching user photos;

automatically comparing photo metadata for each of a plurality of stored community member photos to the viewer profile to determine matching community member photos, wherein the stored community member photos are stored on community social media accounts of community members of the user;

automatically downloading, and changing photos shown on the digital display to, the matching user photos and, from the community social media accounts, the matching community member photos, upon detection of the user with the camera;

wherein the method further comprises;

automatically monitoring destinations and member activities of community members of the user at the destinations via electronic devices of the community members;

automatically learning activity patterns at the destinations for each of the community members from manually entered and manually confirmed member information and automatically determined context information associated with the member information;

automatically identifying when any of the community members is participating in a member activity upon future member arrivals at one of the destinations as a function of comparing the context information to a future context of each of the future member arrivals, without receiving any manually entered confirmation or manually entered additional member information;

automatically tagging community member photos taken at any of the each of the future member arrivals with photo metadata of corresponding member activity or destination information;

automatically determining relevant photos of the community members that are relevant to the user from the photo metadata of the tagged community member photos; and

automatically loading and including the relevant photos as the matching community member photos in the display shown on the digital display upon the detection of the user with the camera.

2. The method of claim 1, wherein the plurality of stored photos includes user photos stored in a social media account of the user, and further comprising:

automatically accessing using the network module the social media account of the user; and

automatically loading and displaying photos for display on the digital display from the social media account.

3. The method of claim 2, wherein the plurality of stored photos includes photos stored in a social media account of a community member of the user and further comprising:

automatically accessing using the network module the social media account of the community member; and

automatically loading and displaying photos for display on the digital display from the at least one social media account of the community member.

4. The method of claim 1, further comprising automatically displaying a slideshow of photos relevant to the user on the digital display as a function of photo context selected from time taken, photo location, photo content, or combinations thereof.

5. The method of claim 1, further comprising automatically sequencing photos displayed on the digital display as a function of profiling traits selected from chronological order, photo location, photo activity, community member, or combinations thereof.

6. The method of claim 1, wherein the digital picture frame is hung on a vertical wall.

7. The method of claim 1, further comprising:

automatically monitoring user destinations and user activities of the user at the destinations via a first mobile electronic device of the user;

automatically learning activity patterns at the user destinations for the user from manually entered and manually confirmed user information and automatically determined context information associated with the user information;

automatically identifying that the user is participating in a user activity upon future user arrivals at one of the user destinations as a function of comparing the context information to a future context of each of the future user arrivals, without receiving any manually entered confirmation or manually entered additional user information; and

automatically tagging photos taken at any of the each of the future user arrivals with corresponding user activity or user destination information.

8. The method of claim 7, wherein the user activity or destination information comprises a photo location, a photo activity, and a present community member.

9. The method of claim 1, wherein the photo metadata of the tagged community member photos comprises a photo location, a photo activity, and a present community member.

15. The method of claim 1, further comprising:

receiving a photo context request from the user;

comparing the context request to the photo metadata to filter the matching user photos and the matching community member photos according to the photo context request; and

automatically changing photos shown on the digital display to the filtered matching user photos and the matching community member photos.

16. The method of claim 1, further comprising automatically generating or updating the viewer profile from learned user activities, corresponding locations and corresponding context information.

10. A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a camera connected to the frame, and a network connection module, the method comprising:

automatically monitoring destinations and user activities performed at the destinations of a first user via a first mobile electronic device of the first user;

receiving user information comprising a first user activity performed at at least one of the destinations upon a user arriving at the at least one destination;

automatically learning activity patterns for the first user activity by automatically associating the user information with the at least one of the destinations, automatically determining a user activity context for the first user activity, and automatically comparing a further context of each of a plurality of further user arrivals to the at least one of the destinations to the user activity context;

automatically updating context information associated with the at least one destination from the further context of each of the further user arrivals;

automatically identifying that the first user is participating in the first user activity upon future user arrivals at the at least one destination as a function of comparing the context information to a future context of each of the future user arrivals determined via the first mobile electronic device, without receiving any manually entered confirmation or manually entered additional user information;

automatically tagging photos taken at the destinations with the context information to obtain photo metadata;

automatically determining with the camera an identity of the user when viewing the digital picture frame;

automatically determining a viewer profile from the identity of the user;

automatically comparing the photo metadata to the viewer profile to determine matching photos;

automatically changing photos shown on the digital display to the matching photos upon detection of the user with the camera.

11. The method of claim 10, wherein the photo metadata comprises a photo location, a photo activity, and a present community member.

12. The method of claim 10, wherein each of the user activity context, the further context, and the context information comprises more than one of:

a time of day, a day of a week, a calendar date, a preceding user activity to the user visits, a weather condition, people accompanying the user, or community member activity bias information for the at least one destination.

13. The method of claim 10, further comprising automatically changing photos displayed on the digital display to matching photos for viewer profiles of two or more persons viewing the digital picture frame, upon automatic detection with the camera of the two or more persons viewing the digital picture frame.

14. The method of claim 13, wherein the matching photos from each of the two or more persons comprise shared activity photos from activities shared by the two or more persons, wherein a server computer automatically determines shared activity photos from the photo metadata of photos belonging to the each of the two or more persons, wherein the photo metadata comprises a photo location, a photo activity, and any present community member.