Image with audio conversation system and method

• US 9,894,022 B2
• Filed: 10/01/2013
• Issued: 02/13/2018
• Est. Priority Date: 07/19/2013
• Status: Expired due to Fees

• Current Assignee: Filmstrip, Inc.
• Original Assignee: Ambient Consulting, LLC
• Inventors: Grossman, Andrew, Krutsch, Kenneth F.
• Primary Examiner(s): Shin, Kyung H
• Application Number:
  US14/043,385
• Publication Number:
  US 20150095433A1
• Time in Patent Office: 1,596 Days
• Field of Search: 709203, 709206, 715716, 700 94, 707608, 707805
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/80 of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML content-based retrieval of web data G06F16/95
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/94 Hypermedia Hyperlinking G06F40/134
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/329 on a disc [VTOC]
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/4756 for rating content, e.g. scoring a recommended movie
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages

Abstract

A system and method are presented to allow audio communication between users concerning an image. The originator of the communication uses a mobile device app to select an image and record an audio commentary. The image and commentary are encoded together into a video file. The app uses a server to analyze the recipient address to determine the preferred mode of delivery. If the recipient is a known user of the app, the file is delivered through a proprietary communication system and viewed by the recipient using the app. Otherwise, the originator'"'"'s app delivers the file through MMS or e-mail for the recipient to view using a standard video player. E-mail and MMS communications include a link for the recipient to download the app. The recipient can download the app and register as a user, which causes a server to download previously delivered files to the new user'"'"'s app.

Claims

1. A computerized method comprising:

a) at a first mobile device, receiving a remote audio image file from a remote mobile device identified through a remote identifier, the remote audio image file having

i) a video portion, and

ii) an audio portion having a remote commentary added to the remote audio image file by the remote mobile device;

b) presenting the video portion of the remote audio image file through a display screen of the first mobile device;

c) while presenting the video portion, presenting the remote commentary in the audio portion of the remote audio image file over an audio output of the first mobile device;

d) after presenting the remote commentary, recording a new commentary through a microphone input of the first mobile device;

e) at the first mobile device, creating a new audio image file by adding the new commentary to the remote commentary in the audio portion of the remote audio image file;

f) wherein the remote commentary and the new commentary are arranged within a single audio track; and

g) transmitting the new audio image file to the remote mobile device using the remote identifier.

2. The method of claim 1, wherein the remote audio image file further has:

iii) metadata indicating a remote creator name and a remote creation time for the remote commentary;

further wherein the step of creating the new audio image file further comprises adding to the metadata of the remote audio image file an indication of a new commentary creator name and a new commentary creation time for the new commentary.

3. The method of claim 1, wherein the remote identifier is selected from a set comprising an e-mail address and a telephone number.

4. The method of claim 3, wherein the new commentary and the remote commentary are joined together as the audio portion of the new audio image file within a single audio track without chapter breaks, and further wherein the metadata identifies a location within the single track and a duration for each commentary in the audio portion.

5. The method of claim 4, wherein the remote audio image file contains a plurality of commentaries within the single audio track, and the metadata indicates a creator name, creation time, time location, and time duration for each of the commentaries.

6. The method of claim 5, wherein the plurality of commentaries and the new commentary are arranged within the single audio track in reverse chronological order.

7. The method of claim 5, wherein the remote audio image file is video file incorporating the single audio track recorded using a video codec, further wherein the steps of presenting the video portion and the step of presenting the remote commentary comprises playing the video file with the single audio track from the time location and for the time duration indicated in the metadata for the remote commentary.

8. The method of claim 7, wherein the video portion consists of a single fixed image.

9. The method of claim 8, wherein the step of creating the new audio image file further comprises extending a duration of the video portion of the remote audio image file to compensate for a duration of the new commentary.

10. A computerized method comprising:

a) at a mobile device, selecting a photographic still image;

b) at the mobile device, recording an audio commentary;

c) at the mobile device, encoding the photographic image and the audio commentary into a video file showing the photographic image along with the audio commentary;

d) at the mobile device, receiving a selection of recipient addresses to receive the video file;

e) at the mobile device, submitting a query to a remote server concerning whether the recipient addresses are associated with users of a audio image app, and receiving a first indication from the remote server that the first user associated with a recipient address uses the audio image app and a second indication from the remote server that a second user does not use the audio image app;

f) at the mobile device, sending the video file to the recipient address via the remote server, wherein the remote server forwards the video file to the audio image app on a first recipient mobile device associated with the recipient address;

g) as a result of receiving the second indication sending the video file to the second user via and alternative message, the alternative message selected from a set comprising an MMS message and an e-mail message, the alternative message including an app link to a to a download location for the audio image app.

11. The computerized method of claim 10, wherein the plurality of recipient addresses comprise a plurality of e-mail address and telephone numbers, further wherein the request to the remote server transmits the plurality of e-mail addresses and telephone numbers.

12. A computerized method comprising:

a) receiving, at a server computer, a communication that a video file was transmitted from a first mobile device to an electronic delivery address, where the electronic delivery address is not associated with a user for an audio image app that can modify the video file;

b) storing, at the server computer, the video file and the electronic delivery address in a database;

c) receiving, at the server computer and from a second mobile device and after step b), a new user registration for the audio image app operating on a second mobile device, the new user registration including the electronic delivery address as a contact address;

d) locating, at the server computer, the video file in the database associated with the electronic delivery address, wherein the electronic delivery address is of a type selected from a set comprising an e-mail address and a telephone number; and

transmitting, from the server computer and to the audio image app on the second mobile device, the video file.